基于结构光三维重建的头部姿态估计算法  

Head Pose Estimation Algorithm Based on Structured Light Three-Dimensional Reconstruction

作　　者：钟俊宇 邱健[1] 韩鹏[1] 骆开庆[1] 彭力[1] 刘冬梅[1] Zhong Junyu;Qiu Jian;Han Peng;Luo Kaiqing;Peng Li;Liu Dongmei(School of Phgusics and Telecom municatiom Engineering,South China Normal University,Guangzhou,Guatngdoug 510631,China)

机构地区：[1]华南师范大学物理与电信工程学院,广东广州510631

出　　处：《激光与光电子学进展》2020年第18期104-111,共8页Laser & Optoelectronics Progress

基　　金：国家自然科学基金(61975058);广东省自然科学基金(2019A1515011401);广州市科技计划重点项目(201707010485);广州市科技项目(201704020137);华南师大物电学院蓝盾信息安全技术联合实验室课题项目(LD20170208)。

摘　　要：头部姿态估计广泛应用于多个领域,大多基于二维图像,而三维(3D)头部姿态估计与人脸三维重建结合的相关研究较少。利用重建的头部三维信息,可以为估计头部姿态提供更多有效的数据信息,能大大提高头部姿态估计的精确度和准确度。因此,将基于结构光三维重建和3D头部姿态估计相结合,重建人脸三维形貌并实现3D点云可视化。同时提出一种3D头部姿态估计算法,搜索鼻尖和鼻梁,建立空间直角坐标系和人脸本征坐标系,利用人脸的垂直对称性估计头部姿态欧拉角。利用模特人头进行实验,基于结构光三维重建的3D头部姿态估计算法的欧拉角在-25°~25°范围内均可测量,绝对误差的平均值和标准差均小于1°,测量平均值与真实值的线性相关度达99.8%。与基于二维图像的头部姿态估计相比,本文算法具有更高的准确度和鲁棒性。Head pose estimation is widely used in many fields,mostly based on two-dimensional(2D)images.However,there is little research on the combination of three-dimensional(3D)face reconstruction.The reconstructed head 3D information can provide more effective data information for head pose estimation,and greatly improve the accuracy and accuracy of head pose estimation.Hence,in this paper,a recombination of 3D reconstruction based on structured light and 3D head pose estimation is proposed to reconstruct 3D facial morphology and realize 3D point cloud visualization.At the same time,a 3D head pose estimation algorithm is put forward,which searches the nose tip and nose bridge,establishes the space rectangular coordinate system and the face eigen coordinate system,and uses the vertical symmetry of the face to estimate the Euler angle of the head posture.The results show that the Euler angle of the 3D reconstruction can be measured in the range of-25°to 25°.The average and standard deviations of the absolute errors are both less than 1°.The linear correlation between the value and the true value is 99.8%.Comparing with the head pose estimation based on 2D images,the algorithm in this paper is more accurate and robust.

关 键 词：图像处理 结构光 三维重建 人脸本征坐标系 三维头部姿态估计 

分 类 号：O439[机械工程—光学工程]