融合深度学习与外极线约束的三维人体位姿测量方法  

3-D human pose measurement method based on deep learning and epipolar constraint

作　　者：宋丽梅[1] 吕昆昆 杨燕罡 SONG Limei;LYU Kunkun;YANG Yan’gang(Key Laboratory of Advanced Electrical Engineering and Energy Technology,Tianjin Polytechnic University,Tianjin 300387,China;School of mechanical engineering,Tianjin University of Technology and Education,Tianjin 300222,China)

机构地区：[1]天津工业大学电气工程与自动化学院天津市电工电能新技术重点实验室,天津300387 [2]天津职业技术师范大学机械工程学院,天津300222

出　　处：《应用光学》2020年第6期1166-1173,共8页Journal of Applied Optics

基　　金：国家自然科学基金项目(61078041,51806150);天津市应用基础及前沿计划(18JCQNJC04400,16JCYBJC15400,15JCYBJC51700);天津大学精密测试技术及仪器国家重点实验室开放基金(PIL1603);天津市企业科技特派员项目(18JCTPJC61700);天津市高等学校创新团队培养计划的资助(TD13-5036)。

摘　　要：为了实现汽车座椅上三维人体姿态的高精度实时测量,基于现有二维人体关节点和三维人体关节点测量方法,提出了一种融合深度学习与外极线约束的三维人体姿态测量方法。该方法将二维人体关节点深度网络提取方法和双目测量系统相结合,采用双通道多阶段迭代网络分别提取左右相机图像中人体二维关节点,结合关节点位置的Brief特征和外极线约束,利用双目相机标定结果将匹配二维关节点信息转换到三维空间中,最终得到三维人体姿态。实验结果表明,文中提出方法在自采测试集中的检测精度可达到98%。通过得到三维关节点计算所得关键位姿角度的偏差小于10°。该文所提出的方法能够满足实际汽车座椅设计的数据采集要求。It is necessary for the design of car seat to realize the high precision and real-time measurement of the 3-D human pose on the car seat.Based on the existing 2-D and 3-D human joint measurement methods,a 3-D human pose measurement method is proposed,which integrates deep learning and epipolar constraint.This method combines 2-D human joint depth network extraction method with binocular measurement system,uses two-channel multi-stage iterative network to extract 2-D human joint points in the images taken by left and right cameras respectively,combines the Brief feature of joint point position and epipolar constraint,uses binocular camera calibration results to convert the matching 2-D joint point information into 3-D space,and finally obtains 3-D human pose.The experimental results show that the detection accuracy of the proposed method in the self sampling test set can reach 98%.The deviation of the angle of the key position of human body calculated by the 3-D joint point is less than 10°.Therefore,the method proposed in this paper can meet the data acquisition requirements of the actual car seat design.

关 键 词：二维人体关节点 深度神经网络 外极线约束 三维人体位姿 

分 类 号：TN957.52[电子电信—信号与信息处理]