关节轴角先验对3维人体重建结果的影响  

The impact of joint axis angle prior on the results of 3D human body reconstruction

作　　者：姚砺[1] 张幼安 张梦雪 万燕[1] Yao Li;Zhang Youan;Zhang Mengxue;Wan Yan(Computer Science and Technology Department,Donghua University,Shanghai 201620,China)

机构地区：[1]东华大学计算机学院,上海201620

出　　处：《中国图象图形学报》2021年第12期2918-2930,共13页Journal of Image and Graphics

摘　　要：目的3维人体重建的目标在于建立真实可靠的3维人体模型。但目前基于SMPL(skinned multi-person linear model)模型重建3维人体的实验和一些公开数据集中,常常会出现预测的姿势角度值不符合真实人体关节角度规则的现象。针对这一问题,本文提出设置关节旋转角值域,使得重建的结果真实性更强、更符合人体关节机械结构。方法根据人体关节的联接结构将各个关节的运动进行划分。根据划分结果计算关节运动自由度,并结合实际情况提出基于SMPL模型的关节旋转值域。提出一个简单的重建方法来验证值域分析的正确性。结果使用3维人体数据集UP-3D进行相关实验,并对比以往直接根据学习结果生成重建模型的数据。在使用轴角作为损失参数的情况下,重建精度提高显著,平均误差降低15.1%。在使用所有损失函数后,平均误差比直接根据预测值生成重建模型的两段式重建方法降低7.0%。重建结果与UP-3D数据集进行真实性对比有显著的关节联动性效果。结论本文提出的关节旋转角值域设置对基于SMPL模型进行3维人体重建的方法在进行关节点旋转角回归的过程中起到了很大作用,重建的模型也更符合人体关节运动联动性。Objective The goal of 3D human body reconstruction has been building a credible and reliable human body model.The credibility of the reconstructed results cannot be guaranteed entirely subject to the mismatch issue between predicted posture angle value and the real human joint movement based on the skinned multi-person linear model(SMPL).A prior of the joint rotation angle value range make the reconstruction result to fit human joint mechanical structure.The rationality and effectiveness of the value range setting combined with a simple reconstruction method have been demonstrated more better than the 3D SMPL-based reconstruction.The reconstruction accuracy of the model has been significantly improved.Method The two-stage 3D human body reconstruction method has tailored the reconstruction to improve the credibility and provide more details of the 3D human body model effectively in terms of the range setting verification.In the first stage,the description has been preprocessed to reduce noise,to extract key information as well as to remove the background of the image.In the second stage,the reconstruction has been completed via using the posture and shape parameters of the human body in the image learned with the residual network based on the SMPL model.The UP-3D dataset has been used.The details of reconstruction algorithm have been presented as follows:first,the human silhouette image has been extracted based on the render light image in via the UP-3D dataset with the priority of the acquired segmentation of the human body in the dataset.An RGB image of human body with uniform size can be obtained via removing the background of the original image based on the silhouette image.Next,the resized RGB image and the Render light image has been concatenated and used as the input of the pose regression.Silhouette has been input into the body shape regression simultaneously.The residual network has been used to learn human body posture parameters and body shape parameters based on the parametric statistical body shape mo

关 键 词：SMPL模型 3维人体重建 关节角度 重建真实性 关节运动联动性 

分 类 号：TP751.1[自动化与计算机技术—检测技术与自动化装置]