基于Kinect与网格几何变形的人脸表情动画  

Facial expression animation based on Kinect and mesh geometry deformation

作　　者：张满囤[1,2] 霍江雷[1,2] 单新媛 王小芳[1,2] 吴鸿韬[1,2] ZHANG Mandun;HUO Jianglei;SHAN Xinyuan;WANG Xiaofang;WU Hongtao(School of Computer Science and Engineering, Hebei University of Technology, Tianjin 300401, China;Hebei Province Key Laboratory of Big Data Calculation, Tianjin 300401, China)

机构地区：[1]河北工业大学计算机科学与软件学院,天津300401 [2]河北省大数据计算重点实验室,天津300401

出　　处：《计算机工程与应用》2017年第14期172-177,共6页Computer Engineering and Applications

基　　金：河北省引进留学人员资助项目(No.C2013003015);河北省科技计划项目(No.15210124);河北省高等学校科学技术研究项目(No.Z2015105)

摘　　要：面部表情重建的实时性与重建效果的真实性是人脸表情动画的关键问题,提出一种基于Kinect人脸追踪和几何变形技术的面部表情快速重建新方法。使用微软的Kinect设备识别出表演者面部并记录其特征点数据,并利用捕捉到的特征点建立覆盖人脸的网格模型,从中选取变形使用的控制点数据,由于Kinect可以实时地自动追踪表演者面部,由此实现了利用三种不同变形算法对目标模型实时快速重建。实验结果表明,该方法简单易实施,不用在表演者面部做任何标定,可以自动地将人脸表情动作迁移到目标模型上,实现人脸表情快速重建,并且保证目标模型表情真实自然。The efficiency and realistic of facial expression reconstruction is a key point to facial expression animation.Anovel method of rapidly facial expression reconstruction based on face tracking with Kinect and geometry deformationhas been proposed.The face of actor has been identified using the Kinect device of Microsoft and the feature points havebeen recorded.These feature points are used to construct a mesh model covering the actor’s face.Some control pointshave been chosen for mesh deformation from the mesh model.Because of the real-time face tracking of actor the rapidreconstruct of target model using three different deformation algorithm is realized.The experimental results show that thismethod is easily implemented and needn’t any calibration,automatically immigrates the facial expression to target model.The expression of result model is true and natural.

关 键 词：人脸表情动画 面部表情重建 网格模型 几何变形 KINECT 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]