基于语音驱动的三维人脸动画技术综述  

Overview on Speech-driven 3D Facial Animation Technology

作　　者：刘贤梅[1] 刘露 贾迪 赵娅[1] 田枫[1] LIU Xian-Mei;LIU Lu;JIA Di;ZHAO Ya;TIAN Feng(School of Computer&Information Technology,Northeast Petroleum University,Daqing 163318,China)

机构地区：[1]东北石油大学计算机与信息技术学院,大庆163318

出　　处：《计算机系统应用》2022年第10期44-50,共7页Computer Systems & Applications

基　　金：黑龙江省自然科学基金(LH2020F003);黑龙江省高等教育教学改革重点委托项目(SJGZ20200037);黑龙江省教育科学“十四五”规划重点课题(GJB1421114)

摘　　要：随着三维数字虚拟人的发展,语音驱动三维人脸动画技术已经成为虚拟人交互的重要研究热点之一.其关键技术在于语音-视觉映射模型的建立以及三维人脸动画的合成.首先分析了音-视素匹配法和音-视觉参数映射两类方法的特点;之后阐述了目前三维人脸模型的建立方法,并依据三维人脸模型的表示方法不同,分析了不同运动控制方法的优缺点;然后阐述了语音驱动三维人脸动画的主观评价和客观评价方法;最后总结了语音驱动三维人脸动画技术的未来发展方向.With the development of 3D digital virtual humans,speech-driven 3D facial animation technology has become one of the important research hotspots in virtual human interaction.The key parts of the speech-driven 3D facial animation technology include the construction of a speech-visual mapping model and the synthesis of 3D facial animation.Specifically,the characteristics of phoneme-viseme matching methods and speech-visual parameter mapping methods are described.Next,the current methods of building 3D facial models are expounded,and the advantages and disadvantages of different motion control methods are analyzed according to the different representation methods of 3D facial models.Then,the subjective and objective evaluation methods for speech-driven 3D facial animation are expounded.Finally,the future development directions of speech-driven 3D facial animation technology are summarized.

关 键 词：三维人脸动画 语音 语音-视觉映射模型 虚拟人 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] TN912.3[自动化与计算机技术—计算机科学与技术]