虚拟人形象合成技术综述  

Human avatars synthesis technologies:a survey

作　　者：邓钇敏 张旭龙 司世景 王健宗 肖京 DENG Yimin;ZHANG Xulong;SI Shijing;WANG Jianzong;XIAO Jing(Ping An Technology(Shenzhen)Co.,Ltd.,Shenzhen 518063,China;University of Science and Technology of China,Hefei 230026,China;School of Economics and Finance,Shanghai International Studies University,Shanghai 200083,China)

机构地区：[1]平安科技(深圳)有限公司,广东深圳518063 [2]中国科学技术大学,安徽合肥230026 [3]上海外国语大学国际金融贸易学院,上海200083

出　　处：《大数据》2023年第3期114-139,共26页Big Data Research

基　　金：广东省重点领域研发计划“新一代人工智能”重大专项(No.2021B0101400003)。

摘　　要：随着元宇宙兴起,针对虚拟人形象化高效建模的需求日益迫切。从人类图像数据集中构建人类模型一直是计算机视觉的热门话题,其中3D虚拟人合成可以视作三维重建的子模块,重点在于对复杂的人体结构和表面细节的还原。对近年来虚拟人形象构建相关文献进行了全面调研,研究范围覆盖了全身形象、头部形象以及衣物建模等领域。分析归纳构建工作的基本原理,从各自技术路线层面出发将虚拟人合成方法分为基于网格、基于图像、基于体素、基于隐式表示、混合表示5类。首先介绍各类方法的基本原理,然后结合现有工作讨论具体技术,并指出各类方法的优缺点。此外还介绍了部分常见的模型质量评估的数据集和评价指标,简要介绍了虚拟人的常见应用。最后对虚拟人合成技术未来发展方向进行了展望,以合成高质量、高保真度、低延迟的虚拟人形象。Nowadays,the demand for efficient human avatars modeling is becoming increasingly urgent since metaverse has attracted more and more attention.Creating human avatars from human image datasets has always been a popular topic in the field of computer vision.3D human avatars synthesis can be regarded as a sub-module of 3D reconstruction focusing on reproducing the complex articulated body and surface details of human.A comprehensive survey of the literature related to the human reconstruction in recent years was conducted,including the work of full-body avatars,talking-head and clothing modeling.By analyzing and summarizing existing work,human avatars synthesis technologies were divided into five categories:mesh-based methods,image-based methods,voxel-based methods,implicit methods and hybrid methods due to the features of their pipelines.Firstly,the basic principles of them were introduced respectively.Secondly,the realization based on related work was discussed and then the advantages and disadvantages of methods respectively were pointed out.Thirdly,the datasets and metrics for model quality evaluation were introduced.Besides,an overview of various applications was given.Finally,the future directions of human avatars synthesis technology were prospected to synthesize high-quality,high-fidelity and low-latency human avatars.

关 键 词：元宇宙 虚拟人 三维人体重建 计算机视觉 深度学习 人脸合成 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]