Synthesis,Style Editing,and Animation of 3D Cartoon Face  

作　　者：Ming Guo Feng Xu Shunfei Wang Zhibo Wang Ming Lu Xiufen Cui Xiao Ling 

机构地区：[1]School of Software and BNRist,Tsinghua University,Beijing 100084,China [2]Department of Multimedia and Smart,Guangdong OPPO Mobile Telecommunications Corp.Ltd.,Dongguan 523860,China [3]Intel Labs,Intel,Beijing 100089,China

出　　处：《Tsinghua Science and Technology》2024年第2期506-516,共11页清华大学学报（自然科学版（英文版）

基　　金：supported by the National Key R&D Program of China(No.2018YFA0704000);the Beijing Natural Science Foundation(No.M22024);the National Natural Science Foundation of China(No.62021002);the Key Research and Development Project of Tibet Autonomous Region(No.XZ202101ZY0019G);supported by the Institute for Brain and Cognitive Sciences,BNRist,Tsinghua University,BLBCI,and Beijing Municipal Education Commission.

摘　　要：As a popular kind of stylized face,cartoon faces have rich application scenarios.It is challenging to create personalized 3D cartoon faces directly from 2D real photos.Besides,in order to adapt to more application scenarios,automatic style editing,and animation of cartoon faces is also a crucial problem that is urgently needed to be solved in the industry,but has not yet had a perfect solution.To solve this problem,we first propose“3D face cartoonizer”,which can generate high-quality 3D cartoon faces with texture when fed into 2D facial images.We contribute the first 3D cartoon face hybrid dataset and a new training strategy which first pretrains our network with low-quality triplets in a reconstruction-then-generation manner,and then finetunes it with high-quality triplets in an adversarial manner to fully leverage the hybrid dataset.Besides,we implement style editing for 3D cartoon faces based on k-means,which can be easily achieved without retrain the neural network.In addition,we propose a new cartoon faces'blendshape generation method,and based on this,realize the expression animation of 3D cartoon faces,enabling more practical applications.Our dataset and code will be released for future research.

关 键 词：CARTOON 3D face ANIMATION computer graphics 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程] TP391.41[自动化与计算机技术—控制科学与工程] J218.2[艺术—美术]