基于改进神经辐射场的民族舞蹈重建方法  

A neural radiation field-based approach to ethnic dance reconstruction

作　　者：邱佳新 宋倩云 徐丹[1] QIU Jiaxin;SONG Qianyun;XU Dan(School of Information Science and Engineering,Yunnan University,Kunming Yunnan 650500,China)

机构地区：[1]云南大学信息学院,云南昆明650500

出　　处：《图学学报》2025年第2期415-424,共10页Journal of Graphics

基　　金：国家自然科学基金(62162068,61540062);云南省万人计划云岭学者专项(YNWR-YLXZ-2018-022);云南省科技厅-云南大学“双一流”建设联合基金重大项目(202301BF070001-025)。

摘　　要：中国民族舞蹈作为一种世代传承的艺术形式,诞生于人民群众的日常生活之中,但是随着社会发展,一些传统的舞蹈存在传承不到位的问题,继而面临着濒临失传的尴尬局面。不同民族的舞蹈各具特色,动作变化复杂,为了更好地对民族舞蹈进行保护,于是提出一种基于改进神经辐射场的民族舞蹈三维重建方法。首先通过一个改进的姿态估计算法,在对姿态进行降噪优化后将形变场分解为由深度神经网络产生的刚性运动以及非刚性运动,并通过线性混合蒙皮将姿态由观测空间映射到标准空间,以此得到一个与姿态无关的形变场。然后,使用神经辐射场来对人体进行三维重建,在重建的过程中使用注意力机制加强边缘色彩的学习,同时对姿态估计得到的人体动作进行优化,最后得到舞蹈者每一帧不同视角的新渲染视图。实验结果表明,该方法能较好地对舞蹈者及舞姿进行三维重建,与HumanNeRF相比,提高了还原的精度。相比传统的、二维的舞蹈保护技术,此方法能更好地还原出舞蹈者的动作,以达到对民族舞蹈保护的目的。Chinese folk dance,as an art form inherited through generations,originates from the everyday lives of the people.However,with the development of the society,some traditional dances face challenges in effective preservation,leading to the risk of cultural loss.Different ethnic dances exhibit unique features and complex movement patterns.In order to enhance the preservation of ethnic dance,a 3D reconstruction method of human body based on an improved neural radiation field was proposed.This method first employed an improved pose estimation algorithm,which decomposed the deformation field into rigid and non-rigid motions generated by a deep neural network after noise reduction and optimization of the poses.The poses were mapped from the observation space to a standard space by linear hybrid skinning,producing a pose-independent deformation field.Then,a neural radiation field was used to reconstruct the 3D model of the human body.Throughout reconstruction,an attention mechanism was used to enhance the learning of edge colors and optimize the body movements obtained from pose estimation.Finally,a new rendered view of the dancer was obtained for each frame from different viewpoints.The experimental results showed that the proposed method can better reconstruct the dancer and the dance posture in 3D,improving the restoration accuracy compared to HumanNeRF.Compared with the traditional 2D dance preservation techniques,the method in this paper can better restore the dancer’s movements,fulfilling the purpose of folk dance preservation.

关 键 词：姿态优化 神经辐射场 三维重建 人体重建 民族舞蹈 

分 类 号：TP391[自动化与计算机技术—计算机应用技术] J722[自动化与计算机技术—计算机科学与技术]