元宇宙中三维场景重建技术综述  

Survey on 3D Scene Reconstruction Techniques in Metaverse

作　　者：宋星诺 王丛妍 陈鸣锴 SONG Xingnuo;WANG Congyan;CHEN Mingkai(Portland College,Nanjing University of Posts and Telecommunications,Nanjing 210023,China;School of Communication and Information Engineering,Nanjing University of Posts and Telecommunications,Nanjing 210003,China)

机构地区：[1]南京邮电大学波特兰学院,南京210023 [2]南京邮电大学通信与信息工程学院,南京210003

出　　处：《计算机科学》2025年第3期17-32,共16页Computer Science

基　　金：国家自然科学基金(62001246);江苏省重点研发计划(BE2023035);江苏省通信与网络技术工程研究中心开放课题(JERCCN202301)。

摘　　要：随着虚拟现实(Virtual Reality,VR)、增强现实(Augmented Reality,AR)、区块链、人工智能(Artificial Intelligence,AI)等多种技术的发展,元宇宙逐渐被应用于游戏、教育、医疗、商业等许多领域。三维重建技术作为元宇宙的核心技术,因具有极高研究价值和广泛应用前景而受到关注。传统的三维重建技术在处理以实时交互性为特点的元宇宙任务中表现不佳,其计算效率以及重建模型精度都有很大提升空间。因此,如何优化三维重建技术,提高精度和鲁棒性,为用户提供更真实、更实时的交互体验,成为当前的研究热点。文中对近几年元宇宙中基于场景生成的三维重建技术进行了跟踪与归纳。首先,回顾元宇宙的发展历程,指出其中三维重建技术面临的挑战,并提出基于两种不同三维表示的解决思路。其次,分别梳理了基于三维高斯(3D Gaussian)和神经辐射场(Neural Radiance Field,NeRF)表示的三维重建技术。然后,主要分析了三维重建技术与触觉信号、大语言模型的创新融合方法。最后,详细探讨了元宇宙中基于场景生成的三维重建技术面临的挑战,并提出其未来研究方向。With the development of various technologies such as virtual reality(VR),augmented reality(AR),blockchain,and artificial intelligence(AI),the metaverse is gradually being applied in many fields such as gaming,education,healthcare,and business.As the core technology of the metaverse,3D reconstruction technology has attracted attention due to its extremely high research value and wide application prospects.Traditional 3D reconstruction techniques perform poorly in processing metaverse tasks characterized by real-time interactivity,with significant room for improvement in computational efficiency and reconstruction model accuracy.Therefore,how to optimize 3D reconstruction technology,improve accuracy and robustness,and provide users with a more realistic and real-time interactive experience has become a current research hotspot.This paper tracks and summarizes the 3D reconstruction techniques based on scene generation in the metaverse in recent years.Firstly,we review the deve-lopment history of the metaverse,point out the challenges faced by 3D reconstruction technology,and propose solutions based on two different 3D representations.Then,3D reconstruction techniques based on 3D Gaussian and Neural Radiance Field(NeRF)representations are sorted out separately.Next,the innovative fusion methods of 3D reconstruction technology with tactile signals and large language models are mainly analyzed.Finally,the challenges faced by scenebased 3D reconstruction technology in the metaverse are discussed in detail,and corresponding future research directions are proposed.

关 键 词：元宇宙 三维重建 三维高斯 神经辐射场 视触觉传感器 大语言模型 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]