室外大场景神经辐射场综述  

A review of neural radiance fields for outdoor large scenes

作　　者：董相涛 马鑫[1] 潘成伟 鲁鹏[1] DONG Xiangtao;MA Xin;PAN Chengwei;LU Peng(School of Artificial Intelligence,Beijing University of Posts and Telecommunications,Beijing 100876,China;Institute of Artificial Intelligence,Beihang University,Beijing 100191,China)

机构地区：[1]北京邮电大学人工智能学院,北京100876 [2]北京航空航天大学人工智能研究院,北京100191

出　　处：《图学学报》2024年第4期631-649,共19页Journal of Graphics

摘　　要：对室外大场景进行三维建模,不仅可以完成实时的城市建图和漫游,还能为自动驾驶等提供技术支持。近年来,神经隐式建模的发展十分迅速,神经辐射场(NeRF)的出现更是将神经隐式建模推上了新的高度。NeRF凭借高质量渲染和任意角度渲染的特点,已经在可控编辑、数字化人体、城市场景重建等领域得到了广泛的应用。NeRF通过深度学习的方法从二维图片及其位姿中学习隐式三维场景,生成新视角图像。然而原始NeRF只能在有界场景下得到逼真的结果,在对室外大场景进行建模时,往往会面临无界背景、模型容量、场景外观等问题。基于室外大场景中NeRF部署的多个角度改进和多样的NeRF变种,首先介绍NeRF的背景,然后从室外大场景的难点切入,对各个难点的解决方法进行分析和讨论,最后对室外大场景NeRF目前的进展进行总结并对未来进行展望。The 3D modeling of large outdoor scenes can not only complete real-time urban mapping and roaming,but also provide technical support for autonomous driving.In recent years,the advancement of neural implicit representation has been rapid,and the emergence of the neural radiance fields(NeRF)has propelled neural implicit representation to a new height.With its characteristics of high-quality rendering and arbitrary angle rendering,NeRF has been widely applied in controllable editing,digital human body,urban scene reconstruction,and other fields.The neural radiance field utilizes deep learning methods to learn implicit three-dimensional scenes from two-dimensional pictures and their poses,synthesizing novel view images.However,the original NeRF can only yield realistic results in bounded scenes,posing challenges in modeling large outdoor scenes due to problems such as unbounded backgrounds,model capacity constraints,and scene appearance.In order to deploy NeRF in large outdoor scenes,researchers have improved from multiple angles and proposed a variety of NeRF variants.Our review will begin by introducing the background of neural radiance fields,then delve into the challenges specific to the large outdoor scenes,analyzing and discussing the solutions to each,before concluding with a summary of current progress of NeRF for large outdoor scenes and prospects for the future.

关 键 词：神经隐式表达 神经辐射场 新视角合成 室外场景 大场景 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]