基于三维高斯溅射技术的可微分渲染研究进展(特邀)  

Advances in Differentiable Rendering Based on Three-Dimensional Gaussian Splatting(Invited)

作　　者：高建[1] 陈林卓 沈秋 曹汛[2] 姚遥 Gao Jian;Chen Linzhuo;Shen Qiu;Cao Xun;Yao Yao(School of Intelligence Science and Technology,Nanjing University,Suzhou 215163,Jiangsu,China;School of Electronic Science and Engineering,Nanjing University,Nanjing 210023,Jiangsu,China)

机构地区：[1]南京大学智能科学与技术学院,江苏苏州215163 [2]南京大学电子科学与工程学院,江苏南京210023

出　　处：《激光与光电子学进展》2024年第16期153-165,共13页Laser & Optoelectronics Progress

基　　金：国家自然科学基金专项项目(62441204)。

摘　　要：近年来,三维高斯溅射(3DGS)技术的兴起为可微分渲染技术带来了革命性变化。虽然神经辐射场(NeRF)是可微分渲染技术的里程碑,并已在高真实感的新视角合成方面取得了突破性进展,但它依然存在隐式表达不直观、训练效率低等问题。相比之下,3DGS技术通过显式点云表达和高度并行化的可微分光栅化管线成功解决了NeRF的痛点,显著提升了训练速度和渲染效率,并提供了更高的场景控制性。3DGS技术将可微分渲染推向了新的高度,并且该技术已在新视角渲染、动态场景重建等领域取得了显著成果,展现出了广阔的应用前景和巨大潜力。本文旨在展示3DGS技术的最新发展动态,激发研究人员对可微分渲染技术进行深入探索,同时为未来技术的进一步发展提供启示。Recently,the advent of three-dimensional Gaussian splatting(3DGS)technology has brought revolutionary changes to the development of differentiable rendering techniques.Although neural radiance field(NeRF)has been a milestone in differentiable rendering,achieving breakthroughs in high-fidelity novel view synthesis,it still suffers from issues such as implicit expression and low training efficiency.In contrast,3DGS technology addresses the pain points of NeRF by employing an explicit point cloud representation and a highly parallelizable differentiable rasterization pipeline.Compared to NeRF,3DGS improves training speed and rendering efficiency while offering greater scene control.3DGS technology propels differentiable rendering to a new height with remarkable achievements in areas such as novel view synthesis and dynamic scene reconstruction.3DGS has been demonstrated to have broad application prospects and tremendous potential.This study aims to showcase the latest developments in 3DGS technology to inspire in-depth exploration of differentiable rendering techniques,with the hope of providing insights for technological advancements in the future.

关 键 词：三维高斯溅射 可微分渲染 三维重建 

分 类 号：TP37[自动化与计算机技术—计算机系统结构]