动态三维场景重建研究综述  

A survey of dynamic 3D scene reconstruction

作　　者：黄家晖 穆太江 HUANG Jiahui;MU Taijiang(Department of Computer Science and Technology,Tsinghua University,Beijing 100084,China)

机构地区：[1]清华大学计算机科学与技术系,北京100084

出　　处：《图学学报》2024年第1期14-25,共12页Journal of Graphics

摘　　要：三维重建技术旨在通过传感器输入,恢复所观测场景的数字化三维表示,是计算机图形学与视觉领域的重要研究方向,在可视化、模拟、路线规划等各类任务上都有重要应用。相比于静态场景,动态场景额外引入了时间维度,对应的重建任务不仅需要重构每帧细节几何,还需刻画目标随着时间变化的趋势与关联关系用于下游分析任务,为重建算法设计带来了更大的挑战。然而,目前学界就动态场景重建的讨论依然仅处于起步阶段,且关于现有方法的系统性总结也较为欠缺。为了填补上述空缺、进一步启发算法设计,对学界当前最新的动态三维场景重建技术进行整理和归纳,对动态三维场景重建问题及其通用求解框架进行一般性的定义,从动态三维表示方式、优化框架方面对已有技术进行综述,并针对结构化的特殊场景讨论对应的重建方法与处理方式。最终,介绍相关数据集,并对动态三维场景重建现存的问题进行分析总结,对未来工作进行展望。Three-dimensional reconstruction technology aims to recover the digital 3D representation of an observed scene through sensor input.It is an important research direction in the fields of computer graphics and vision,with significant applications in visualization,simulation,route planning,and various other tasks.Compared to static scenes,dynamic scenes introduce an additional temporal dimension.The reconstruction of dynamic scenes not only requires accurately reconstructing the geometric details of each frame but also capturing the motion trends of the target over time and correlations for downstream analysis tasks,presenting greater challenges to the design of reconstruction algorithms.However,the existing literature pertaining to the reconstruction of dynamic scenes is still in their infancy,and systematic summarizations of existing methodologies are notably lacking.In an endeavor to address these problems and to enlighten future algorithm design,the latest dynamic 3D scene reconstruction technologies in the literature were reviewed and summarized.A general definition of dynamic 3D scene reconstruction and its general solution framework was provided.Existing technologies were reviewed from the perspectives of dynamic 3D representation methods and optimization frameworks,and the reconstruction algorithms and processing methods for structured scenes were discussed.Finally,existing datasets were summarized,the existing problems in dynamic 3D scene reconstruction were identified,and an outlook on future research was provided.

关 键 词：动态三维重建 研究综述 动态场景表示 三维建模 结构化场景 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]