基于三维高斯泼溅技术的航拍场景建模  

3D Gaussian Splatting-based Aerial Video Scene Modeling

作　　者：何天琪 宋佳洁 程景春 潘雄[1] HE Tianqi;SONG Jiajie;CHENG Jingchun;PAN Xiong(School of Instrumentation and Optoelectronic Engineering,Beihang University,Beijing 100191,China)

机构地区：[1]北京航空航天大学仪器科学与光电工程学院,北京100191

出　　处：《火箭军工程大学学报》2025年第2期1-12,21,共13页Journal of Rocket Force University of Engineering

基　　金：火箭军工程大学重点实验室开放基金(AAIE-2023-0202)。

摘　　要：针对航拍视频场景建模存在的数据匮乏、现有算法建模细节缺失等问题,提出了基于仿真引擎的飞行场景数据采集方法,并采用三维高斯泼溅(3D Gaussian Splatting,3DGS)算法实现航拍场景的建模与渲染。首先,利用仿真引擎实现城区、沙滩、江桥3种典型场景下不同飞行轨迹、不同飞行速度、不同环境条件下的数据集获取,并进行航拍视频帧采样;然后,通过运动恢复结构实现场景的稀疏建模,再利用3DGS算法进行场景的稠密建模及渲染;最后,进行了模型的定量对比与定性分析实验。结果表明:与经典的COLMAP算法相比,所提算法具有更好的建模效果以及更完备的图像细节;线性、网格、螺旋不同的飞行轨迹均能得到较高的图像质量,但螺旋轨迹具有更好的场景通用性;飞行速度在30 m/s以下时可以得到较高质量的建模效果,其中PSNR>32 dB,SSIM>0.93,LPIPS<0.13;在不同环境条件下均能得到较高的图像质量,且在晴天白天理想光照下质量最佳。该研究为具有位姿灵活、飞行速度较快、场景大等难点的航拍视频提供了高精度、高鲁棒性的建模方案。To solve the problems of data scarcity and lack of modeling details in existing algorithms in the modeling of aerial video scenes,a flight scene data acquisition method based on simulation engines was proposed.The advanced 3DGS(3D Gaussian Splatting)algorithm was adopted to model and render aerial scenes.First,simulation engines were used to obtain datasets for different flight trajectories,speeds,and environmental conditions in three typical scenes(urban areas,beaches,and river bridges),and to obtain samples of aerial video frames.In addition,the sparse modeling of the scenes was realized through the motion recovery structure,and the 3DGS algorithm was used for dense modeling and rendering of the scenes.Finally,quantitative comparison and qualitative analysis experiments of the models were conducted.The results show that compared with the classical COLMAP algorithm,the proposed algorithm has better modeling results and more complete image details.Higher image quality can be obtained in different flight trajectories(linear,grid,and spiral),while achieving better scene universality in spiral trajectories.Higher-quality modeling results can be obtained when the flight speed is below 30 m/s(PSNR>32 dB,SSIM>0.93,LPIPS<0.13).Furthermore,high image quality can be achieved under different environmental conditions,and the best quality is achieved under ideal light during the daytime of sunny days.A high-precision and high-robustness modeling solution for aerial videos with difficulties such as flexible positions,fast flight speeds,and large scenes is provided in this paper.

关 键 词：三维重建 航拍场景建模 三维高斯泼溅 可微渲染 数字孪生 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]