基于神经辐射场的城市三维重建  

Three-Dimensional Reconstruction of Cities Based on Neural Radiation Fields

作　　者：赖杰 谭诗瀚 戈文一 钟娟 梁书凝 邹书蓉[1] LAI Jie;TAN Shihan;GE Wenyi;ZHONG Juan;LIANG Shuning;ZOU Shurong(School of Computer,Chengdu University of Information Technology,Chengdu 610225,China)

机构地区：[1]成都信息工程大学计算机学院,四川成都610225

出　　处：《软件导刊》2024年第12期241-248,共8页Software Guide

基　　金：四川省科技计划资助项目(2022ZDZX0008,2023YFG0304)。

摘　　要：城市三维重建是计算机视觉领域备受关注的热点问题。城市三维模型的应用涵盖多个领域,然而,在目前城市场景重建工作中依然存在一些问题,包括城市场景下的数据多尺度问题、近景重建比较模糊而远景重建出现锯齿、远景细节表征不足和边缘模糊等。为了解决这些问题,采用基于神经辐射场的阶段式三维重建方法,并提出基于远边界的采样分布策略。阶段式重建方法让模型由远及近层层学习城市场景,解决了城市建模的多尺度问题。采样策略通过计算光线分布,在远景上进行密集采样,能够更有效地捕获场景区域的细节,有助于模型更全面地学习和表达城市场景的细微差异,更准确地还原远景中的细节。通过实验对比发现,图像的PSNR提升了7.22%,SSIM提升了17.20%,LPIPS下降了32.40%,表明该方法能够有效提升渲染质量。Urban 3D reconstruction is a hot issue that has received much attention in the field of computer vision.The wide application of urban 3D modeling covers many fields,however,there are still some problems in the current work of urban scene reconstruction.The problem of data multi-scale in urban scenes,the reconstruction of the near scene is blurred while the reconstruction of the far scene appears jagged,and the details of the far scene are under-represented and the edges are blurred.In order to solve these problems,a staged 3D reconstruction method based on neural radiation field is used and a sampling distribution strategy based on far boundary is proposed.The staged reconstruction method allows the model to learn the city scene layer by layer from far and near,which solves the multi-scale problem of city modeling.The sampling strategy is able to capture the details of the scene area more effectively by calculating the light distribution and sampling densely on the far boundary,which helps the model to learn and express the nuances of the urban scene more comprehensively and restore the details in the far boundary more accurately.Comparison in the experiment reveals that the image PSNR increased by 7.22%,SSIM increased by 17.20%,and LPIPS decreased by 32.40%,indicating that the method can effectively improve the rendering quality.

关 键 词：神经辐射场 三维重建 城市场景 采样策略 多尺度数据 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术]