Dense 3D surface reconstruction of large-scale streetscape from vehicle-borne imagery and LiDAR  

作　　者：Xiaohu Lin Bisheng Yang Fuhong Wang Jianping Li Xiqi Wang 

机构地区：[1]School of Geodesy and Geomatics,Wuhan University,Wuhan,People’s Republic of China [2]State Key Laboratory of Information Engineering in Surveying,Mapping and Remote Sensing,Wuhan University,Wuhan,People’s Republic of China [3]School of Remote Sensing Information Engineering,Wuhan University,Wuhan,People’s Republic of China

出　　处：《International Journal of Digital Earth》2021年第5期619-639,共21页国际数字地球学报（英文）

基　　金：funded by the National Natural Science Foundation of China for Distinguished Young Scholars[grant number 41725005];the Key Project of the National Natural Science Foundation of China[grant number 41531177];the National Key Research and Development Program of China[grant number 2016YFB0501803].

摘　　要：Accurate and efficient three-dimensional(3D)streetscape reconstruction is the fundamental ability for an exploration vehicle to navigate safely and perform high-level tasks.Recently,remarkable progress has been made in streetscape reconstruction with visual images and light detection and ranging(LiDAR),but they have difficulties either in scaling and reconstructing large-scale outdoors or in efficient processing.To address these issues,this paper proposed an automatic method for incremental dense reconstruction of large-scale 3D streetscapes from coarse to fine at near real time.Firstly,the pose of vehicle is estimated by visual and laser odometry(VLO)and the state-of-the-art pyramid stereo matching network(PSMNet)is introduced to estimate depth information.Then,incremental dense 3D streetscape reconstruction is conducted by key-frame selection and coarse registration with local optimization.Finally,redundant and noise points are removed through multiple filtering,resulting good quality of dense reconstruction.Comprehensive experiments were undertaken to check the visual effect,trajectory pose error and multi-scale model to model cloud comparison(M3C2)based on reference trajectories and reconstructions provided by the state-of-the-art method,showing the precision,recall and F-score of sampling core points(SCPs)are over 80.42%,71.68%and 77.19%,respectively,which verified the proposed method.

关 键 词：Dense 3D streetscape reconstruction vehicleborne imagery stereo matching pose estimation multiple filtering 

分 类 号：TP3[自动化与计算机技术—计算机科学与技术]