An adaptive 3D reconstruction method for asymmetric dual-angle multispectral stereo imaging system on UAV platform  

作　　者：Chen WANG Xian LI Yanfeng GU Zixu WANG 

机构地区：[1]School of Electronics and Information Engineering,Harbin Institute of Technology,Harbin 150001,China [2]Beijing Institute of Control and Electronic Technology,Beijing 100038,China

出　　处：《Science China(Information Sciences)》2024年第8期281-295,共15页中国科学（信息科学）（英文版）

基　　金：supported by National Science Fund for Outstanding Young Scholars(Grant No.62025107);Open Fund Project of KuiYuan Laboratory(Grant No.KY202423).

摘　　要：A multispectral imaging system often cannot capture 3D spatial information owing to hardware limitations,which diminishes the effectiveness across various domains.To address this problem,we have de-veloped a multispectral stereo imaging system along with an adaptive 3D reconstruction algorithm.Unlike existing unmanned aerial vehicle stereo imaging systems,our multispectral stereo imaging system uses two multispectral cameras with asymmetric spectral bands positioned at different angles.This design enables the acquisition of a higher number of bands and lateral spatial information while maintaining a lightweight struc-ture.This system introduces challenges such as large geometric distortions and intensity differences between multiple bands.To accurately recover 3D spatial information,we propose an adaptive 3D reconstruction method.This method employs a position and orientation system-assisted projection transformation and a normalized threshold adjustment strategy.Finally,mutual information is used to reconstruct the multispec-tral images densely,effectively addressing nonlinear differences and generating a comprehensive multispectral point cloud.Our stereo system was used for two real data collections in different regions,and the efficacy of the proposed 3D reconstruction method was validated by comparing it with existing methods and commercial software.

关 键 词：multispectral images 3D reconstruction stereo imaging system unmanned aerial vehicle fea-tureextraction 

分 类 号：TP391.41[自动化与计算机技术—计算机应用技术] V279[自动化与计算机技术—计算机科学与技术]