面向多镜头组合相机的卷帘快门SfM算法  

Rolling Shutter SfM Algorithm for Multi-Lens Combination Cameras

作　　者：郭帅威 邓非[1] 安晓亚[2,3] 宫志群 张栋樑 李长胜 GUO Shuaiwei;DENG Fei;AN Xiaoya;GONG Zhiqun;ZHANG Dongliang;LI Changsheng(School of Geodesy and Geomatics,Wuhan University,Wuhan Hubei 430079,China;Xi'an Research Institute of Surveying and Mapping,Xi'an Shaanxi 710054,China;State Key Laboratory of Geo-Information Engineering,Xi'an Shaanxi 710054,China;China Construction Infrastructure Co.,Ltd.,Beijing 100029,China)

机构地区：[1]武汉大学测绘学院,湖北武汉430079 [2]西安测绘研究所,陕西西安710054 [3]地理信息工程国家重点实验室,陕西西安710054 [4]中国建设基础设施有限公司,北京100029

出　　处：《传感技术学报》2024年第12期2050-2057,共8页Chinese Journal of Sensors and Actuators

基　　金：宁夏回族自治区重点研发计划项目(2024BEG02042);创新研究专项基金项目(2022C61540)。

摘　　要：使用卷帘快门相机进行移动测量时,由于逐行曝光的特点,影像上会产生果冻效应。而传统的运动恢复结构(Structure from Motion,SfM)算法假设影像是全局快门获取,直接处理卷帘快门影像很难得到高精度的结果。针对以上问题,构建了卷帘快门SfM框架,主要包括对初始化重建、卷帘快门影像绝对位姿估计、卷帘快门三角化和光束法平差等关键步骤的算法改进,分析并验证了卷帘快门SfM的退化问题,提出利用多镜头组合相机采集的影像进行卷帘快门SfM可以避免退化,并且利用多镜头约束的光束法平差对SfM结果进行进一步优化。实验表明,所提出的面向多镜头组合相机的卷帘快门SfM算法能够有效应对果冻效应,提高重建精度。Images might suffer from rolling shutter effect due to the characteristic of progressive exposure if a rolling shutter camera for movement measurement is used.Traditional SfM algorithm typically assumes that images are obtained by a global shutter,so it is diffi-cult to obtain high-precision results when using them to process the rolling shutter images.To solve this problem,a rolling shutter SfM framework is constructed,which mainly includes algorithm improvements for key steps such as initialization reconstruction,rolling shutter image absolute pose estimation,rolling shutter triangulation and rolling shutter bundle adjustment.Then,the degradation of rolling shutter SfM is analyzed and verified.Images captured by multi-lens combination cameras are used to perform rolling shutter SfM to avoid degradation,and multi-lens constrained bundle adjustment is used to further optimize the SfM results.Experiments show that the rolling shutter SfM algorithm for multi-lens combination cameras proposed can effectively deal with the rolling shutter effect and im-prove the reconstruction accuracy.

关 键 词：摄影测量与遥感 卷帘快门SfM 多镜头组合相机 光束法平差 果冻效应 

分 类 号：P232[天文地球—摄影测量与遥感]