基于视差角和天顶角优化的偏振多视角三维重建  

Polarimetric multi-view 3D reconstruction based on parallax angle and zenith angle optimization

作　　者：张瑞华 施柏鑫 杨锦发 赵红颖[1] 左正康 ZHANG Rui-Hua;SHI Bo-Xin;YANG Jin-Fa;ZHAO Hong-Ying;ZUO Zheng-Kang(Institute of Remote Sensing and Geographic Information System,School of Earth and Space Science,Peking University,Beijing 100871,China;National Engineering Laboratory for Video Technology,Peking University,Beijing 100871,China)

机构地区：[1]北京大学地球与空间科学学院遥感与地理信息系统研究所,北京100871 [2]北京大学数字视频编解码技术国家工程实验室,北京100871

出　　处：《红外与毫米波学报》2021年第1期133-142,共10页Journal of Infrared and Millimeter Waves

基　　金：国家重点研发计划(2017YFB0503003,2017YFB0503004)。

摘　　要：多视角三维重建依赖目标表面的纹理特征,在处理低纹理区域时易出现数据空洞现象,融合目标物反射光的偏振信息可以在不同光照环境下对其进行完整重建,通过偏振参数计算物体表面法向量,进而重建目标物深度图。但单独使用偏振信息重建三维表面存在方位角歧义和天顶角偏差等问题,导致重建结果出现变形甚至得不到深度结果。针对存在低纹理区域的物体,使用偏振相机获取30个左右视角下四个偏振角度的影像,利用视差角参数化光束法平差方法优化相机参数与点云坐标,泊松优化方法纠正天顶角偏差,使用多视角立体几何与偏振信息融合的三维重建算法,既可以弥补多视角三维点云局部数据空洞现象,又可以解决偏振三维中方位角歧义和天顶角偏差的问题,最终得到更加精确的三维重建结果。Multi-view stereo reconstruction relies on object’s surface feature,and thus occurred data deficiency in dealing with low-texture regions,the polarization characteristics of the reflection light con be fused to observe completely surface under different light surroundings,which can reconstruct depth map of objects by calculating polarization parameters and normal information.However,there appears several problems such as azimuth ambiguity and zenith angle deviation using pure polarization information for 3D reconstruction,which result in distortion of the reconstruction results and even couldn’t get the depth.For objects with low-texture regions,capturing images from around 30 views from four polarizing angles using polarization camera,and using parallax bundle adjustment to optimize camera parameters and points’coordinate and using passion optimization method to correct zenith angle deviation,the 3D reconstruction algorithm combining the multi-view stereo and polarization information can not only replenish the local data deficiency of multi-view 3D point cloud,but also solve the azimuth ambiguity and zenith angle deviation,and finally get the more accurate 3D reconstruction results.

关 键 词：偏振三维重建 光束法平差 泊松优化 图像融合 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]