基于多视角相机阵列的偏振图像重构方法  

Polarization Image Reconstruction Method Based on Multi-View Camera Array

作　　者：马一鸣 王昕[1,2] 蒲先坤 石磊 韩涵 查耀 高隽 Ma Yiming;Wang Xin;Pu XianKun;Shi Lei;Han Han;Zha Yao;Gao Jun(School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230031,Anhui,China;Laboratory of Image Information Processing,Hefei University of Technology,Hefei 230031,Anhui,China)

机构地区：[1]合肥工业大学计算机与信息学院,安徽合肥230031 [2]合肥工业大学图像信息处理研究室,安徽合肥230031

出　　处：《激光与光电子学进展》2024年第22期91-100,共10页Laser & Optoelectronics Progress

基　　金：国家自然科学基金(62171178)。

摘　　要：偏振成像技术相较于传统成像技术能够提高对比度和可视性,特别是在消除反射或散射光方面,同时还能揭示物体表面特定的属性和细节。多视角成像允许从不同角度捕捉场景,提供更丰富的场景信息和深度感知,增强图像的细节捕捉能力。然而,传统多视角目标检测只专注于普通图像,忽略了场景中所包含的偏振信息。为解决这一问题,运用自行研发的多视角偏振相机阵列系统,对场景中的被遮挡目标进行识别与恢复。首先,通过采集系统获取场景中的多视角偏振信息,信息包括不同距离、不同遮挡物和不同目标的纯遮挡物、目标真实值,以及遮挡场景数据;然后,将获取的偏振图像进行预处理,处理后的偏振度为0°、45°、90°、135°的偏振图像数据分别输入Polar-ReOccNet进行有监督训练,遮挡场景数据与目标真实值一一对应;最终,输入一组多视角偏振图像,得到去除遮挡后的目标偏振图像,并且计算出其偏振度、偏振角和偏振度偏振角融合图像。该方法实现了对被遮挡目标的偏振信息重构,有效获取了目标纹理、材料等性质中蕴含的偏振信息,更有利于目标检测。Polarization imaging technology,compared to conventional imaging technology,can enhance contrast and visibility,especially in eliminating reflections or scatter,while also revealing specific properties and details of object surfaces.Multi-view imaging allows capturing scenes from different angles,offering richer scene information and depth perception,thus enhancing the capability to capture image details.However,traditional multi-view object detection focuses solely on ordinary images,neglecting the polarization information contained within the scene.To address this issue,this study employs a self-developed multi-view polarization camera array system to identify and recover occluded targets within a scene.Initially,the system acquires multi-view polarization information of the scene,including data on pure occlusions,ground truth,and occluded scenes across different distances,obstructions,and objects.Subsequently,the acquired polarized images are preprocessed,and polarization images at 0°,45°,90°,and 135°are fed into the Polar-ReOccNet network for supervised training,with occluded scene data corresponding to ground truth.Ultimately,by inputting a set of multi-view polarized images,one can obtain the polarized images of the target after removing occlusions,and calculate its degree of polarization,angle of polarization,and a fused image of both degree and angle of polarization.This method achieves the reconstruction of polarization information for occluded targets,effectively retrieving the polarization information inherent in properties such as target texture and materials,thereby facilitating object detection.

关 键 词：偏振计算成像 偏振相机阵列 图像重构 目标检测 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]