采用VGG19和低通滤波的红外与微光图像融合方法  

Infrared and low-light image fusion based on VGG19 and low-pass filtering

作　　者：刘洲洲 孙传新 王晓柱 张杨梅 LIU Zhou-zhou;SUN Chuan-xin;WANG Xiao-zhu;ZHANG Yang-mei(School of Computer Science,Xi'an Aeronautical University,Xi'an 710077,China;No.29 Research Institute of CETC,Chengdu 610036,China;School of Data Sciences,The Chinese University of Hong Kong(Shenzhen),Shenzhen 518172,China;School of Electronic Engineering,Xi'an Aeronautical University,Xi'an 710077,China)

机构地区：[1]西安航空学院计算机学院,西安710077 [2]中国电子科技集团公司第二十九研究所,成都610036 [3]香港中文大学(深圳)数据科学学院,广东深圳518172 [4]西安航空学院电子工程学院,西安710077

出　　处：《吉林大学学报（工学版）》2023年第1期255-262,共8页Journal of Jilin University:Engineering and Technology Edition

基　　金：陕西省教育厅科研计划项目(20JG014);陕西省重点研发计划项目(2020GY-084,2023-YBGY-014).

摘　　要：针对当前单一传感器受其成像性能的影响,通常很难全面反映地物场景下的全部有效信息,从而产生场景信息难以准确识别的问题,提出了一种采用VGG19与低通滤波的红外与微光图像融合算法。首先,通过红外与微光探测器得到地物场景信息,采用三维分布、直方图对比以及取反方式对图像进行处理,同时分析红外与微光图像目标特性,研究双频图像的光谱机理;其次,在此基础上,利用低通滤波方式分解红外与微光图像,得到其轮廓信息与显著信息,轮廓部分采用平均加权策略进行融合,显著部分采用VGG策略进行多层融合,进而融合重构图像;最后,与其他算法结果进行对比,并利用性能评估方法评价各融合算法。实验结果表明,该算法能够增强图像中场景信息的灰度,可以很好地提高场景亮度,解决了单频图像中场景信息抗背景干扰的问题。Due to the current single sensor being affected by its imaging performance,it is often difficult to fully reflect all the effective information in the ground object scene,resulting in the problem that the scene information is difficult to accurately identify,so a new infrared and low light image fusion algorithm based on VGG and low-pass filtering is proposed. Firstly,obtain the ground object scene information through infrared and low-level light detectors,use three-dimensional distribution,histogram comparison,and inversion to process the image,analyze the target characteristics of infrared and low-level light images,and study the spectroscopic mechanism of dual-frequency images;On this basis,the low-pass filtering method is used to decompose the infrared and low-light images to obtain their contour information and salient information. The contour part adopts the average weighting strategy for fusion,and the significant part adopts the VGG strategy for multi-layer fusion,and then the reconstructed image is fused;Finally,it is compared with the results of other algorithms,and the performance evaluation method is used to evaluate each fusion algorithm. The experimental results show that the algorithm can enhance the gray level of the scene information in the image,improve the brightness of the scene,and solve the problem of anti background interference of the scene information in the single frequency image.

关 键 词：红外图像 微光图像 低通滤波 VGG网络 融合算法 

分 类 号：TP312[自动化与计算机技术—计算机软件与理论]