NSST域下基于引导滤波与稀疏表示的红外与可见光图像融合  

Infrared and Visible Image Fusion Based on Guided Filter and Sparse Representation in NSST Domain

作　　者：武凌霄 康家银 姬云翔 WU Lingxiao;KANG Jiayin;JI Yunxiang(School of Electronic Engineering,Jiangsu Ocean University,Lianyungang 222005,China)

机构地区：[1]江苏海洋大学电子工程学院,江苏连云港222005

出　　处：《红外技术》2023年第9期915-924,共10页Infrared Technology

基　　金：连云港市“海燕计划”基金(2018-QD-011);江苏海洋大学自然科学基金项目(Z2015009);研究生科研与实践创新计划项目(KYCX2021-052);江苏省自然科学基金(BK20191469)。

摘　　要：图像融合技术旨在解决单模态图像呈现信息不充分、不全面的问题。本文针对红外和可见光图像的融合,提出了一种新的在非下采样剪切波变换(Non-Subsampled Shearlet Transform,NSST)域下基于引导滤波(Guided Filter,GF)和稀疏表示(Sparse Representation,SR)的融合算法。具体地,①利用NSST对红外与可见光图像分别进行分解,以得到各自的高频子带图像和低频子带图像;②使用GF加权融合策略对高频子带图像进行融合;③使用滚动引导滤波器(Rolling Guidance Filter,RGF)将低频子带图像进一步分解为基础层和细节层:其中基础层采用SR进行融合,细节层利用基于一致性验证的局部最大值策略进行融合;④对融合后的高频子带和低频子带图像进行NSST反变换,从而得到最终的融合结果。在公开数据集上的实验结果表明,相较于其它一些方法,本文方法得到的融合结果的纹理细节信息更丰富、主观视觉效果更好,此外,本文算法所得融合结果的客观评价指标也相对占优。Image fusion technology aims to solve the problem of insufficient and incomplete information provided by a single-modality image.This paper proposes a novel method based on guided filter(GF)and sparse representation(SR)in the non-subsampled shearlet transform(NSST)domain,to fuse infrared and visible images.Specifically,①the infrared and visible images are respectively decomposed using NSST to obtain the corresponding high-frequency and low-frequency sub-band images;②The GF-weighted fusion strategy is exploited to fuse the high-frequency sub-band images;③Rolling guidance filter(RGF)is used to further decompose the low-frequency sub-band images into base and detail layers,whereby the base layers are fused via SR,and the detail layers are fused using local maximum strategy which is based on consistency verification;④An inverse NSST is performed on the fused high-frequency and low-frequency sub-band images to obtain the final fusion result.Compared to those of other methods,experimental results on public datasets show that the fusion result obtained by the proposed method has richer texture detail and better subjective visual effects.In addition,the proposed method achieves overall better performance in terms of objective metrics that are commonly used for evaluating fusion results.

关 键 词：图像处理 图像融合 红外图像 非下采样剪切波 引导滤波 稀疏表示 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]