基于Tetrolet变换的近红外与彩色可见光图像融合算法研究  

Fusion Algorithm for Near-Infrared and Color Visible Images Based on Tetrolet Transform

作　　者：苑玉彬 彭静[1] 沈瑜[1] 陈小朋 YUAN Yubin;PENG Jing;SHEN Yu;CHEN Xiaopeng(School of Electronic and Information Engineering,Lanzhou Jiaotong University,Lanzhou 730070,China)

机构地区：[1]兰州交通大学电子与信息工程学院,甘肃兰州730070

出　　处：《红外技术》2020年第3期223-230,共8页Infrared Technology

基　　金：国家自然科学基金项目(61861025,61562057,61663021,61761027,51669010);长江学者和创新团队发展计划(IRT_16R36);光电技术与智能控制教育部重点实验室(兰州交通大学)开放课题(KFKT2018-9);兰州市人才创新创业项目(2018-RC-117)。

摘　　要：针对近红外与彩色可见光图像融合后出现的对比度降低、细节丢失、颜色失真等问题,提出一种基于Tetrolet变换和自适应脉冲耦合神经网络PCNN(PCNN-Pulse Coupled Neural Network)的近红外与彩色可见光图像融合的新算法。首先将彩色可见光源图像转换到各个分量相对独立的HSI空间(HSI-Hue Saturation Intensity),将其亮度分量与近红外图像进行Tetrolet分解,对分解后得到的低频系数,提出一种从给定不完备数据集中寻找潜在分布最大似然估计的期望最大算法融合规则;对分解后得到的高频系数,采用一种Sobel算子自动调节阈值的自适应PCNN模型作为融合规则;处理后的高低频图像经Tetrolet逆变换作为融合后的亮度图像,提出一种饱和度分量自适应拉伸方法来解决图像饱和度下降的问题。处理后的各个分量反向映射到RGB空间,完成融合。将本文算法与多种高效融合算法进行对比分析,实验表明,本方法取得的图像,细节清晰,色彩对比度得到提升,在图像饱和度、颜色恢复性能、结构相似性和对比度等客观评价指标上均具有明显的优势。To address the problems of low contrast,loss of detail,and color distortion after near-infrared and color visible image fusion,an algorithm for near-infrared and color visible image fusion based on the Tetrolet transform and pulse coupled neural network(PCNN)is proposed.First,the color visible light source image is transformed into a hue saturation intensity space,where each component is relatively independent,and its brightness component is decomposed into a near-infrared image by Tetrolet decomposition.Subsequently,a fusion rule for expectation maximization likelihood estimation of the potential distribution from a given incomplete dataset is proposed.A self-adaptive PCNN model with a Sobel operator that automatically adjusts the threshold is used as a fusion rule,and the processed high-frequency and low-frequency images are fused by Tetrolet inverse transformation as brightness images.An adaptive stretching method for the saturation component is proposed to solve the problem of image saturation decline.The processed components are mapped back to red–green–blue space to complete the fusion.The proposed algorithm was compared with several efficient fusion algorithms.The experimental results show that the image obtained by this method has clear details and improved color contrast.It has obvious advantages in image saturation,color restoration performance,structural similarity,and contrast.

关 键 词：彩色图像融合 Tetrolet变换 期望最大算法 自适应脉冲耦合神经网络 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]