基于结构相似性的多传感器图像融合  

Multi-sensor image fusion algorithm based on SSIM

作　　者：胡前[1] 杜军平[1] 方明[1] 訾玲玲[1] 韩鹏程[1] 

机构地区：[1]北京邮电大学智能通信软件与多媒体北京市重点实验室,北京100876

出　　处：《东南大学学报（自然科学版）》2013年第A01期158-162,共5页Journal of Southeast University：Natural Science Edition

基　　金：国家重点基础研究发展计划(973计划)资助项目(2012CB821200;2012CB821206);国家自然科学基金资助项目(91024001;61070142);北京市自然科学基金资助项目(4111002)

摘　　要：采用SCDPT变换对图像进行多尺度、多方向分解,得到图像不同尺度、不同方向的频带系数.然后对低频子带系数采取基于结构相似性(SSIM)、区域能量和区域平均梯度的融合规则,对方向子带系数采取基于SSIM和区域方差的融合规则.最后通过SCDPT逆变换得到融合图像.采用信息熵、平均梯度、互信息、边缘强度、均值等作为客观评价指标,实验结果表明,相对于小波变换、拉普拉斯金字塔变换、梯度金字塔变换,所提出的算法能够充分提取图像特征,具有更灵活的方向性和平移不变性,并且能够准确捕获图像轮廓特征信息和纹理细节信息.融合结果优于大部分基于其他多尺度变换的图像融合算法.Shiftable complex directional pyramid transform（SCDPT） is used to decompose source images at each scale and direction to obtain low-pass sub-band coefficients and band-pass directional sub-band coefficients.Low-pass sub-band coefficients are fused w ith the rule based on structural similarity（SSIM）,regional energy,and regional average gradient.Directional band-pass sub-band coefficients are fused w ith the rule based on SSIM and regional variance.Finally,fused image is obtained by SCDPT inverse transform.Information entropy,average gradient,mutual information,edge strength,and mean are adopted as objective evaluations.Experimental results show that,compared w ith the w avelet transform,Laplacian pyramid transform and gradient pyramid transform,the proposed algorithm can not only fully extract image features w ith more flexible directivity and shift invariance,but also can accurately capture the image information of the contour feature and texture details.Fusion result is better than those of the most other algorithms based on multi-scale transformation.

关 键 词：图像融合 SCDPT变换 SSIM 区域能量 平均梯度 

分 类 号：TP391.4[自动化与计算机技术—计算机应用技术]