面向误差补偿的高光谱与多光谱图像融合  

Hyperspectral and multispectral image fusion focused on error compensation

作　　者：方帅[1,2] 许漫 Fang Shuai;Xu Man(School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China;Anhui Province Key Laboratory of Industry Safety and Emergency Technology,Hefei 230601,China)

机构地区：[1]合肥工业大学计算机与信息学院,合肥230601 [2]工业安全与应急技术安徽省重点实验室,合肥230601

出　　处：《中国图象图形学报》2023年第1期277-289,共13页Journal of Image and Graphics

基　　金：国家自然科学基金项目(61872327,61175033)。

摘　　要：目的在高光谱和多光谱融合领域,光谱字典学习是一种常用的方法,但是这种算法获得的融合结果不可避免地会损失一部分空间信息。针对这一问题,本文提出了一种面向误差补偿的高光谱和多光谱融合框架,即先利用低分辨率图像构建出误差,再将构建的误差对字典学习所得初步结果进行补偿,从而捕获更多的空间信息和光谱信息。方法设计了一种基于局部区域的注入系数,使得到的系数能够根据局部区域的光谱特性自适应地调整误差信息的注入权重,从而避免注入过多或者过少的空间信息而导致光谱失真。为了保证融合结果在提升空间分辨率的同时不发生光谱畸变,在梯度域提取多光谱图像的空间结构,构造变分模型,并将光谱字典学习得到的初步结果与计算出的系数相结合构成优化项并将该优化项与变分模型结合,构建出一个新的模型,通过迭代更新,逐步提升补偿系数的精度和融合结果的质量。结果分别在两个公开数据集上与其他算法进行对比,实验结果表明,本文算法在评价指标和视觉效果上都取得明显提升。从主观分析来看,本文方法可以得到融合质量高、视觉效果自然清晰的目标图像。从客观评价指标来看,在Pavia University数据集上的实验结果在ERGAS(relative dimensionless global error in synthesis)、SAM(spectral angle mapper)、RMSE(root mean square error)指标上与次优方法相比,分别提升了4.2%、4.1%和2.2%;在AVIRIS(airborne visible infrared imaging spectrometer)数据集上分别提升了2.0%,4.0%和3.5%。结论本文算法在有效提升融合结果空间分辨率的同时,很好地保持了光谱信息。且在不同数据集上取得了较优的表现,具有一定的鲁棒性。Objective Hyperspectral images(HSI)are widely used in image classification and target detection because of their rich and useful spectral information.Their spatial resolution is required to be optimized further due to the limitation of imaging cameras.Multispectral or panchromatic images with lower spectral resolution have higher spatial resolution compared to hyperspectral images.To improve the spatial resolution of hyperspectral images,they are often fused with multispectral images(MSI)or panchromatic images in the same scene.Dictionary learning is one of the popular algorithms for image fusion,which can be divided into dictionary-spectral learning and dictionary-spatial learning.Using spectral dictionary learning algorithms,high-resolution hyper-spectral images can be expressed as an over-completed spectral dictionary multiplied by sparse coefficients.Spectral dictionary can illustrate the spectral information of high-resolution hyperspectral images,which is originated from k-singular value decomposition(SVD)and the algorithms-related.It is challenged of spatial information loss for spectral dictionary cannot fully express spatial information.Therefore,we develop a new compensated framework to explore more detailed spatial information.To improve the spatial resolution of fusion result,residual spatial information is used to compensate the preliminary result.The residual information is calculated as the error between the image obtained by spectral down sampling through preliminary results and the multispectral image.It is required to inject the residual space information into the preliminary results in an appropriate manner.However,most of the algorithms have limitations for that they only consider the differences between spectral channels but do not consider the differences in spatial.Therefore,the spectral and spatial quality of the fused image will be seriously affected if the extracted errors are injected indiscriminately into a channel.Method Our method is focused on improving the spatial resolution of hyp

关 键 词：遥感 高光谱与多光谱图像融合 字典学习 误差补偿 超像素分割 

分 类 号：TP751.2[自动化与计算机技术—检测技术与自动化装置]