Learning hyperspectral images from RGB images via a coarse-to-fine CNN  

作　　者：Shaohui MEI Yunhao GENG Junhui HOU Qian DU 

机构地区：[1]School of Electronics and Information,Northwestern Polytechnical University,Xi’an 710072,China [2]Department of Computer Science,City University of Hong Kong,Hong Kong 999077,China [3]Department of Electrical and Computer Engineering,Mississippi State University,Starkville MS 39762,USA

出　　处：《Science China(Information Sciences)》2022年第5期47-60,共14页中国科学（信息科学）（英文版）

基　　金：partially supported by National Natural Science Foundation of China (Grant No. 61671383);Seed Foundation of Innovation and Creation for Graduate Students in Northwestern Polytechnical University (Grant No. CX2020020);Hong Kong RGC (Grant No. 9042820 (CityU 11219019))

摘　　要：Hyperspectral remote sensing is well-known for its extraordinary spectral distinguishability to discriminate different materials.However,the cost of hyperspectral image(HSI)acquisition is much higher compared to traditional RGB imaging.In addition,spatial and temporal resolutions are sacrificed to obtain very high spectral resolution owing to the limitations of sensor technologies.Therefore,in this paper,HSIs are reconstructed using easily acquired RGB images and a convolutional neural network(CNN).As a result,high spatial and temporal resolution RGB images can be inherited to HSIs.Specifically,a two-stage CNN,referred to as the spectral super-resolution network(SSR-Net),is designed to learn the transformation model between RGB images and HSIs from training data,including a band prediction network(BP-Net)to estimate hyperspectral bands from RGB images and a refinement network(RF-Net)to further reduce spectral distortion in the band prediction step.As a result,the learned joint features in the proposed SSR-Net can directly predict HSIs from their corresponding scenes in RGB images without prior knowledge.Experimental results obtained on several benchmark datasets demonstrate that the proposed SSR-Net outperforms several state-of-the-art methods by ensuring higher quality in HSI reconstruction,and significantly improves the performance of traditional RGB images in classification.

关 键 词：HYPERSPECTRAL RECONSTRUCTION convolutional neural network deep learning 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置] TP183[自动化与计算机技术—控制科学与工程]