跨层交互与多源特征融合的遥感图像语义分割  

Cross-layer Interaction and Multi-source Feature Adaptive Fusion Networks for Semantic Segmentation of Remote Sensing Images

作　　者：冯建华 孟妮娜[2] 兰小机[1] 吴启用 张天亮 FENG Jianhua;MENG Nina;LAN Xiaoji;WU Qiyong;ZHANG Tianliang(School of Civil and Surveying Engineering,Jiangxi University of Science and Technology,Ganzhou,Jiangxi 341400,China;School of Geoengineering and Mapping,Chang’an University,Xi’an 710054,China;College of Forestry,Jiangxi Environmental Engineering Vocational College,Ganzhou,Jiangxi 341400,China)

机构地区：[1]江西理工大学土木与测绘工程学院,江西赣州341400 [2]长安大学地质工程与测绘学院,西安710054 [3]江西环境工程职业学院林业学院,江西赣州341400

出　　处：《遥感信息》2023年第6期50-59,共10页Remote Sensing Information

基　　金：国家自然基金(41501498);地区科学基金(41561085)。

摘　　要：将数字表面模型提供的高程特征与光谱特征进行融合可以提高遥感图像的语义分割性能。然而,由于多模态数据特征之间存在显著差异,仅使用级联或者相加的方式对数据特征进行融合容易造成特征冗余和过量噪声。针对该问题,提出了一种跨层交互与多源特征自适应融合的语义分割网络CIMFANet。该网络在解码层实现对双模态特征的提取,采用密集的短跳跃连接进行跨层特征交互以防止空间细节信息的丢失,同时引入空洞空间金字塔池化模块提取跨层交互后的多尺度上下文特征。解码层使用多模态融合模块以自适应的方式融合来自双分支和前一层的特征。该方法在ISPRS提供的两个基准数据集上与其他方法进行对比实验。实验表明,该方法在某些地物要素方面具有更高的分割精度。The fusion of elevation features provided by digital surface models with spectral features can improve the semantic segmentation performance of remote sensing images.However,due to the significant differences between multimodal data features,the fusion of data features using only cascading or summation is prone to feature redundancy and excessive noise.The network implements the extraction of bimodal features at the decoding layer,using dense short-hop connections for cross-layer feature interactions to prevent loss of spatial detail information,and introduces a void space pyramid pooling module to extract multi-scale contextual features after cross-layer interactions.The decoding layer uses a multimodal fusion module to fuse features from the two branches and the previous layer in an adaptive manner.The method is tested against other methods on two benchmark datasets provided by ISPRS.The experimental results show that the proposed method has higher segmentation accuracy in terms of some feature elements.

关 键 词：多源遥感影像 语义分割 深度学习 跨层交互 自适应融合 

分 类 号：P237[天文地球—摄影测量与遥感]