基于注意力网络尺度特征融合的遥感场景分类  

Remote sensing scene classification based on attention network scale feature fusion

作　　者：帖军[1,2] 肖鹏飞 郑禄[1,2] 马海荣 彭丹 TIE Jun;XIAO Pengfei;ZHENG Lu;MA Hairong;PENG Dan(South-Central Minzu University,College of Computer Science,Wuhan 430074,China;South-Central Minzu University,Hubei Provincial Engineering Research Center for Intelligent Management of Manufacturing Enterprises,Wuhan 430074,China;Institute of Agricultural Economics and Technology,Hubei Academy of Agricultural Sciences,Wuhan 430064,China)

机构地区：[1]中南民族大学计算机科学学院,武汉430074 [2]中南民族大学、湖北省制造企业智能管理工程技术研究中心,武汉430074 [3]湖北省农业科学院农业经济技术研究所,武汉430064

出　　处：《中南民族大学学报（自然科学版）》2024年第4期474-484,共11页Journal of South-Central University for Nationalities：Natural Science Edition

基　　金：湖北省技术创新重大专项资助项目(2019ABA101);湖北省科技重大专项资助项目(2020AEA011);武汉市科技计划应用基础前沿资助项目(2020020601012267)。

摘　　要：针对遥感数据集存在的类内差异性大和类间相似性高的特点导致遥感场景分类准确率不高的问题,提出了一种基于注意力网络尺度特征融合(MSA-CNN)的遥感影像场景分类模型.将遥感图像经过尺度变换操作输入到VGG-16网络提取遥感影像的多尺度特征,使用多选框注意力模型(MS-APN)提取图像多尺度下的目标区域,对目标区域进行剪切和放大并输入到三层网络结构中.融合原始影像的多尺度特征和目标区域的特征,并且利用LBP对全局特征表达,克服遥感图像因拍摄角度不同带来的差异性.将融合的多尺度特征输入到网络全连接层来完成最终的分类预测任务.实验结果显示:MSA-CNN平均分类精度较注意循环卷积网络(ARCNet)和传统细粒度循环注意力网络(RA-CNN)在NWPU-RESISC45公开数据集上分别提升1.63%和2.66%,在UC Merced Land-Use公开数据集上较RA-CNN提升0.64%.结果表明:提出的MSA-CNN能够有效提高遥感图像场景分类的准确率.Aiming at the existence of remote sensing data sets within the class difference between large and class high similarity features in remote sensing scene classification accuracy is not high,a remote sensing image scene classification model based on attention network scale feature fusion(MSA-CNN).The remote sensing image is input to the VGG-16 network through scaling transformation is proposed to extract the multi-scale features of the remote sensing image.The multi-scale target region of the image is extracted by using the multi-scale attention model(MS-APN),and the target region is cut and enlarged and input into the three-layer network structure.The multi-scale features of the original image and the features of the target region are integrated,and LBP is used to express the global features to overcome the difference of the remote sensing image caused by different shooting angles.The fused multi-scale features are input to the full connection layer of the network to complete the final classification and prediction task.The experimental results show that the average classification accuracy of MSA-CNN is 1.63%and 2.66%higher than that of the attention circular convolutional network(ARCNet)and the traditional fine-grained circular attention network(RA-CNN)on the NWPU-Resisc45 public dataset,respectively.In the open data set of UC Merced Land-Use,it is 0.64%higher than that of RA-CNN.The results show that the proposed MSA-CNN can effectively improve the accuracy of scene classification of remote sensing images.

关 键 词：遥感图像 场景分类 多尺度特征 多选框注意力模型 LBP特征融合 

分 类 号：TP751[自动化与计算机技术—检测技术与自动化装置]