基于生成对抗网络的遥感光学影像舰船样本仿真  

Synthesis of Remote Sensing Optical Images with Ship Targets Based on Generative Adversarial Networks

作　　者：冀锐 马磊 张靖 王卫红 郭祉辀 万献慈 肖蕾 万玮[1] JI Rui;MA Lei;ZHANG Jing;WANG Weihong;GUO Zhizhou;WAN Xianci;XIAO Lei;WAN Wei(School of Earth and Space Sciences,Peking University,Beijing 100871;China Academic of Electronics and Information Technology,Beijing 100041;City Institute,Dalian University of Technology,Dalian 116630)

机构地区：[1]北京大学地球与空间科学学院,北京100871 [2]中国电子科技集团公司电子科学研究院,北京100041 [3]大连理工大学城市学院,大连116630

出　　处：《北京大学学报（自然科学版）》2024年第5期883-892,共10页Acta Scientiarum Naturalium Universitatis Pekinensis

摘　　要：基于遥感数据获取的真实舰船数据集数量非常有限,难以满足深度学习算法训练对样本数量的需求。针对此问题,利用三维模型和能够进行风格迁移的生成对抗网络,提出一种高质量的包含舰船目标的三波段光学高分辨率遥感图像仿真方法。基于构建的数据集,进行仿真样本的生成及评估。研究结果表明,该方法能够合成在视觉上接近真实影像的图像,通过加入合成样本对目标检测模型进行训练,可以使Faster-RCNN和YOLOv5的全类平均正确率mAP分别提升2.6%和2.3%。Due to real-world constraints,the quantity of ship datasets derived from remote sensing data is substantially limited and can’t fulfill the extensive sample demands required for training deep learning algorithms.According to this problem,a high-quality synthesizing method for three-band optical high-resolution remote sensing images containing ship targets is introduced,which utilizes 3D models and generative adversarial networks with style transfer capabilities.Based on the constructed dataset,synthetic samples are generated and evaluated.The experiments indicate that the approach can synthesize images visually close to real images.Incorporating these syn-thetic samples into the training process of detection models results in an increase of 2.6%in mAP for Faster R-CNN and 2.3%for YOLOv5.

关 键 词：舰船目标检测 高分辨率光学影像 仿真样本 深度学习 生成对抗网络 

分 类 号：U674.7[交通运输工程—船舶及航道工程] TP18[交通运输工程—船舶与海洋工程] TP751[自动化与计算机技术—控制理论与控制工程]