整型推理量化CNN的SAR图像跨域变化检测  

IIQ-CNN-based cross-domain change detection of SAR images

作　　者：王蓉芳 王良[1,2] 李畅 霍春雷 陈佳伟[2] Wang Rongfang;Wang Liang;Li Chang;Huo Chunlei;Chen Jiawei(School of Artificial Intelligence,Xidian University,Xi’an 710071,China;Key Laboratory of Intelligent Perception and Image Understanding,Ministry of Education,Xidian University,Xi’an 710071,China;National Laboratory of Pattern Recognition,Institute of Automation,Chinese Academy of Sciences,Beijing 100190,China)

机构地区：[1]西安电子科技大学人工智能学院,西安710071 [2]西安电子科技大学智能感知与图像理解教育部重点实验室,西安710071 [3]中国科学院自动化研究所模式识别国家重点实验室,北京100190

出　　处：《中国图象图形学报》2023年第7期2208-2220,共13页Journal of Image and Graphics

基　　金：国家自然科学基金项目(62176196);多模态人工智能系统全国重点实验室开放课题项目(202200021);陕西省重点研发计划项目(2023-YBNY-218)。

摘　　要：目的合成孔径雷达(synthetic aperture radar,SAR)特有的成像优势使得SAR图像变化检测在民用和军事领域有着广泛的应用场景,但实际应用中对SAR图像的变化区域进行标注既耗时又昂贵,而且现有的变化检测方法复杂度较高,无法满足实时、快速检测的需求。对此,提出了一种基于整型推理量化卷积神经网络的SAR图像跨域变化检测方法(integer inference-based quantization convolutional neural network,IIQ-CNN)。方法该方法研究了不同场景之间的跨域变化检测问题,即利用已有标记的源域数据对未知的目标域数据进行检测;设计了同时使用时相图和差异图的样本构建方法,既避免了检测结果对差异图的过分依赖,又能充分利用差异信息和时相图与差异图之间的共享信息,提高检测精度;并且在变化检测任务中首次引入整型推理量化技术,对深度网络模型进行模拟量化,减小模型复杂度并加速推理时间。结果在4组真实的SAR图像数据集上进行实验,从检测性能上看,IIQ-CNN与其他CNN方法相比,Kappa系数提高了4.23%~9.07%;从量化能力上看,对IIQ-CNN分别进行16、8和4位量化,仅在4位量化时检测结果有较明显下降,在16和8位量化时,模型都保持了较好的检测性能,并且推理时间明显减少。结论本文方法有效解决了伪标签质量对变化检测性能的影响,实现了加速推理的同时较好地保持模型检测精度的目的,促进了变化检测算法在嵌入式设备中的应用。Objective Multiple remote sensing(RS)imaging technologies-oriented synthetic aperture radar(SAR)have been developing dramatically nowadays.Compared to other related RS imaging techniques,SAR imaging technique has its high-resolution potentials for all-weather and all-day observation beyond atmospheric and sunlight conditions.SAR image is oriented to changeable detection in related to such land cover analyses and certain regional comparison via multitemporal SAR images.It can be widely applied for such domains in the context of natural disaster analysis,agricultural monitoring,and public security surveillance.To get final binary dynamic detection map,conventional detection method consists of such three aspects like preprocessing image,generating difference image,and analyzing the difference map.The accuracy of conventional changeable detection results are greatly originated from data preprocessing and difference image quality.The information loss is related to preprocessing and generating the difference image,especially for the regions of slight changes,and it is very tough to detect the changeable information of this location subsequently.Recent neural network has been facilitating for effective feature learning method,and non-local structures are developed and highly robust to noise-relevant features extraction and invariance can be generated as well.In addition,deep neural network(DNN)based end-to-end structure of can effectively alleviate the constraints of changeable detection results on the difference image.In recent years,multiple variants of convolutional neural network(CNN)models have been developing intensively.The growth of complex network models is required to deal with much more computing resources.To optimize the complexity of neural network,there are two sort of problem-solving schemes mentioned below:the first scheme is developed based on the structure of the neural network model.It can optimize the complexity of the model and such computing resources can be assigned to a new type of operator for f

关 键 词：SAR图像 变化检测(CD) 整型推理量化 卷积神经网络(CNN) 跨域检测 

分 类 号：TP751.1[自动化与计算机技术—检测技术与自动化装置]