基于脉冲神经网络微调方法的遥感图像目标检测  

Research on Spiking Neural Network fine-tuning method for object detection in remote sensing images

作　　者：郭柏麟 黄立威[2] 路遥 张雪涛[1,3,4] 马永强 GUO Bailin;HUANG Liwei;LU Yao;ZHANG Xuetao;MA Yongqiang(National Key Laboratory of Human-Machine Hybrid Augmented Intelligence,Xi’an 710049,China;Beijing Institute of Remote Sensing,Beijing 100192,China;National Engineering Research Center forVisual Information and Applications,Xi’an 710049,China;Institute of Artificial Intelligence and Robotics,Xi'an Jiaotong University,Xi’an 710049,China)

机构地区：[1]西安交通大学人机混合增强智能全国重点实验室,西安710049 [2]北京市遥感信息研究所,北京100192 [3]西安交通大学视觉信息与应用国家工程研究中心,西安710049 [4]西安交通大学人工智能与机器人研究所,西安710049

出　　处：《遥感学报》2024年第7期1702-1712,共11页NATIONAL REMOTE SENSING BULLETIN

基　　金：卫星信息智能处理与应用重点实验室基金;国家重点研发计划(编号:2022ZD0208801)。

摘　　要：遥感影像目标检测问题是视觉图像识别任务的重要研究内容之一,但是在船舶遥感图像中,船舶目标小且分布稀疏,使用传统的人工神经网络(ANN)进行目标检测往往会浪费大量的计算资源。脉冲神经网络(SNN)的事件驱动与低功耗特性可以极大地节省能量消耗同时解放更多的计算资源。然而SNN神经元由于其复杂动态与不可微调的脉冲操作,难以正常进行训练。作为替代,将训练好的ANN转换为SNN可以有效规避这一问题。对于转换后的深层SNN,需要大量时间步长(time steps)来维持其性能。这一过程需要大量的计算资源并对产生较大的延迟,与低功耗的研究初衷相违背。本文研究了转换后SNN需要大量time steps维持模型性能的原因,并提出了新的转换方法,基于微调的逐层转换方法;考虑硬件部署的合理性,提出了泊松群编码,相比泊松编码,泊松群编码输出的脉冲序列噪声更小,对模型性能的影响更小。实验表明,微调转换方法在SAR舰船检测数据集(SSDD、AIR-SARShip)上取得与转换前模型(97.9%、79.6%)相近的性能(96.9%、70.3%),在PASCAL VOC数据集上也获得了较好的检测性能(49.2%),而且对于泊松群编码,time steps相同的条件下神经元数目越多,对模型性能的影响越小,时间步长较少的条件下即可获得与输入模拟频率近似的性能。本文的研究可以提升转换后SNN的性能,减少转换后SNN对time steps的需求,并为SNN的硬件部署提供了一个切实有效的输入编码方法。Object detection in remote sensing images is essential research contents of visual image recognition tasks.However,in the remote sensing images of ships,a ship target is small and sparsely distributed,and using a traditional Artificial Neural Network(ANN)for object detection often wastes a considerable amount of computing resources.SpikinG Neural Networks(SNNs)can be applied due to its event-driven and low-power characteristics,greatly saving energy and computing resources.However,training an SNN is difficult because of the complex dynamics and nondifferentiable pulse operation of SNN neurons.Instead,converting a trained ANN into SNN can effectively circumvent training difficulties.For a converted deep SNN,many time steps are often required to maintain its performance.Unfortunately,this process requires a substantial amount of computing resources.This paper studies the reason why a large number of time steps are required to maintain an SNN model’s performance after conversion and proposes a novel conversion method:a layer-by-layer conversion method based on fine-tuning.During conversion,the network is converted layer by layer,and the subsequent unconverted network is fine-tuned,and thus the errors accumulate layer by layer during conversion is prevented.In addition,given the rationality of hardware deployment,we propose Poisson group coding,which uses multiple Poisson coding neurons to encode input images and sends them to the network after average pooling.Compared with Poisson coding,the output of Poisson group coding is less noisy and has less impact on model performance.The fine-tuning transformation method achieves a result(96.9%,70.3%),similar to that of YOLOv3-tiny(97.9%,79.6%)on the SAR ship detection datasets(AIR-SARShip),and 80%of the performance of the preconversion model can be achieved by using few time steps(20 and 80 steps).The method achieves good detection performance(49.2%)on the PASCAL VOC dataset.By contrast,the performance of the conventional conversion method is inferior to that of the fine

关 键 词：脉冲神经网络 目标检测 船舶遥感图像 ANN-SNN转换 泊松群编码 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] P2[自动化与计算机技术—控制科学与工程]