基于类脑脉冲神经网络的遥感图像检测算法  

Remote sensing image detection method based on brain-inspired spiking neural networks

作　　者：段德鑫 路遥 黄立威[2] 刘佩林[1] 文飞 DUAN Dexin;LU Yao;HUANG Liwei;LIU Peilin;WEN Fei(School of Electronic Information and Electrical Engineering,Shanghai Jiao Tong University,Shanghai 200240,China;Beijing Institute of Remote Sensing Information,Beijing 100192,China)

机构地区：[1]上海交通大学电子信息与电气工程学院,上海200240 [2]北京市遥感信息研究所,北京100192

出　　处：《遥感学报》2024年第7期1713-1721,共9页NATIONAL REMOTE SENSING BULLETIN

基　　金：科技创新2030-脑科学与类脑研究重大项目(编号:2022ZD0208701);卫星信息智能处理与应用技术重点实验室基金。

摘　　要：与第二代人工神经网络(ANN)相比,第三代类脑脉冲神经网络(SNN)由于其高能效、高仿生、可解释等特点,在遥感影像智能处理的高能效、高精度、高可解译方面具有较大的潜在优势。针对现有脉冲神经网络算法延时较大的问题,本文提出一种基于类脑脉冲神经网络的遥感图像检测算法。该算法首先搭建了一个带有动态裁剪阈值激活函数的目标检测神经网络作为源网络进行预训练,随后借助训练过程中得到的裁剪阈值,通过激活神经元与脉冲神经元的映射关系将源网络转换为类脑脉冲神经网络,在继承源网络较高精度的同时还具备了低延迟、高仿生的特点。在SSDD(SAR-Ship-Detection-Datasets)和RSOD两个公开遥感数据集上的实验结果表明,该方法能够以极低的损失将源网络转换至类脑脉冲神经网络,并能在低时间步下对遥感目标实现较高的检测识别精度。同时该方法能够在继承ANN网络易于训练的特性与精度优势的同时,充分展现SNN的高稀疏度的带来的巨大能效优势。In the intelligent processing of remote sensing images,third-generation brain-inspired Spiking Neural Network(SNN)surpasses its predecessor,the second-generation artificial neural network,showing remarkable advantages in terms of high energy efficiency,high precision,and high interpretability.These advantages stem from the SNN’s characteristic features,including high energy efficiency,elevated sparsity,and remarkable bio-plausibility.The integration of these features in the SNN presents an enthralling solution to challenges faced in remote sensing image processing and holds immense potential for advancing this field further.The proposed algorithm introduces a novel approach and initially establishes a target-detection neural network,which serves as the source artificial neural network for pretraining.This source network utilizes a dynamic clipping threshold activation function to optimize its performance.Subsequently,the algorithm transforms the source network into a brain-inspired SNN by leveraging the mapping relationship between activated neurons and spiking neurons.This conversion process effectively incorporates the clipping thresholds obtained during training.By seamlessly transitioning the source network into an SNN,the algorithm ensures the preservation and enhancement of key characteristics essential for remote sensing image processing.The efficacy of the proposed method was evaluated through extensive experiments performed on two widely recognized open remote sensing datasets:SAR-Ship-Detection-Datasets(SSDD)and RSOD.Experimental results highlighted the exceptional capabilities of the proposed method in transforming the source network into a brain-inspired spiking neural network,demonstrating negligible loss in performance.Furthermore,the transformed SNN exhibited remarkable accuracy in detecting and recognizing remote sensing targets within significantly reduced time steps.The performance achieved by the transformed SNN was comparable to that of the source artificial neural network while tremendously

关 键 词：SAR 遥感图像 光学遥感 目标检测 深度学习 脉冲神经网络 

分 类 号：TP701[自动化与计算机技术—检测技术与自动化装置] P2[自动化与计算机技术—控制科学与工程]