单粒子翻转对神经网络的影响分析与优化  

Analysis and optimization of single event upset on neural network

作　　者：王慧玲 谢卓辰 梁旭文 WANG Huiling;XIE Zhuochen;LIANG Xuwen(Innovation Academy for Microsatellites,Chinese Academy of Sciences,Shanghai 201203,China;University of Chinese Academy of Sciences,Beijing 100049,China)

机构地区：[1]中国科学院微小卫星创新研究院,上海201203 [2]中国科学院大学,北京100049

出　　处：《中国科学院大学学报（中英文）》2021年第6期832-840,共9页Journal of University of Chinese Academy of Sciences

基　　金：上海市青年科技英才扬帆计划项目(17YF1418200);国家自然科学基金(91738201)资助。

摘　　要：DNN芯片作为星载芯片应用到卫星系统中时会受到太空辐照的影响,其中单粒子翻转对存储单元的干扰会使得存储器单元的参数出现错误,该错误映射到神经网络中会造成神经网络最后的输出结果出现偏差。结合单粒子翻转概率模型,对用于网络推断的神经网络的权值参数进行注错后分析实验结果准确率,从激活函数的非线性特性分析并通过实验验证具有双边抑制效果的函数容错能力更强。进一步在网络卷积层后加入BN层和在训练过程中考虑L2正则化提高网络的容错能力,并通过实验验证其可行性。When the DNN(deep neural network)chip is used in a satellite system as a space-borne chip,it will be affected by space radiation.The interference of single event upset(SEU)on the storage unit will cause the parameters of the memory unit to be wrong.The error mapping to the neural network will affect the output results.This paper analyzes the accuracy of the network inference which combines the SEU probability model to inject the error on the network weight parameters.From the analysis of the nonlinear characteristics of the activation function and experimental verification,it is found that the activation function with bilateral inhibition is more fault-tolerant.Furthermore,we add the BN layer after the network convolution layer and consider L2 regularization during training to improve the network's fault tolerance,and verify its feasibility through experiments.

关 键 词：单粒子翻转错误概率模型 深度神经网络 激活函数 网络容错 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]