基于分区再训练的RRAM阵列多缺陷容忍算法  

Partition retraining based multi-fault tolerance algorithm for RRAM crossbar

作　　者：王梦可 杨朝晖 查晓婧 夏银水[1] Wang Mengke;Yang Zhaohui;Zha Xiaojing;Xia Yinshui(Faculty of Electrical Engineering&Computer Science,Ningbo University,Ningbo Zhejiang 315211,China)

机构地区：[1]宁波大学信息科学与工程学院,浙江宁波315211

出　　处：《计算机应用研究》2024年第10期3068-3072,共5页Application Research of Computers

基　　金：国家自然科学基金资助项目(62131010,U22A2013);国家自然科学基金青年项目(62304115);浙江省自然科学基金创新群体资助项目(LDT23F04021F04);浙江省科研计划一般项目(Y202248965)。

摘　　要：针对RRAM单元制造工艺不完善造成神经网络矩阵向量乘法计算错误问题,根据RRAM阵列多缺陷特性进行建模,提出了多缺陷容忍算法。首先根据RRAM阵列常见的转变缺陷和粘连缺陷对神经网络计算准确度的影响,对两种缺陷统一建模;然后对神经网络进行划分,基于改进的知识蒸馏方式进行分区训练;最后选择适配的损失函数加入归一化层,进一步优化算法。在MNIST和Cifar-10数据集上进行实验,结果表明该方法在多个神经网络上能够得到98%以上的恢复率,说明该方法可有效降低RRAM阵列多缺陷对神经网络计算准确度的影响。To address the issue of calculation errors in neural network matrix-vector multiplication caused by manufacturing processes of RRAM cells,this paper modeled the characteristics of multiple faults in RRAM crossbar arrays and proposed a multi-fault tolerant algorithm.Firstly,it modeled the impacts of common transition fault and stuck at fault in RRAM crossbar arrays on the accuracy of neural network computations.Secondly,it partitioned the neural network and conducted partitioned training based on an improved knowledge distillation method.Lastly,it further optimized the algorithm by selecting an appropriate loss function and incorporating normalization layers.Experimental results on the MNIST and Cifar-10 datasets demonstrate that the proposed method can achieve a recovery rate of over 98%across multiple neural networks,indicating its effectiveness in mitigating the impact of multiple faults in RRAM crossbar arrays on the accuracy of neural network computations.

关 键 词：RRAM阵列 缺陷容忍 神经网络 知识蒸馏 

分 类 号：TP391.7[自动化与计算机技术—计算机应用技术]