Improving multi-layer spiking neural networks by incorporating brain-inspired rules  

作　　者：Yi ZENG Tielin ZHANG Bo XU 

机构地区：[1]Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China [2]Center for Excellence in Brain Science and Intelligence Technology, Chinese Academy of Sciences, Shanghai 200031, China

出　　处：《Science China(Information Sciences)》2017年第5期222-232,共11页中国科学（信息科学）（英文版）

基　　金：supported by Strategic Priority Research Program of Chinese Academy of Sciences (Grant No. XDB02060007);Beijing Municipal Commission of Science and Technology (Grant Nos. Z151100000915070, Z161100000216124)

摘　　要：This paper introduces seven brain-inspired rules that are deeply rooted in the understanding of the brain to improve multi-layer spiking neural networks（SNNs）. The dynamics of neurons, synapses, and plasticity models are considered to be major characteristics of information processing in brain neural networks.Hence, incorporating these models and rules to traditional SNNs is expected to improve their efficiency. The proposed SNN model can mainly be divided into three parts： the spike generation layer, the hidden layers, and the output layer. In the spike generation layer, non-temporary signals such as static images are converted into spikes by both local and global feature-converting methods. In the hidden layers, the rules of dynamic neurons,synapses, the proportion of different kinds of neurons, and various spike timing dependent plasticity（STDP）models are incorporated. In the output layer, the function of classification for excitatory neurons and winner take all（WTA） for inhibitory neurons are realized. MNIST dataset is used to validate the classification accuracy of the proposed neural network model. Experimental results show that higher accuracy will be achieved when more brain-inspired rules（with careful selection） are integrated into the learning procedure.This paper introduces seven brain-inspired rules that are deeply rooted in the understanding of the brain to improve multi-layer spiking neural networks（SNNs）. The dynamics of neurons, synapses, and plasticity models are considered to be major characteristics of information processing in brain neural networks.Hence, incorporating these models and rules to traditional SNNs is expected to improve their efficiency. The proposed SNN model can mainly be divided into three parts： the spike generation layer, the hidden layers, and the output layer. In the spike generation layer, non-temporary signals such as static images are converted into spikes by both local and global feature-converting methods. In the hidden layers, the rules of dynamic neurons,synapses, the proportion of different kinds of neurons, and various spike timing dependent plasticity（STDP）models are incorporated. In the output layer, the function of classification for excitatory neurons and winner take all（WTA） for inhibitory neurons are realized. MNIST dataset is used to validate the classification accuracy of the proposed neural network model. Experimental results show that higher accuracy will be achieved when more brain-inspired rules（with careful selection） are integrated into the learning procedure.

关 键 词：brain-inspired rules spiking neural network PLASTICITY classification task 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] TP311[自动化与计算机技术—控制科学与工程]