一种新型的神经元激活函数及其导数的可编程发生器  

A Novel Programmable Generator of Neuron Activation Function and Its Derivative

作　　者：卢纯[1] 石秉学[1] 

机构地区：[1]清华大学微电子所,北京100084

出　　处：《固体电子学研究与进展》2002年第1期64-67,共4页Research & Progress of SSE

基　　金：国家自然科学基金 (编号 :6963 60 3 0 )资助项目

摘　　要：在神经网络的片上学习中 ,需要将神经元激活函数及其导数都映射为硬件。为满足这种需求 ,利用前向差分的原理 ,提出了一种新型的神经元激活函数及其导数的可编程发生器。该发生器采用模拟电路 ,具有结构简单、速度快、功耗小的优点。它产生的函数不仅与理想函数的拟合程度很好 ,而且可对阈值和增益因子进行编程 ,从而克服了一般模拟电路可编程性差、适用范围窄的缺点。采用标准 1 .2μm CMOS工艺的第 47级模型 ,对电路进行的In the neural network on chip learning,both the neuron activation function and its derivative must be mapped to hardware. A novel programmable generator is presented to meet this requirement. Using the forward difference method, the neuron activation function and its derivative are generated at the same time. Designed by the analog circuit, the generator has the merits of simplicity, speediness and low power consumption. The generated functions are not only fit well for the ideal functions, but also programmable with the threshold and the gain factor. Thus, the generator overcomes the disadvatages of poor programmability and small flexibility of analog circuits. The circuit is simulated with HSPICE, using level 47 transistor models for a standard 1.2 μm CMOS process. The results show the superior performance of the generator.

关 键 词：神经网络 可编程发生器 激活函数 导数 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]