递归pi-sigma神经网络的带惩罚项的梯度算法分析  

Gradient algorithm with penalty for training recurrent pi-sigma neural network

作　　者：喻昕[1] 邓飞[1] 

机构地区：[1]广西大学计算机与电子信息学院,南宁530004

出　　处：《计算机工程与应用》2013年第4期43-46,共4页Computer Engineering and Applications

基　　金：国家自然科学基金(No.60763013);广西人才小高地创新团队计划(No.[2007]71);广西教育厅基金项目(No.TLZ100715);广西大学科研基金项目(No.X081017)

摘　　要：传统的梯度算法存在收敛速度过慢的问题,针对这个问题,提出一种将惩罚项加到传统误差函数的梯度算法以训练递归pi-sigma神经网络,算法不仅提高了神经网络的泛化能力,而且克服了因网络初始权值选取过小而导致的收敛速度过慢的问题,相比不带惩罚项的梯度算法提高了收敛速度。从理论上分析了带惩罚项的梯度算法的收敛性,并通过实验验证了算法的有效性。In this paper, a new gradient training algorithm is presented to train the recurrent pi-sigma neural networks, in which a penalty is added to the conventional error function. The algorithm can not only improve the generalization of neural networks, but also avoid the slow convergence caused by the case that the original weights are chosen too small, achieving a better conver- gence compared to the traditional gradient algorithm without the penalty term. Moreover, the convergence of the algorithm is also studied, and finally the simulated experimental results indicates that the algorithm is efficient.

关 键 词：递归pi-sigma神经网络 梯度算法 惩罚项 收敛性 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] TP389.1[自动化与计算机技术—控制科学与工程]