用线性多步法训练神经网络  

TRAINING NEURAL NETWORKS BY USING THE LINEAR MULTI-STEP METHOD

作　　者：许少华[1] 梁久祯[1] 何新贵[2] 

机构地区：[1]北京航空航天大学计算机科学与工程系,北京100083 [2]北京系统工程研究所,北京100101

出　　处：《计算机研究与发展》2001年第12期1486-1490,共5页Journal of Computer Research and Development

基　　金：黑龙江省自然科学基金资助 ( F 9917)

摘　　要：研究用微分方程数值解法——线性多步法替代神经网络的学习算法 .指出在一定条件下神经网络的 BP学习问题与求解一个相应的微分动力系统在渐近意义下是等价的 ,从而求解微分动力系统的数值解法也可用于神经网络的学习 .给出了训练神经网络的 Milne方法和 BP- Milne结合算法以及 Hamming方法和 BP- Hamm ing结合算法 ,并以 9点两类模式、随机模式识别和石油地质中沉积微相模式识别等 3个问题为例进行了实验 .实验结果表明利用微分动力系统的数值解法进行神经网络的学习是可行的 .Training neural networks by using the linear multi-step method is studied, which is a classical numerical method for differential dynamics. It is pointed out that the iteration formula of BP algorithm is equivalent to the Euler method of differential dynamic systems under certain conditions, and the asymptotic solutions of the two formulas are consistent, and thus training a neural network can be converted to computing numerical solution of differential dynamic systems. Two algorithms to train neural networks are presented, namely the Milne method and the Hamming method. Finally three experiment examples are implemented to illustrate the fitness of training neural networks by the numerical method for differential dynamics.

关 键 词：神经网络 学习算法 微分动力系统 数值解 线性多步法 训练 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]