Approximate computation of Madaline sensitivity based on discrete stochastic technique  

作　　者：ZHONG ShuiMing , ZENG XiaoQin, LIU HuiYi & XU Yan Institute of Pattern Recognition and Intelligent System, College of Computer and Information Engineering, Hohai University, Nanjing 210098, China 

出　　处：《Science China(Information Sciences)》2010年第12期2399-2414,共16页中国科学（信息科学）（英文版）

基　　金：supported by the National Natural Science Foundation of China (Grant Nos. 60571048, 60971088);the Research Innovation Program for College Postgraduate in Jiangsu Province (Grant No. CX09B 157Z);the Excellent Doctoral Dissertation Cultivation Program of HoHai University (Grant No. 2010B19214)

摘　　要：The computation of the sensitivity of a Madaline＇s output to its parameter perturbation is systematically discussed. Firstly, according to the discrete feature of Adalines, a method based on discrete stochastic technique is proposed, which derives some analytical formulas for the computation of Adalines＇ sensitivity. The method can theoretically solve some problems that are unsolvable by the existing methods based on continuous stochastic techniques, release some unpractical constraints, and make it available to theoretically analyze the approximation error of Adalines＇ sensitivity. Secondly, on the basis of the sensitivity of Adalines and the structural characteristics of Madalines, a new selection strategy depending on a type of dedication degree for computing Madalines＇ sensitivity is proposed, which is superior to current popular way of simply averaging in both precision and complexity. The proposed formulas and algorithm have the advantages of simplicity, low computational complexity, small approximation error, and high generality, as have been verified by a great amount of experimental simulations.The computation of the sensitivity of a Madaline＇s output to its parameter perturbation is systematically discussed. Firstly, according to the discrete feature of Adalines, a method based on discrete stochastic technique is proposed, which derives some analytical formulas for the computation of Adalines＇ sensitivity. The method can theoretically solve some problems that are unsolvable by the existing methods based on continuous stochastic techniques, release some unpractical constraints, and make it available to theoretically analyze the approximation error of Adalines＇ sensitivity. Secondly, on the basis of the sensitivity of Adalines and the structural characteristics of Madalines, a new selection strategy depending on a type of dedication degree for computing Madalines＇ sensitivity is proposed, which is superior to current popular way of simply averaging in both precision and complexity. The proposed formulas and algorithm have the advantages of simplicity, low computational complexity, small approximation error, and high generality, as have been verified by a great amount of experimental simulations.

关 键 词：ADALINE Madaline feedforward networks sensitivity parameter perturbation stochastic discretetechnique 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]