模糊线性判别函数与权重初始化超球面  

Fuzzy Linear Discriminant Functions and the Weight-Initialization Hyperspheres

作　　者：冯天瑾[1] 刘洪波[1] 

机构地区：[1]中国海洋大学信息工程中心,山东青岛266071

出　　处：《中国海洋大学学报（自然科学版）》2004年第3期481-488,共8页Periodical of Ocean University of China

基　　金：国家高技术研究发展计划 ( 2 0 0 3 AA4Z2 1 3 0 )资助

摘　　要：将非线性神经元及多层感知机分类行为分析建筑在模糊集理论基础上 ,提出模糊线性判别函数、模糊判别面、模糊模式分类等概念 ,并引导出将多层感知机的隐层权重值均匀地分布在权重空间超球面上的网络初始化方法。以一系列实验验证此方法能明显提高多层感知机收敛性能 ,且与所用的学习算法、神经元的激励函数形式无关。Based on the fuzzy set theory, the concepts of fuzzy linear discriminant function, fuzzy decision surface, and fuzzy classification are introduced in this paper. Then, a novel weight-initialization method, by which the input-to-hidden weight vectors of MLP-classifiers are initialized and distributed uniformly on a hypersphere in the weight space, is induced. Using a series of experiments, it is proved that this weight-initialization method is an universal approach to improving markedly the performance of MLP-classifiers, no matter what kind of learning algorithms are exploited and what kind of activation functions are built into the hidden-neurons.

关 键 词：多层感知机 模糊线性判别函数 非线性激励函数 LM学习算法 权重初始化 神经网络 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] O159[自动化与计算机技术—控制科学与工程]