基于ReLU稀疏性的MAXOUT卷积神经网络的数据分类算法  

Data Classification Algorithm Based on Sparse MAXOUT Convolutional Neural Network

作　　者：赵馨宇 黄福珍 周晨旭 ZHAO Xinyu;HUANG Fuzhen;ZHOU Chenxu(Shanghai University of Electric Power,Shanghai 200090,China;Shanghai Municipal Engineering Design and Research General Institute(Group)Co.Ltd.,Shanghai 201900,China)

机构地区：[1]上海电力大学,上海200090 [2]上海市政工程设计研究总院(集团)有限公司,上海201900

出　　处：《上海电力大学学报》2020年第3期280-284,共5页Journal of Shanghai University of Electric Power

摘　　要：卷积神经网络作为一种具有深度学习能力的人工学习网络,由于其具有权值数量少、网络模型复杂度低以及算法效率高等优点在很多领域被广泛应用,但是其表现在很大程度上依赖于激活函数的选取,而激活函数的选取又比较复杂,大都是依靠经验或者实验来选择,所以这个过程中会出现无先验知识可借鉴或者参数类型繁琐难以较快确定的情况。MAXOUT卷积神经网络的出现解决了激活函数难以选择的问题,在研究MAXOUT网络构架的基础上,针对其不稀疏的特性引入ReLU稀疏单元,提出了一种基于ReLU函数稀疏性的MAXOUT卷积神经网络,并在MINST和CIFAR 10两个数据集上分别进行了数据分类实验。实验结果表明,具有稀疏性的MAXOUT卷积神经网络的分类效果更加理想。Convolution neural network as a kind of artificial learning network with deep learning ability,has been widely used in many fields,due to its advantages of low weight,low complexity of network model and high efficiency of algorithm.But its performance depends on the selection of the activation function,which is more complex and mostly relies on experience or experimental.But there are situations where there is no prior knowledge or the parameter is too complex to determine.MAXOUT solves the problem that activation function is difficult to choose.Based on the study of MAXOUT network architecture,a sparse MAXOUT convolutional neural network based on ReLU function is proposed and ReLU sparse unit is introduced for its non-sparse characteristics.The classification results on the databases MINST and CIFAR 10 show that the classification effect of MAXOUT with sparsity is more ideal.

关 键 词：卷积神经网络 激活函数 稀疏性 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]