卷积神经网络层级分解研究  

Research on Hierarchical Decomposition of Convolutional Neural Network

作　　者：柯岩 林小竹[1] 廖蕊 魏战红 KE Yan;LIN Xiaozhu;LIAO Rui;WEI Zhanhong(College of Information Engineering,Beijing Institute of Petrochemical Technology,Beijing 102617,China;College of Information Science and Technology,Beijing University of Chemical Technology,Beijing 100029,China)

机构地区：[1]北京石油化工学院信息工程学院,北京102617 [2]北京化工大学信息科学与技术学院,北京100029

出　　处：《计算机工程》2019年第11期191-197,共7页Computer Engineering

基　　金：国家自然科学基金(61702040);北京市自然科学基金(4174089);北京市教委科研科技计划一般项目(KM201810017006)

摘　　要：随着深度学习的不断发展,卷积神经网络(CNN)在目标检测与图像分类中受到研究者的广泛关注。CNN从LeNet-5网络发展到深度残差网络,其层数不断增加。基于神经网络中"深度"的含义,在确保感受野相同的前提下,给定标准的输入图片和输出特征图,对不同层数的卷积神经网络进行训练,并将训练结果与标准输出图进行对比。在此基础上,对标准的3×3卷积核进行分解,构建由2×2大小卷积核组成的CNN。根据目标特征是否具有中心对称的性质,提出多层卷积网络初始权值的选取规则。With the continuous development of deep learning,Convolutional Neural Network(CNN)have received extensive attention from researchers in target detection and image classification.CNN have evolved from LeNet-5 networks to deep residual networks,and the number of layers are increasing.According to the definition of the depth of a neural network,this paper trains CNN of different layers with given standard input images and an output feature graph.The training is performed on the premise that the CNN shares the same receptive field,and training results are compared with standard output graphs.On this basis,the standard 3×3 convolution kernel is decomposed,and a convolutional neural network composed of 2×2 convolution kernels is constructed.According to the central symmetry property of the target feature,the selection rule of the initial weight of the multi-layer convolutional network is proposed.

关 键 词：卷积神经网络 卷积核 感受野 网络深度 中心极限定理 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]