一种基于混合粒子群优化算法的深度卷积神经网络架构搜索方法  

Deep convolutional neural architecture search method based onhybrid particle swarm optimization algorithm

作　　者：王上 唐欢容[1,2] Wang Shang;Tang Huanrong(School of Computer Science&School of Cyberspace Security,Xiangtan University,Xiangtan Hunan 411105,China;Key Laboratory of Intelligent Computing&Information Processing,Ministry of Education,Xiangtan University,Xiangtan Hunan 411105,China)

机构地区：[1]湘潭大学计算机学院·网络空间安全学院,湖南湘潭411105 [2]湘潭大学智能计算与信息处理教育部重点实验室,湖南湘潭411105

出　　处：《计算机应用研究》2023年第7期2019-2024,共6页Application Research of Computers

基　　金：国家重点研发计划课题(2018AAA0102301,2020YFC0832401)。

摘　　要：神经架构搜索(neural architecture search,NAS)技术自动寻找神经网络中各层的最佳组合和连接方式,以及各种超参数的最佳分布。该方法从搜索空间生成若干不同的卷积神经网络(CNN),使用混合粒子群优化(hybrid particle swarm optimization,HPSO)算法,将一定数目的神经网络个体视做一个群体,将每个网络个体在评价指标下的表现值视做适应度,在给定的世代数范围内,每个神经网络个体都学习自身的历史最佳适应度个体,和整个群体的最佳适应度个体,迭代改善自身的网络架构。实验结果表明,算法运行中出现的最优网络架构,在图像分类任务的多个基准数据集上,与手工设计的神经网络和以遗传算法为基础的NAS算法相比,在网络参数数量和准确率的平衡上取得了有竞争力的结果。The neural architecture search(NAS)technique automatically finds the optimal combination and connectivity of layers in a neural network,as well as the optimal distribution of various hyperparameters.The method generated a number of different convolutional neural network(CNN)from the search space,and used a hybrid particle swarm optimization(HPSO)algorithm to treat a certain number of neural network individuals as a population and the performance of each individual under the evaluation metric as the fitness.Within a given number of generations,each neural network individual learnt its own historical best fitness individual,and the best fitness individual of the whole population,and iteratively improved its own network architecture.Experimental results show that the optimal network architecture emerging from the algorithm runs achieves competitive results in terms of the trade-off between the number of network parameters and accuracy on multiple benchmark datasets for the image classification task,compared to both the hand-designed neural network and the genetic algorithm-based NAS algorithm.

关 键 词：混合粒子群算法 神经架构搜索 卷积神经网络 图像分类 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]