一种结构范数正则化的可微神经结构搜索算法  

A differentiable neural architecture search algorithm with architecture norm regularization

作　　者：曾宪华[1,2] 吴杰 夏耀光 向一心 Xianhua ZENG;Jie WU;Yaoguang XIA;Yixin XIANG(School of Computer Science and Technology/School of Artificial Intelligence,Chongqing University of Posts and Telecommunications,Chongqing 400065,China;Chongqing Key Laboratory of Image Cognition,Chongqing University of Posts and Telecommunications,Chongqing 400065,China)

机构地区：[1]重庆邮电大学计算机科学与技术学院/人工智能学院,重庆400065 [2]重庆邮电大学图像认知重庆市重点实验室,重庆400065

出　　处：《中国科学：信息科学》2024年第9期2181-2199,共19页Scientia Sinica(Informationis)

基　　金：国家自然科学基金(批准号:62076044);重庆英才计划“包干制”项目(批准号:cstc2022ycjh-bgzxm0160)资助。

摘　　要：可微神经结构搜索(differentiable neural architecture search,DNAS)作为近年来神经结构搜索的主流方法之一,通过结合基于梯度优化的搜索策略能够有效地搜索网络结构.然而,存在结构搜索稳定性差和模型复杂度高的问题.为了解决这两个问题,本文提出了一种结构范数正则化的可微神经结构搜索算法,提高了结构搜索的稳定性;设计了一种冗余边剪枝算法修剪网络结构中的冗余边,降低了最终模型的复杂度.本文在CIFAR10,CIFAR100,miniImageNet和胎儿心脏标准平面分类(fetal heart standard plane,FHSP)等4个数据集上进行了算法性能对比实验,与一系列当前最新的可微神经结构搜索算法相比,取得了最优的综合性能.Differentiable neural architecture search(DNAS)has emerged as a popular method for finding network architectures by using a gradient-based optimization search strategy.However,there have been issues with the instability of the network architecture search and high model complexity.To address these challenges,this paper introduces a novel differentiable neural architecture search algorithm with architecture norm regularization to enhance the stability of network architecture search.Additionally,a redundant edge pruning algorithm is proposed to reduce the complexity of the final model by pruning redundant edges in the network architecture.Comparative experiments on algorithm performance were conducted using four datasets:CIFAR10,CIFAR100,miniImageNet,and Fetal Heart Standard Plane classification(FHSP).The results demonstrate that,in comparison to several of the latest differentiable neural architecture search algorithms,the proposed algorithm achieved the best overall performance.

关 键 词：深度学习 可微神经结构搜索 剪枝 正则化 高效搜索网络结构 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程] TP391.41[自动化与计算机技术—控制科学与工程]