深度神经架构搜索综述  

Deep Neural Architecture Search:A Survey

作　　者：孟子尧 谷雪 梁艳春[1,2] 许东[3] 吴春国[1] Meng Ziyao;Gu Xue;Liang Yanchun;Xu Dong;Wu Chunguo(Key Laboratory of Symbol Computation and Knowledge Engineering(Jilin University),Ministry of Education,Changchun 130012;Zhuhai Laboratory of Key Laboratory of Symbol Computation and Knowledge Engineering(Zhuhai College of Jilin University),Ministry of Education,Zhuhai,Guangdong 519041;Department of Electrical Engineering and Computer Science,University of Missouri-Columbia,Columbia,Missouri,USA MO65211)

机构地区：[1]符号计算与知识工程教育部重点实验室(吉林大学),长春130012 [2]符号计算与知识工程教育部重点实验室珠海分实验室(吉林大学珠海学院),广东珠海519041 [3]密苏里大学哥伦比亚分校电子工程与计算机科学系,美国密苏里州哥伦比亚MO65211

出　　处：《计算机研究与发展》2021年第1期22-33,共12页Journal of Computer Research and Development

基　　金：国家自然科学基金项目(61972174,61876069,61876207);吉林省重点研发项目(20180201045GX,20180201067GX);吉林省自然科学基金项目(20200201163JC);广东省科技计划项目(2020A0505100018);广东省应用基础研究重点项目(2018KZDXM076);广东省优势重点学科项目(2016GDYSZDXK036)。

摘　　要：深度学习在图像、语音、文本等多种模态的数据任务上取得了优异的效果.然而,针对特定任务,人工设计网络需要花费大量的时间,并且需要设计者具有一定水平的专业知识和设计经验.面对如今日趋复杂的网络架构,仅依靠人工进行设计变得越来越复杂.基于此,借助算法自动地对神经网络进行架构的搜索成为了研究热点.神经架构搜索的方法涉及3个方面:搜索空间、搜索策略、性能评估策略.通过搜索策略在搜索空间中选择一个网络架构,借助性能评估策略对该网络架构进行评估,并将结果反馈给搜索策略指导搜索策略选择更好的网络架构,通过不断迭代得到最优的网络架构.为了更好地为读者提供一个快速了解神经网络架构搜索方法的导航地图,从搜索空间、搜索策略和性能评估策略3个方面对现有典型的神经架构搜索方法进行了梳理,总结讨论了近年来常见的架构搜索方法,并分析了各种方法的优势和不足.Deep learning has achieved excellent results on data tasks with multiple modalities such as images,speech,and text.However,designing networks manually for specific tasks is time-consuming and requires a certain level of expertise and design experience from the designer.In the face of today s increasingly complex network architectures,relying on manual design alone increasingly becomes complex.For this reason,automatic architecture search of neural networks with the help of algorithms has become a hot research topic.The approach of neural architecture search involves three aspects:search space,search strategy,and performance evaluation strategy.The search strategy samples a network architecture in the search space,evaluates the network architecture by a performance evaluation strategy,and feed-back the results to the search strategy to guide it to select a better network architecture,and obtains the optimal network architecture through continuous iterations.In order to better sort out the methods of neural architecture search,we summarize the common methods in recent years from search space,search strategy and performance evaluation strategy,and analyze their strengths and weaknesses.

关 键 词：深度学习 神经架构搜索 搜索空间 搜索策略 性能评估 

分 类 号：TP183[自动化与计算机技术—控制理论与控制工程]