深度学习驱动的领域专用架构  

Domain-speci?c architectures driven by deep learning

作　　者：马立伟 Liwei MA(BitMain Technologies Holding Company,Beijing 100192,China)

机构地区：[1]北京比特大陆科技有限公司,北京100192

出　　处：《中国科学：信息科学》2019年第3期334-341,共8页Scientia Sinica(Informationis)

摘　　要：深度学习是人工智能近年来的新进展,其对计算的新需求驱动新的计算架构.本文首先通过分析人工智能的阶段和任务指出深度学习的需求实质,然后从3个方面讨论深度学习领域专用架构,分别是计算结构的评价标准、数字计算的数制基础和深度学习计算架构的研究方向.本文首次提出使用K-L距离(Kullback-Leibler divergence)来评价深度学习结构的复杂度和准确度.本文认为以Posit数制为基础,不仅可以重新构造深度学习的计算架构,而且可以重新构造科学计算的计算架构,形成计算芯片设计的后发优势.最后全文总结认为深度学习驱动的领域专用架构将是计算架构创新的重要组成部分.Deep learning(DL)is one of the most exciting progresses in the field of arti ficial intelligence(AI);moreover,its new computational demands are driving new architecture researches.This paper firstly points out DL requirement essence by analyzing the stage and tasks in AI development,then discusses DL domain-speci fic architectures(DSAs)from three perspectives,which are the criteria of computational structures,the basics of a numerical system for computation,and DL DSA potential research directions.Furthermore,herein,the KullbackLeibler divergence was utilized as the criteria for DL computation architecture complexity and accuracy.Besides,Posit was employed as a new number system to rebuild DL computation and scienti fic computation and to establish the late-development advantage of digital chips.Finally,it was concluded that DL DSAs are one of the critical DSA research areas.

关 键 词：深度学习 熵 互熵 数制 计算架构 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]