基于任务资源需求预测的人工智能算力调度  

Artificial intelligence computing power cluster scheduling based on task resource demand prediction

作　　者：杨明烜 洪学海[1] 唐宏伟[1,3] YANG Mingxuan;HONG Xuehai;TANG Hongwei(Institute of Computing Technology,Chinese Academy of Sciences,Beijing 100190;University of Chinese Academy of Sciences,Beijing 100049;University of Chinese Academy of Sciences,Nanjing 211135)

机构地区：[1]中国科学院计算技术研究所,北京100190 [2]中国科学院大学,北京100049 [3]中国科学院大学南京学院,南京211135

出　　处：《高技术通讯》2024年第5期475-485,共11页Chinese High Technology Letters

基　　金：国家重点研发计划(2016YFC1401706)资助项目。

摘　　要：为提升人工智能(AI)算力的任务执行效率和资源利用率,本文提出一种基于任务资源需求预测的AI算力调度方法,指导资源调度过程。相比于以往大多数研究工作仅围绕着图形处理器(GPU)资源设计的AI算力调度方法,本文充分考虑了多个维度资源对用户任务运行效率和计算集群资源利用的影响。本文基于机器学习方法构建任务资源需求预测模型,分析多维度资源对任务性能的影响,进而完成自适应资源伸缩调度,解决用户超额申请问题。实验结果表明,在相同时间内,该方法实现了更多任务的部署和执行。任务部署量提升25.3%,部署任务的完成率提升15.2%,GPU和内存利用率分别提升7.2%和8.0%,提升了算力资源的总体利用率。A scheduling method based on task resource demand prediction is proposed to improve the job execution and resource utilization of artificial intelligence(AI)computing power cluster.Existing schedulers are designed by op-timizing the graphics processing unit(GPU)resources allocation,which ignore the effect of multidimensional re-sources on AI task executing.In this work,the impact of multi-dimension resources on job execution and cluster re-source utilization is considered.First,the multi-dimensional resource requirements of jobs are modeled through ma-chine learning methods.Then,an adaptive resource scaling scheduling method is proposed,which reduce the over claim resource waste.It is found that compared with the basic strategy,this method makes more tasks allocated and executed in the same period.Evaluation results shows that the job deployment increases by 25.3%,the completion rate of deployed tasks increases by 15.2%.The GPU and memory utilization rates have been increased by 7.2%and 8.0%respectively,leading to an improvement in the overall utillization of computing resources.

关 键 词：资源调度 弹性资源分配 人工智能(AI) 算力 

分 类 号：TP18[自动化与计算机技术—控制理论与控制工程]