Performance Prediction Based Workload Scheduling in Co-Located Cluster  

作　　者：Dongyang Ou Yongjian Ren Congfeng Jiang 

机构地区：[1]School of Computer Science and Technology,Hangzhou Dianzi University,Hangzhou,310018,China

出　　处：《Computer Modeling in Engineering & Sciences》2024年第5期2043-2067,共25页工程与科学中的计算机建模（英文）

基　　金：supported by the NationalNatural Science Foundation of China(No.61972118);the Key R&D Program of Zhejiang Province(No.2023C01028).

摘　　要：Cloud service providers generally co-locate online services and batch jobs onto the same computer cluster,where the resources can be pooled in order to maximize data center resource utilization.Due to resource competition between batch jobs and online services,co-location frequently impairs the performance of online services.This study presents a quality of service(QoS)prediction-based schedulingmodel(QPSM)for co-locatedworkloads.The performance prediction of QPSM consists of two parts:the prediction of an online service’s QoS anomaly based on XGBoost and the prediction of the completion time of an offline batch job based on randomforest.On-line service QoS anomaly prediction is used to evaluate the influence of batch jobmix on on-line service performance,and batch job completion time prediction is utilized to reduce the total waiting time of batch jobs.When the same number of batch jobs are scheduled in experiments using typical test sets such as CloudSuite,the scheduling time required by QPSM is reduced by about 6 h on average compared with the first-come,first-served strategy and by about 11 h compared with the random scheduling strategy.Compared with the non-co-located situation,QPSM can improve CPU resource utilization by 12.15% and memory resource utilization by 5.7% on average.Experiments show that the QPSM scheduling strategy proposed in this study can effectively guarantee the quality of online services and further improve cluster resource utilization.

关 键 词：Co-located cluster workload scheduling online service batch jobs data center 

分 类 号：TP39[自动化与计算机技术—计算机应用技术]