一种基于深度强化学习与概率性能感知的边缘计算环境多工作流卸载方法  

Multi-workflow Offloading Method Based on Deep Reinforcement Learning and Probabilistic Performance-aware in Edge Computing Environment

作　　者：马堉银 郑万波 马勇 刘航 夏云霓[1] 郭坤银[1] 陈鹏 刘诚武 MA Yu-yin;ZHENG Wan-bo;MA Yong;LIU Hang;XIA Yun-ni;GUO Kun-yin;CHEN Peng;LIU Cheng-wu(College of Computer Science,Chongqing University,Chongqing 400044,China;Faculty of Science,Kunming University of Science and Technology,Kunming 650500,China;School of Computer Information Engineering,Jiangxi Normal University,Nanchang 330022,China;School of Computer Science and Software Engineering,Xihua University,Chengdu 610039,China;Shanghai Jiaotong University Chongqing Research Institute,Chongqing 401135,China)

机构地区：[1]重庆大学计算机学院,重庆400044 [2]昆明理工大学理学院,昆明650500 [3]江西师范大学计算机信息工程学院,南昌330022 [4]西华大学计算机与软件工程学院,成都610039 [5]上海交通大学重庆研究院,重庆401135

出　　处：《计算机科学》2021年第1期40-48,共9页Computer Science

基　　金：重庆市研究生科研创新项目(CYS20066,CYB20062);重庆市科技局技术创新项目(cstc2019jscx-msxm0652,cstc2019jscx-fxyd0385);四川省科技计划项目(2020JDRC0067,2020YFG0326);西华大学人才引进项目(Z202047);重庆市科技局重点研发计划项目(cstc2018jszx-cyzdX0081);江西省重点研发计划(20181ACE50029)。

摘　　要：移动边缘计算是一种新兴的分布式和泛在计算模式,其将计算密集型和时延敏感型任务转移到附近的边缘服务器,有效缓解了移动终端资源不足的问题,显著减小了用户与计算处理节点之间的通信传输开销。然而,如果多个用户同时提出计算密集型任务请求,特别是流程化的工作流任务请求,边缘计算环境往往难以有效地进行响应,并会造成任务拥塞。另外,受任务负载、电力供给、通信能力的实时变化等不利因素的影响,边缘服务器本身的性能总是处于波动和变化中,从而为保证任务执行效能和用户感知服务效率带来了挑战。针对上述问题,文中提出了一种基于深度Q网络(DQN)与概率性能感知机制的边缘计算环境多工作流调度方法。首先对边缘云服务器的历史性能数据进行概率分析,然后利用获得的性能概率分布数据驱动DQN模型,不断迭代优化,生成多工作流的卸载策略。在实验验证环节,基于边缘服务器位置数据集、性能测试数据和多个科学工作流模板,在反映不同系统负载水平的多个场景下进行了模拟实验。实验结果表明,所提方法在多工作流执行效率方面明显优于传统方法。Mobile edge computing is a new distributed and ubiquitous computing model.By transferring computation-intensive and time-delay sensitive tasks to closer to the edge servers,it effectively alleviates the resource shortage of mobile terminals and the communication transmission overhead between users and computing processing nodes.However,if multiple users request computation-intensive tasks simultaneously,especially process-based workflow task requests,edge computing are often difficult to respond effectively and cause task congestion.Inaddition,the performance of edge servers is affected by detrimental factors such as task overload,power supply and real-time change of communication capability,and its performance fluctuates and changes,which brings challenges to ensure task execution and user-perceived service efficiency.To solve the above problems,a Deep-Q-Network(DQN)and probabilistic performance aware based multi-workflow scheduling approach in edge computing environment is proposed.Firstly,the historical performance data of edge cloud servers is analyzed probabilistically,then the DQN model is driven by performance probability distribution data,and iterative optimization is carried out continuously to generate multi-workflow offloading strategy.In the process of experimental verification,simulation experiments are conducted in multiple scenarios reflecting difterent levels of system load based on edge server Location data set,performance test data and multiple scientific workflow templates.The results show that the proposed method is superior to the traditional method in the execution efficiency of multi-workflow.

关 键 词：工作流调度 边缘计算 概率分布模型 强化学习 深度Q网络 

分 类 号：TP301[自动化与计算机技术—计算机系统结构]