车联网中基于深度强化学习的计算卸载与资源分配算法  

Computational offloading and resource allocation algorithm based on deep reinforcement learning in Internet of Vehicles

作　　者：师亚莉 肖春艳 王宇 刘聪 张润东 SHI Yali;XIAO Chunyan;WANG Yu;LIU Cong;ZHANG Rundong(School of Electronic Engineering,Xi’an University of Posts and Telecommunications,Xi’an 710121,China;Xi’an IoT Ubiquitous Engineering and Innovation Consortium,Xi’an 710121,China)

机构地区：[1]西安邮电大学电子工程学院,陕西西安710121 [2]西安市物联网泛在工程创新联合体,陕西西安710121

出　　处：《西安邮电大学学报》2024年第4期30-38,共9页Journal of Xi’an University of Posts and Telecommunications

基　　金：陕西省重点研发计划项目(2022GY-055)。

摘　　要：针对车辆边缘计算(Vehicular Edge Computing,VEC)卸载与资源分配过程中由于边缘服务器资源受限导致的时延增大的问题,提出一种基于深度强化学习的计算卸载与资源分配(Compute Offload and Resource Allocation Based on Deep Q-Netwrk,CORADQN)算法。构建VEC网络架构,通过拆分计算密集型车载任务及利用空闲服务车辆的计算资源,将计算任务分别卸载至边缘服务器、空闲服务车辆和本地车辆进行处理,以降低VEC网络系统的总时延。将计算卸载与资源分配转化为多约束优化问题,并将平均奖励作为样本的优先级进行采样,从而提高样本的利用率,加快算法收敛速度。仿真结果表明,相较于完全本地(ALL-Local)算法、完全边缘(ALL-Edge)算法、联邦卸载(Federated Offloading Scheme,FOS)算法及深度Q学习(Deep Q-Network,DQN)算法,所提算法能够最小化VEC网络的系统时延。In order to solve the problems of limited resources and high latency of edge servers in the process of computation offloading and resource allocation of vehicular edge computing(VEC),a computation offloading and resource allocation algorithm based on deep reinforcement learning is proposed.The VEC network architecture is constructed to reduce the total latency of the VEC network system by splitting the computation-intensive on-board tasks and using the computing resources of the idle service vehicles,the computing tasks are offloaded to the edge servers,the idle service vehicles,and the local vehicles separately for processing.The computational offloading and resource allocation are transformed into multi-constraint optimization problems,and the average reward is sampled as the priority of the samples,so as to improve the utilization rate of the samples and accelerate the convergence speed of the algorithm.Simulation results show that compared with the ALL-Local algorithm,the ALL-Edge algorithm,the FOS algorithm,and the DQN algorithm,the proposed algorithm can minimize the system delay of the VEC network.

关 键 词：车联网 移动边缘计算 深度Q学习 计算卸载 网络时延 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]