Container cluster placement in edge computing based on reinforcement learning incorporating graph convolutional networks scheme  

作　　者：Zhuo Chen Bowen Zhu Chuan Zhou 

机构地区：[1]College of Computer Science and Engineering,Chongqing University of Technology,Chongqing,400054,China

出　　处：《Digital Communications and Networks》2025年第1期60-70,共11页数字通信与网络(英文版)

摘　　要：Container-based virtualization technology has been more widely used in edge computing environments recently due to its advantages of lighter resource occupation, faster startup capability, and better resource utilization efficiency. To meet the diverse needs of tasks, it usually needs to instantiate multiple network functions in the form of containers interconnect various generated containers to build a Container Cluster(CC). Then CCs will be deployed on edge service nodes with relatively limited resources. However, the increasingly complex and timevarying nature of tasks brings great challenges to optimal placement of CC. This paper regards the charges for various resources occupied by providing services as revenue, the service efficiency and energy consumption as cost, thus formulates a Mixed Integer Programming(MIP) model to describe the optimal placement of CC on edge service nodes. Furthermore, an Actor-Critic based Deep Reinforcement Learning(DRL) incorporating Graph Convolutional Networks(GCN) framework named as RL-GCN is proposed to solve the optimization problem. The framework obtains an optimal placement strategy through self-learning according to the requirements and objectives of the placement of CC. Particularly, through the introduction of GCN, the features of the association relationship between multiple containers in CCs can be effectively extracted to improve the quality of placement.The experiment results show that under different scales of service nodes and task requests, the proposed method can obtain the improved system performance in terms of placement error ratio, time efficiency of solution output and cumulative system revenue compared with other representative baseline methods.

关 键 词：Edge computing Network virtualization Container cluster Deep reinforcement learning Graph convolutional network 

分 类 号：TN9[电子电信—信息与通信工程]