基于深度强化学习的电力线与无线双模通信MAC层接入算法  

Adaptive MAC layer access algorithm for power line and wireless dualmode communication based on deep reinforcement learning

作　　者：陈智雄[1,2] 詹学滋 左嘉烁 CHEN Zhixiong;ZHAN Xuezi;ZUO Jiashuo(Department of Electronic and Communication Engineering,North China Electric Power University,Baoding 071003,China;Hebei Key Laboratory of Electric Power Internet of Things Technology,Baoding 071003,China)

机构地区：[1]华北电力大学电子与通信工程系,河北保定071003 [2]河北省电力物联网技术重点实验室,河北保定071003

出　　处：《智能系统学报》2025年第2期344-354,共11页CAAI Transactions on Intelligent Systems

基　　金：国家自然科学基金青年基金项目(61601182);中央高校科研业务费专项资金项目(2023MS113).

摘　　要：针对无线和电力线通信混合组网的信道竞争接入问题,提出了一种基于深度强化学习的电力线与无线双模通信的MAC接入算法。双模节点根据网络广播信息和信道使用等数据自适应接入双媒质信道。首先建立了基于双模通信网络交互和统计信息的双模通信节点数据采集模型;接着定义了基于协作信息的深度强化学习(deep reinforcement learning,DRL)状态空间、动作空间和奖励,设计了联合α-公平效用函数和P坚持接入机制的节点决策流程,实现基于双深度Q网络(double deep Q-network,DDQN)的双模节点自适应接入算法;最后进行算法性能仿真和对比分析。仿真结果表明,提出的接入算法能够在保证双模网络和信道接入公平性的条件下,有效提高双模通信节点的接入性能。Aiming to address the issue of channel competition in hybrid networks of PLC and WC,this study proposes a MAC access algorithm based on deep reinforcement learning for dual-mode communication over power lines and wireless channels.Dual-mode nodes adaptively access the dual-medium channel based on data such as network broadcast information and channel usage.First,a dual-mode node data collection model is established based on interactions and statistical information from dual-mode communication networks.Then,the DRL state space,action space,and rewards are defined based on collaborative information,and an adaptive access algorithm is developed using a dual deep Q-network.This algorithm incorporates a node decision-making process that combines theα-fairness utility function with the P-persistent access mechanism.Finally,simulations and comparative analyses of the algorithm’s performance are performed.Simulation results show that the proposed access algorithm effectively improves the access performance of dual-mode communication nodes while ensuring fairness in dual-mode network and channel access.

关 键 词：电力线通信 无线通信 双模节点 深度强化学习 双深度Q网络 MAC层接入 公平效用函数 P坚持接入 

分 类 号：TM721[电气工程—电力系统及自动化]