一种采用Dueling⁃DDQN算法的无线网络MAC协议  

A MAC Protocol for Wireless Networks Using Dueling⁃DDQN Algorithm

作　　者：杨华 耿烜[1] 孔宁 YANG Hua;GENG Xuan;KONG Ning(College of Information Engineering,Shanghai Maritime University,Shanghai 201306,China;Zhongge Intelligent Technology Co.,Ltd,Shanghai 201100,China)

机构地区：[1]上海海事大学信息工程学院,上海201306 [2]众格智能科技有限公司,上海201100

出　　处：《北京邮电大学学报》2023年第3期25-30,55,共7页Journal of Beijing University of Posts and Telecommunications

基　　金：上海市教委科研创新项目(2101070010E00121)。

摘　　要：为了在快速变化的无线通信网络中实现系统吞吐量最大化,提出了一种采用竞争架构深度双Q网络(dueling⁃DDQN)算法的媒体访问控制协议。该协议将竞争架构Q网络算法中的q值运算方法应用于深度双Q网络中的q值计算,结合了竞争架构Q网络和深度双Q网络的优点,既能够提高q值的计算准确率和收敛性能,又解决了过度估计的问题,提升了系统的整体性能和鲁棒性。仿真实验结果表明,在无线通信系统中,相较于传统深度Q网络媒体访问控制(MAC)协议,当所提协议与时分多址协议和ALOHA协议共存时,有效地减少了收敛时间且提高了系统的总吞吐量。A medium access control protocol using dueling⁃deep double Q⁃network(dueling⁃DDQN)algorithm is proposed to maximize the system throughput in the rapidly changing wireless communication networks.The proposed protocol applies the q value calculation method of the dueling deep Q⁃network to calculate the q value of the deep double Q⁃network,which combines the advantages of dueling deep Q⁃network and deep double Q⁃network.Thus,it cannot only increase the calculation accuracy of the q value and the convergence performance,but also solve the problem of overestimation,that improves the overall performance and robustness of the system.The simulation results demonstrate that the proposed protocol coexisting with time division multiple access protocol and ALOHA protocol in wireless communication systems,is effective to reduce the convergence time and increase the total system throughput when comparing to the traditional deep Q⁃network medium access control(MAC)protocol.

关 键 词：深度强化学习 竞争架构Q网络 深度双Q网络 媒体访问控制协议 吞吐量 

分 类 号：TN915.04[电子电信—通信与信息系统]