低空单层无人机网络覆盖优化控制策略  

Optimization Control Strategy for Low-Altitude and Single-Layer Unmanned Aerial Vehicle Network Coverage

作　　者：郭洋 高原 程绍驰 王晓楠 GUO Yang;GAO Yuan;CHENG Shaochi;WANG Xiaonan(War Studies Institute,Academy of Military Science,Beijing 100091,China)

机构地区：[1]军事科学院战争研究院,北京100091

出　　处：《西南交通大学学报》2024年第4期890-897,共8页Journal of Southwest Jiaotong University

基　　金：国家自然科学基金(62222121,62341110)。

摘　　要：为研究应急通信场景中无人机网络自主控制问题,采用多架旋翼无人机搭载6G一体化基站,通过机间组网形成低空单层无人机网络,对地面任务区域内的用户提供无线网络服务;针对典型场景构建数值模型,利用多智能体强化学习方法求解无人机网络的优化控制策略,并分析无人机基站数量、无人机基站通信距离对于任务地域无线网络覆盖效果的影响.研究结果表明:利用强化学习方法得到的优化控制策略收敛效果较好;无人机网络覆盖得分和公平覆盖指数的学习曲线变化趋势相似,在第1000~2000个episode之间快速增长,随后进入平台区;在无人机基站通信覆盖距离1.0 km、飞行高度300 m条件下,将无人机基站数量从3个增加到7个,网络覆盖得分提高53.28%,公平覆盖指数提高43.57%;当无人机基站数5个、飞行高度300 m条件下,基站通信距离从1.0 km增加到2.5 km时,无人机网络覆盖得分提高86.01%,公平覆盖指数提高41.47%.In order to study the autonomous control problem of unmanned aerial vehicle(UAV)networks in emergency communication scenarios,multiple rotary-wing UAVs equipped with 6G base stations were used,and a low-altitude and single-layer UAV network was formed through the interconnection between UAVs,thus providing wireless network services to users in the ground task area.A numerical model was constructed for typical scenarios,and a multi-agent reinforcement learning method was used to solve the optimization control strategy of the UAV network.The effects of the number of UAV base stations and the communication distance of UAV base stations on the wireless network coverage in the task area were investigated.The research results indicate that the optimization control strategy obtained by using reinforcement learning methods can converge well.The learning curves of the UAV network coverage score and fairness coverage index have similar trends.The curves rapidly increase between the 1000th and 2000th episode and then change slowly.Under the conditions of a communication coverage distance of 1 km and a flight altitude of 300 m for UAV base stations,the UAV network coverage score increases by 53.28%,and the fairness coverage index increases by 43.57%when the number of UAV base stations increases from 3 to 7.Under the condition of five UAV base stations and a flight altitude of 300 m,the UAV network coverage score increases by 86.01%,and the fairness coverage index increases by 41.47%when the communication distance of the base stations increases from 1.0 km to 2.5 km.

关 键 词：无人机 无线网络 强化学习 通信覆盖 

分 类 号：TN929.5[电子电信—通信与信息系统] TP273[电子电信—信息与通信工程] V279[自动化与计算机技术—检测技术与自动化装置]