Navigation for UAV Pair-Supported Relaying in Unknown IoT Systems with Deep Reinforcement Learning  

作　　者：HUANG Fei LI Guangxia WANG Haichao TIAN Shiwei YANG Yang CHANG Jinghui 

机构地区：[1]The College of Communications Engineering,Army Engineering University of PL A,Nanjing 210007,China [2]The National Innovation Institute of Defense Technology,Chinese Academy of Military Sciences,Beijing 100071,China [3]The Satellite Communication Center,Beijing 102300,China

出　　处：《Chinese Journal of Electronics》2022年第3期416-429,共14页电子学报（英文版）

基　　金：supported by the National Natural Science Foundation of China(61931011,61901520,U20B2038,61871398);the Natural Science Foundation for Distinguished Young Scholars of Jiangsu Province(BK20190030)。

摘　　要：Unmanned aerial vehicles(UAVs) have recently been regarded as a promising technology in Internet of things(IoT). UAVs functioned as intermediate relay nodes are capable of establishing uninterrupted and high-quality communication links between remotely deployed IoT devices and the destination. Multiple UAVs are required to be deployed due to their limited onboard energy. We study a UAV pair-supported relaying in unknown IoT systems, which consists of transmitter and receiver. Our goal is that transmitter gathers the data from each device then transfers the information to receiver,and receiver finally transmits the information to the destination, while meeting the constraint that the amount of information received from each device reaches a certain threshold. This is an optimization problem with highly coupled variables, such as trajectories of transmitter and receiver. On account of no prior knowledge of the environment, a dueling double deep Q network(dueling DDQN) algorithm is proposed to solve the problem.Whether it is in the phase of transmitter’s receiving information or the phase of transmitter’s forwarding information to receiver, the effectiveness and superiority of the proposed algorithm is demonstrated by extensive simulationsin in comparison to some base schemes under different scenarios.

关 键 词：Unmanned aerial vehicles(UAVs) Internet of things(IoT) UAV pair RELAYING Dueling DDQN 

分 类 号：V279[航空宇航科学与技术—飞行器设计] TN929.5[电子电信—通信与信息系统] TP391.44[电子电信—信息与通信工程]