Actor-Critic-Based UAV-Assisted Data Collection in the Wireless Sensor Network  

作　　者：Huang Xiaoge Wang Lingzhi He Yong Chen Qianbin 

机构地区：[1]School of Communications and Information Engineering,Chongqing University of Posts and Telecommunications,Chongqing 400065,China

出　　处：《China Communications》2024年第4期163-177,共15页中国通信（英文版）

基　　金：supported by the National Natural Science Foundation of China(NSFC)(61831002,62001076);the General Program of Natural Science Foundation of Chongqing(No.CSTB2023NSCQ-MSX0726,No.cstc2020jcyjmsxmX0878).

摘　　要：Wireless Sensor Network(WSN)is widely utilized in large-scale distributed unmanned detection scenarios due to its low cost and flexible installation.However,WSN data collection encounters challenges in scenarios lacking communication infrastructure.Unmanned aerial vehicle(UAV)offers a novel solution for WSN data collection,leveraging their high mobility.In this paper,we present an efficient UAV-assisted data collection algorithm aimed at minimizing the overall power consumption of the WSN.Firstly,a two-layer UAV-assisted data collection model is introduced,including the ground and aerial layers.The ground layer senses the environmental data by the cluster members(CMs),and the CMs transmit the data to the cluster heads(CHs),which forward the collected data to the UAVs.The aerial network layer consists of multiple UAVs that collect,store,and forward data from the CHs to the data center for analysis.Secondly,an improved clustering algorithm based on K-Means++is proposed to optimize the number and locations of CHs.Moreover,an Actor-Critic based algorithm is introduced to optimize the UAV deployment and the association with CHs.Finally,simulation results verify the effectiveness of the proposed algorithms.

关 键 词：actor critic data collection deep reinforcement learning unmanned aerial vehicle wireless sensor network 

分 类 号：V279[航空宇航科学与技术—飞行器设计] TP212.9[自动化与计算机技术—检测技术与自动化装置] TN929.5[自动化与计算机技术—控制科学与工程]