Enhanced UAV Pursuit-Evasion Using Boids Modelling:A Synergistic Integration of Bird Swarm Intelligence and DRL  

作　　者：Weiqiang Jin Xingwu Tian Bohang Shi Biao Zhao Haibin Duan Hao Wu 

机构地区：[1]School of Information and Communications Engineering,Faculty of Electronic and Information Engineering,Xi’an Jiaotong University,Xi’an,710049,China [2]China Academy of Electronics and Information Technology,China Electronics Technology Group Corporation(CETC),Beijing,100041,China [3]Department ofAutomatic Control,School of Automation Science and Electrical Engineering,BeihangUniversity,Beijing,100191,China

出　　处：《Computers, Materials & Continua》2024年第9期3523-3553,共31页计算机、材料和连续体（英文）

摘　　要：TheUAV pursuit-evasion problem focuses on the efficient tracking and capture of evading targets using unmanned aerial vehicles(UAVs),which is pivotal in public safety applications,particularly in scenarios involving intrusion monitoring and interception.To address the challenges of data acquisition,real-world deployment,and the limited intelligence of existing algorithms in UAV pursuit-evasion tasks,we propose an innovative swarm intelligencebased UAV pursuit-evasion control framework,namely“Boids Model-based DRL Approach for Pursuit and Escape”(Boids-PE),which synergizes the strengths of swarm intelligence from bio-inspired algorithms and deep reinforcement learning(DRL).The Boids model,which simulates collective behavior through three fundamental rules,separation,alignment,and cohesion,is adopted in our work.By integrating Boids model with the Apollonian Circles algorithm,significant improvements are achieved in capturing UAVs against simple evasion strategies.To further enhance decision-making precision,we incorporate a DRL algorithm to facilitate more accurate strategic planning.We also leverage self-play training to continuously optimize the performance of pursuit UAVs.During experimental evaluation,we meticulously designed both one-on-one and multi-to-one pursuit-evasion scenarios,customizing the state space,action space,and reward function models for each scenario.Extensive simulations,supported by the PyBullet physics engine,validate the effectiveness of our proposed method.The overall results demonstrate that Boids-PE significantly enhance the efficiency and reliability of UAV pursuit-evasion tasks,providing a practical and robust solution for the real-world application of UAV pursuit-evasion missions.

关 键 词：UAV pursuit-evasion swarm intelligence algorithm Boids model deep reinforcement learning self-play training 

分 类 号：V279[航空宇航科学与技术—飞行器设计] TP3[自动化与计算机技术—计算机科学与技术]