多无人机空战机动决策中的深度强化学习:实践中的关键技术综述与未来展望  

Deep Reinforcement Learning in Multi-UAV Air Combat Maneuver Decision-Making:A Review of Key Techniques in Practice and Future Prospects

作　　者：方思雨 张振华[2] 牛经龙 边疆 徐昌一 吴玉虎 Fang Siyu;Zhang Zhenhua;Niu Jinglong;Bian Jiang;Xu Changyi;Wu Yuhu(School of Control Science and Engineering,Dalian University of Technology,Dalian 116024,China;North Automatic Control Technology Institute,Taiyuan 030006,China)

机构地区：[1]大连理工大学控制科学与工程学院,辽宁大连116024 [2]北方自动控制技术研究所,太原030006

出　　处：《航空兵器》2025年第2期19-33,共15页Aero Weaponry

摘　　要：基于深度强化学习的多无人机空战机动决策技术是现代军事研究中的热点研究领域,通过结合深度学习处理高维复杂数据的优势和强化学习自主学习长期规划的优势,实现空战机动决策的智能行为涌现。旨在为涉足该研究领域的工作者提供可操作性的实践优化建议或基础性的入门引导,本文针对多无人机空战,从技术实践层面包含的深度强化学习算法改进、高效训练方法设计、多无人机作战环境构建的三个关键技术依次展开,介绍并归纳了现有的主流方法和创新技术成果。最后,探讨了未来的重点研究方向,总结出围绕无人机集群的多智能体协同作战、聚焦真实战场环境的空战场景评估与构建、依托多样决策方法的综合智能决策系统的发展趋势,对现代空战发展和空战制胜具有重要意义。The technology of deep reinforcement learning-based multi-UAV air combat maneuver decision-making is a hot research area in modern military studies.By combining the advantages of deep learning in handling high-dimensional complex data and the advantages of reinforcement learning in autonomous long-term planning,intelligent behaviors for air combat maneuver decision-making emerge.Aimed at providing practical optimization suggestions or basic entry-level guidance for researchers in this field,this paper focuses on the key technologies involved in multi-UAV air combat from a practical perspective,including improvements in deep reinforcement learning algorithms,the design of efficient training methods,and the construction of multi-UAV combat environments.The paper introduces and summarizes current mainstream methods and innovative technological achievements of them.Finally,it discusses future key research directions:centering on multi-agent collaborative combat for UAV swarms,focusing on the evaluation and construction of air combat scenarios in real battlefield environments,and developing comprehensive intelligent decision-making systems based on diverse decision-making methods.These developments are of significant importance for modern air combat advancements and achieving air combat superiority.

关 键 词：无人机 空战 机动决策 深度强化学习 多智能体协同 

分 类 号：TJ760[兵器科学与技术—武器系统与运用工程] V279[航空宇航科学与技术—飞行器设计]