一种基于多Agent强化学习的多星协同任务规划算法  

An Algorithm of Cooperative Multiple Satellites Mission Planning Based on Multi-agent Reinforcement Learning

作　　者：王冲[1] 景宁[1] 李军[1] 王钧[1] 陈浩[1] 

机构地区：[1]国防科技大学电子科学与工程学院,湖南长沙410073

出　　处：《国防科技大学学报》2011年第1期53-58,共6页Journal of National University of Defense Technology

基　　金：国家自然科学基金资助项目(60604035);国家863高技术资助项目(2007AA12020203)

摘　　要：在分析任务特点和卫星约束的基础上给出了多星协同任务规划问题的数学模型。引入约束惩罚算子和多星联合惩罚算子对卫星Agent原始的效用值增益函数进行改进,在此基础上提出了一种多卫星Agent强化学习算法以求解多星协同任务分配策略,设计了基于黑板结构的多星交互方式以降低学习交互过程中的通信代价。通过仿真实验及分析证明该方法能够有效解决多星协同任务规划问题。A multi-satellite cooperative planning problem model was given considering the characteristics of the task requests and satellite constraints.Then the original performance function of each satellite agent was modified by introducing both the constraint punishing operator and the multi-satellite joint punishing operator.Next,a multi-satellite reinforcement learning algorithm（MUSARLA） was proposed to derive the coordinated task allocation strategy.Furthermore,the interaction among multiple satellites was designed based on blackboard architecture to reduce the communication cost while learning.Finally,simulated experiments are carried out which verified the effectiveness of the proposed algorithm.

关 键 词：卫星任务规划 协同规划 多智能体强化学习 黑板结构 

分 类 号：TP391[自动化与计算机技术—计算机应用技术]