基于Dueling DQN的临近空间飞行器再入轨迹规划  

Near Space Vehicle Reentry Trajectory Planning Based on Dueling DQN

作　　者：田若岑 刘益吉 肖涛 张顺家 陆远 TIAN Ruocen;LIU Yiji;XIAO Tao;ZHANG Shunjia;LU Yuan(Shanghai Electro-Mechanical Engineering Institute,Shanghai 201109,China;Shanghai Aerospace Electronic Technology Institute,Shanghai 201109,China)

机构地区：[1]上海机电工程研究所,上海201109 [2]上海航天电子技术研究所,上海201109

出　　处：《制导与引信》2024年第2期1-10,共10页Guidance & Fuze

摘　　要：针对临近空间飞行器再入段禁飞区规避制导问题,构建了临近空间飞行器再入过程横侧向制导的马尔可夫决策过程(Markov decision process,MDP)模型。基于竞争深度Q网络(dueling deep Q network,Dueling DQN),设计了横侧向制导律及满足射程需求与禁飞区规避需求的再入过程奖励函数。经仿真验证,该横侧向制导律能够通过改变倾侧角符号实现禁飞区规避,并导引飞行器到达目标区域,具备较高精度,验证了方法的有效性。Aiming at the problem of no-fly zone avoidance guidance in the reentry phase for near space vehicle,the Markov decision process(MDP)model of lateral guidance in the reentry process for near space vehicle was constructed.On the basis of dueling deep Q network(Dueling DQN),the lateral guidance law and the environmental reward feedback function to satisfy the range requirement and the no-fly zone avoidance requirement were designed.The simulation results show that the lateral guidance law can avoid the no-fly zone by changing the sign of roll angle,and guide the aircraft to the target area with high precision,which verifies the effectiveness of the method.

关 键 词：临近空间飞行器 再入轨迹规划 竞争深度Q网络 

分 类 号：V448.235[航空宇航科学与技术—飞行器设计]