Optimal Multi-impulse Linear Rendezvous via Reinforcement Learning  

作　　者：Longwei Xu Gang Zhang Shi Qiu Xibin Cao 

机构地区：[1]Research Center of Satellite Technology,Harbin Institute of Technology,Harbin 150001,PR China

出　　处：《Space(Science & Technology)》2023年第1期362-373,共12页空间科学与技术（英文）

基　　金：supported in part by the Key Research and Development Plan of Heilongjiang Province under Grant GZ20210120.

摘　　要：A reinforcement learning-based approach is proposed to design the multi-impulse rendezvous trajectories in linear relative motions.For the relative motion in elliptical orbits,the relative state propagation is obtained directly from the state transition matrix.This rendezvous problem is constructed as a Markov decision process that reflects the fuel consumption,the transfer time,the relative state,and the dynamical model.An actor-critic algorithm is used to train policy for generating rendezvous maneuvers.The results of the numerical optimization(e.g.,differential evolution)are adopted as the expert data set to accelerate the training process.By deploying a policy network,the multi-impulse rendezvous trajectories can be obtained on board.Moreover,the proposed approach is also applied to generate a feasible solution for many impulses(e.g.,20 impulses),which can be used as an initial value for further optimization.The numerical examples with random initial states show that the proposed method is much faster and has slightly worse performance indexes when compared with the evolutionary algorithm.

关 键 词：optimization process OPTIMAL 

分 类 号：O17[理学—数学]