Q-Learning-Based Target Selection for Bearings-Only Autonomous Navigation  

作　　者：XIONG Kai WEI Chunling 

机构地区：[1]Science and Technology on Space Intelligent Control Laboratory,Beijing Institute of Control Engineering,Beijing 100094,China

出　　处：《Journal of Systems Science & Complexity》2021年第4期1401-1425,共25页系统科学与复杂性学报（英文版）

基　　金：supported by the National Natural Science Foundation under Grant Nos.61573059,61525301,61690215。

摘　　要：This paper presents a Q-learning-based target selection algorithm for spacecraft autonomous navigation using bearing observations of known visible targets.For the considered navigation system,the position and velocity of the spacecraft are estimated using an extended Kalman filter(EKF)with the measurements of inter-satellite line-of-sight(LOS)vectors obtained via an onboard star camera.This paper focuses on the selection of the appropriate target at each observation period for the star camera adaptively,such that the performance of the EKF is enhanced.To derive an effective algorithm,a Q-function is designed to select a proper observation region,while a U-function is introduced to rank the targets in the selected region.Both the Q-function and the U-function are constructed based on the sequence of innovations obtained from the EKF.The efficiency of the Q-learning-based target selection algorithm is illustrated via numerical simulations,which show that the presented algorithm outperforms the traditional target selection strategy based on a Cramer-Rao bound(CRB)in the case that the prior knowledge about the target location is inaccurate.

关 键 词：Bearings-only autonomous navigation convergence analysis extended Kalman filtering Q-LEARNING target selection 

分 类 号：V448.2[航空宇航科学与技术—飞行器设计]