基于强化学习的无人机吊挂负载系统轨迹规划  

Trajectory planning for unmanned aerial vehicle slung-payload aerial transportation system based on reinforcement learning

作　　者：鲜斌 张诗婧 韩晓薇 蔡佳明 王岭[2] XIAN Bin;ZHANG Shi-jing;HAN Xiao-wei;CAI Jia-ming;WANG Ling(School of Electrical and Information Engineering,Tianjin University,Tianjin 300072,China;Tianjin Navigation Instrument Research Institute,Tianjin 300131,China)

机构地区：[1]天津大学电气自动化与信息工程学院,天津300072 [2]天津航海仪器研究所,天津300131

出　　处：《吉林大学学报（工学版）》2021年第6期2259-2267,共9页Journal of Jilin University:Engineering and Technology Edition

基　　金：国家重点研发计划项目(2018YFB1403900);国家自然科学基金项目(91748121,90916004)。

摘　　要：针对四旋翼无人机吊挂负载系统准确位置控制问题和吊挂负载的摆动抑制问题,提出了一种基于强化学习的在线轨迹规划方案。为补偿飞行过程中未知外界扰动的影响,本文首先将无人机的期望轨迹设计分为位置定位轨迹规划设计和抗扰动轨迹规划设计。其中,位置定位轨迹规划部分可预先设计,以引导无人机飞抵目标位置。抗扰动轨迹规划部分采用基于强化学习的在线更新策略,对外界未知扰动进行补偿,以达到抑制飞行过程中吊挂负载摆动的目的。然后,采用基于Lyapunov稳定性的分析方法,证明了闭环系统的稳定性,并证明了无人机位置跟踪误差和吊挂负载摆动运动的收敛。最后,通过飞行对比实验,验证了所提轨迹规划方法的有效性以及对外界干扰和负载质量变化的鲁棒性。This paper presents an on-line trajectory planning method based on the reinforcement learning for driving the quadrotor to its destination accurately and suppressing the swing motion of the slung-payload effectively. To deal with the unknown external disturbances, the desired trajectory of the Unmanned Aerial Vehicle(UAV) is divided into two parts: the positioning trajectory planning and the disturbance rejection trajectory planning. The positioning trajectory planning can be designed in advance to guide the UAV to reach the desired position, and the disturbance rejection trajectory planning can compensate the unknown external disturbances based on the reinforcement learning strategy and suppress the swing motion of the slung-payload simultenously. The Lyapunov based stability analysis is employed to prove the stability of the closed-loop system, the convergence of the UAV’s position and the swing motion of the slung-payload.Finally, real-time comparing experiments are performed to verify the effectiveness of the proposed trajectory generation method and its robustness to external disturbances and variation of the mass of the slung-payload.

关 键 词：自动控制技术 四旋翼无人机 吊挂负载 强化学习 轨迹规划 

分 类 号：TP273[自动化与计算机技术—检测技术与自动化装置]