Robust Walking and Sim-to-Real Optimization for Quadruped Robots via Reinforcement Learning  

作　　者：Chao Ji Diyuan Liu Wei Gao Shiwu Zhang 

机构地区：[1]Department of Precision Machinery and Precision Instrumentation,School of Engineering Science,University of Science and Technology of China,Hefei,230026,China [2]iFLYTEK Co.,Ltd.,Hefei,230088,China

出　　处：《Journal of Bionic Engineering》2025年第1期107-117,共11页仿生工程学报(英文版)

摘　　要：Achieving robust walking for different stairs is one of the most challenging tasks for quadruped robots in real world.Traditional model-based methods heavily rely on environmental factors,are burdened by intricate modelling complexities,and lack generalizability.The potential for advancements in adaptive locomotion control,often impeded by complex modelling processes,can be substantially enhanced through the application of Reinforcement Learning(RL).In this paper,a learning-based method is proposed to directionally enhance the stair-climbing skill of quadruped robots under different stair conditions.First,the general policy model based on proprioceptive perception is trained as a pre-training model.Then,the pre-training model was initialized,and different terrain information from the stairs was introduced for customized training to enhance the stair-climbing skill without affecting the existing locomotion performance.Finally,the customized control policy is deployed to the real robot to realize motion control in real environments.The experimental results demonstrate that the customized control policy can significantly improve the motion performance of quadruped robots when facing complex stair terrains and has certain generalizability in other complex terrains.The proposed algorithm can be extended to various terrestrial environments.

关 键 词：Quadruped robot Learning-based Skill augmentation Customized control policy Sim-to-Real 

分 类 号：TP242[自动化与计算机技术—检测技术与自动化装置]