Autonomous Overtaking for Intelligent Vehicles Considering Social Preference Based on Hierarchical Reinforcement Learning  

作　　者：Hongliang Lu Chao Lu Yang Yu Guangming Xiong Jianwei Gong 

机构地区：[1]Beijing Institute of Technology,Beijing,China

出　　处：《Automotive Innovation》2022年第2期195-208,共14页汽车创新工程（英文）

基　　金：The authors would like to appreciate the financial support of the National Natural Science Foundation of China(Grant No.61703041);the technological innovation program of Beijing Institute of Technology(2021CX11006).

摘　　要：As intelligent vehicles usually have complex overtaking process,a safe and efficient automated overtaking system(AOS)is vital to avoid accidents caused by wrong operation of drivers.Existing AOSs rarely consider longitudinal reactions of the overtaken vehicle(OV)during overtaking.This paper proposed a novel AOS based on hierarchical reinforcement learning,where the longitudinal reaction is given by a data-driven social preference estimation.This AOS incorporates two modules that can function in different overtaking phases.The first module based on semi-Markov decision process and motion primitives is built for motion planning and control.The second module based on Markov decision process is designed to enable vehicles to make proper decisions according to the social preference of OV.Based on realistic overtaking data,the proposed AOS and its modules are verified experimentally.The results of the tests show that the proposed AOS can realize safe and effective overtaking in scenes built by realistic data,and has the ability to flexibly adjust lateral driving behavior and lane changing position when the OVs have different social preferences.

关 键 词：Automated overtaking system Semi-Markov decision process Hierarchical reinforcement learning Social preference 

分 类 号：U46[机械工程—车辆工程]