基于Q学习的单路口交通信号协调控制  

Single Intersection Traffic Signal Coordination Control Based on Q-learning

作　　者：胡宇 刘美玲 周子昂 张敏 HU Yu;LIU Mei-ling;ZHOU Zi-ang;ZHANG Min(College of Information and Computer Engineering, Northeast Forestry University, Harbin 150040, China)

机构地区：[1]东北林业大学信息与计算机工程学院,黑龙江哈尔滨150040

出　　处：《计算机与现代化》2020年第5期96-100,105,共6页Computer and Modernization

基　　金：国家自然科学基金资助项目(61702091);中央高校基本科研业务费专项基金资助项目(2572018BH06);国家级大学生创新创业训练计划项目(201910225191)。

摘　　要：Q学习通过与外部环境的交互来进行单路口的交通信号自适应控制。在城市交通愈加拥堵的时代背景下,为了缓解交通拥堵,提出一种结合SCOOT系统对绿信比优化方法的Q学习算法。本文将SCOOT系统中对绿信比优化的方法与Q学习相结合,即通过结合车均延误率以及停车次数等时间因素以及经济因素2方面,建立新的数学模型来作为本算法的成本函数并建立一种连续的奖惩函数,在此基础上详细介绍Q学习算法在单路口上的运行过程并且通过与Webster延误率和基于最小车均延误率的Q学习进行横向对比,验证了此算法优于定时控制以及基于车均延误的Q学习算法。相对于这2种算法,本文提出的算法更加适合单路口的绿信比优化。Q-learning uses the interaction with the external environment to carry out the traffic signal adaptive control of a single intersection.In the background of the increasingly congested urban traffic,in order to alleviate the traffic congestion,a Q-learning algorithm combined with the green signal ratio optimization method of SCOOT system is proposed.In this paper,the method of green signal ratio optimization in SCOOT system is combined with Q-learning,that is,a new mathematical model is established as the cost function of the algorithm by combining the time factors such as average vehicle delay rate,parking times and economic factors,and a continuous reward and punishment function is established.On this basis,the operation process of Q-learning algorithm on a single intersection is introduced in detail,and through the horizontal comparison with Webster delay rate and Q-learning based on the minimum average vehicle delay rate,it is verified that this algorithm is superior to the timing control and Q-learning algorithm based on average vehicle delay.Compared with these two algorithms,the algorithm proposed in this paper is more suitable for the single intersection green signal ratio optimization.

关 键 词：交通信号控制 Q学习 单路口 智能体 

分 类 号：U491.5[交通运输工程—交通运输规划与管理]