改进Deep Q Networks的交通信号均衡调度算法  

Traffic Signal Equalization Scheduling Algorithm Based on Improved Deep Q Networks

作　　者：贺道坤[1] HE Daokun(Nanjing Vocational College of Information Technology,Jiangsu Nanjing 210023,China)

机构地区：[1]南京信息职业技术学院,江苏南京210023

出　　处：《机械设计与制造》2025年第4期135-140,共6页Machinery Design & Manufacture

基　　金：2019年江苏省高等教育教改研究立项课题(2019JSJG557)。

摘　　要：为进一步缓解城市道路高峰时段十字路口的交通拥堵现象,实现路口各道路车流均衡通过,基于改进Deep Q Networks提出了一种的交通信号均衡调度算法。提取十字路口与交通信号调度最相关的特征,分别建立单向十字路口交通信号模型和线性双向十字路口交通信号模型,并基于此构建交通信号调度优化模型;针对Deep Q Networks算法在交通信号调度问题应用中所存在的收敛性、过估计等不足,对Deep Q Networks进行竞争网络改进、双网络改进以及梯度更新策略改进,提出相适应的均衡调度算法。通过与经典Deep Q Networks仿真比对,验证论文算法对交通信号调度问题的适用性和优越性。基于城市道路数据,分别针对两种场景进行仿真计算,仿真结果表明该算法能够有效缩减十字路口车辆排队长度,均衡各路口车流通行量,缓解高峰出行方向的道路拥堵现象,有利于十字路口交通信号调度效益的提升。In order to further alleviate traffic congestion at urban road intersections during peak hours and realize the balanced passage of all road traffic flows at intersections,it proposes a traffic signal equalization scheduling algorithm based on improved Deep Q Networks.The most relevant characteristics of intersections and traffic signal scheduling are extracted,and traffic signal models of one-way intersections and linear two-way intersections are established respectively,based on which traffic signal scheduling optimization model is constructed.In view of the convergence and overestimation shortcomings of Deep Q Networks al⁃gorithm in traffic signal scheduling,this paper proposes an adaptive equalization scheduling algorithm based on competitive net⁃work improvement,dual network improvement and gradient update strategy improvement of Deep Q Networks.It verifies the ap⁃plicability and superiority of the proposed algorithm to traffic signal scheduling problem by comparing it with the classical Deep Q Networks simulation.Based on urban road data,it makes simulation calculations for two scenarios respectively.The simula⁃tion results show that this algorithm can effectively reduce the queue length of vehicles at intersections,balance the traffic flow vol⁃ume at each intersection,alleviate the road congestion in the direction of peak travel,and is conducive to the improvement of traf⁃fic signal scheduling efficiency at intersections.

关 键 词：交通信号调度 十字路口 Deep Q Networks 深度强化学习 智能交通 

分 类 号：TH16[机械工程—机械制造及自动化] V412.4[航空宇航科学与技术—航空宇航推进理论与工程] V448.2