Reinforcement Learning-Based Control of Signalized Intersections Having Platoons

Abstract

Smart transportation cities are based on intelligent systems and data sharing while human drivers generally have limited capabilities and imperfect observations in traffics. The perception of Connected and Autonomous Vehicle (CAV) utilizes data sharing through Vehicle-To-Vehicle (V2V) and Vehicle-To-Infrastructure (V2I) communications to improve driving behaviors and reduce traffic delays and fuel consumption. This paper proposes a Double Agent (DA) intelligent traffic signal module based on the Reinforcement Learning (RL) method where the first agent named as Velocity Agent (VA) aims to minimize the fuel consumption by controlling the speed of platoons and single CAVs crossing a signalized intersection, while the second agent named as Signal Agent (SA) proceeds to efficiently reduce traffic delays through signal sequencing and phasing. Several simulation studies are conducted for a signalized intersection with different traffic flows and the performance of a single-agent with only the VA, DA with both VA and SA, and Intelligent Driver Model (IDM) are compared. It is shown that the proposed DA solution improves the average delay by 47.3% and the fuel efficiency by 13.6% compared to the Intelligent Driver Model (IDM).

Vehicle Trajectory Control and Signal Timing Optimization of Isolated Intersection under V2X Environment

“…Two IMAs are adopted, Intelligent Intersection Control Algorithm (IICA) and Hybrid Autonomous Intersection Management (H-AIM), to improve the efciency of intersections through vehicle automation and connectivity. Berbar et al [14] proposed a dual agent (DA) intelligent trafc signal module control based on the reinforcement learning (RL) method. Te speed agent (VA) aimed to minimize fuel consumption by controlling the speed of the platoon and single CAVs crossing the signal intersection and efectively reduce trafc delay through signal sequencing and phases.…”