Multiagent Reinforcement Learning-Based Signal Planning for Resisting Congestion Attack in Green Transportation

Abstract

Inefficient signal control will not only exaggerate traffic congestion, but also increase the fuel consumption and exhaust emissions. Thus, signal planning is highly important in green transportation. As the Connected vehicle (CV) technology has transformed today's transportation systems by connecting vehicles and the transportation infrastructure through wireless communication, the CV-based signal control system has seen significant studies recently. Unfortunately, existing signal planning algorithms in use are developed for the signal-intersection, showing low traffic efficiency in the multi-intersection collaborative planning due to ignoring the traffic correlation among the neighboring intersections. In this work, we target the USDOT (U.S. Department of Transportation) sponsored CVbased traffic control system, and implement a multi-intersection traffic network. We model the multi-intersection collaborative signal planning problem as a multi-agent reinforcement learning problem, and present an actor-attention-critic algorithm to improve transportation efficiency and energy efficiency in green transportation, as well as resist congestion attack. Experiment results on the multi-intersection traffic network indicates that 1) compared to the baseline, our approach reduces the total delay by as high as 44.24%; 2) our method transports more vehicles passing the intersections meanwhile reduces the total CO 2 emissions by 2.40%; 3) under the congestion attack, our approach shows robustness and reduces the total delay by as high as 64.33%.

Mixed Integer Robust Programming Model for Multimodal Fresh Agricultural Products Terminal Distribution Network Design

“…In recent years, the transportation network of fresh agricultural products has undergone great evolution [2]. Low efficiency and high cost of distribution have always been problems in the logistics industry, especially in the terminal distribution process [3,4]. Studies have shown that the low efficiency and high cost of terminal distribution directly restrict the efficiency improvement of the entire distribution supply chain.…”