An Advanced Multi-Agent Reinforcement Learning Framework of Bridge Maintenance Policy Formulation

Abstract

In its long service life, bridge structure will inevitably deteriorate due to coupling effects; thus, bridge maintenance has become a research hotspot. The existing algorithms are mostly based on linear programming and dynamic programming, which have low efficiency and high economic cost and cannot meet the actual needs of maintenance. In this paper, a multi-agent reinforcement learning framework was proposed to predict the deterioration process reasonably and achieve the optimal maintenance policy. Using the regression-based optimization method, the Markov transition matrix can better describe the uncertain transition process of bridge components in the maintenance year and the real-time updating of the matrix can be realized by monitoring and evaluating the performance deterioration of components. Aiming at bridges with a large number of components, the maintenance decision-making framework of multi-agent reinforcement learning can adjust the maintenance policy according to the updated Markov matrix in time, which can better adapt to the dynamic change of bridge performance in service life. Finally, the effectiveness of the framework was verified by taking the simulation data of a simply supported beam bridge and a cable-stayed bridge as examples.

Resilient multi-agent RL: introducing DQ-RTS for distributed environments with data loss

“…In recent years, a new sub-field of RL called Multi-Agent Reinforcement Learning (MARL) has found increasing interest in the literature 7 , 8 . In MARL, several agents interact with each other concurrently sharing the same environment.…”

Modification and implementation of bridge maintenance process in south Gujarat

“…In order to better respond to the dynamic change in bridge performance throughout the course of service life, this system may alter the maintenance strategy in response to the updated Markov matrix over time.(Q. N. Zhou et al, 2022). An innovative method for assessing bridge condition by visual inspection, intended for broad maintenance planning within a BMS framework.…”