A probabilistic deep reinforcement learning approach for optimal monitoring of a building adjacent to deep excavation

Abstract

During a deep excavation project, monitoring the structural health of the adjacent buildings is crucial to ensure safety. Therefore, this study proposes a novel probabilistic deep reinforcement learning (PDRL) framework to optimize the monitoring plan to minimize the cost and excavation‐induced risk. First, a Bayesian‐bi‐directional general regression neural network is built as a probabilistic model to describe the relationship between the ground settlement of the foundation pit and the safety state of the adjacent building, along with the actions in a dynamic manner. Subsequently, a double deep Q‐network method, which can capture the realistic features of the excavation management problem, is trained to form a closed decision loop for continuous learning of monitoring strategies. Finally, the proposed PDRL approach is applied to a real‐world deep excavation case in No. 14 Shanghai Metro. This approach can estimate the time‐variant probability of damage occurrence and maintenance actions and update the state of the adjacent building. According to the strategy proposed via PDRL, monitoring of the adjacent buildings begins in the middle stage rather than on the first day of the excavation project if there is full confidence in the quality of the monitoring data. When the uncertainty level of data rises, the starting day might shift to an earlier date. It is worth noting that the proposed PDRL method is adequately robust to address the uncertainties embedded in the environment and model, thus contributing to optimizing the monitoring plan for achieving cost‐effectiveness and risk mitigation.

Unmanned aerial vehicle–human collaboration route planning for intelligent infrastructure inspection

“…Machine learning and neural networks have been confirmed as suitable tools for solving complex optimization problems within the field of civil engineering (Adeli, 2001; Pan, Qin, et al, 2023; Pan, Qin, et al, 2024; Zhou, Pan, et al, 2024). Classical routing problems, which fall under the umbrella of optimization problems, have also benefited from intelligent algorithms (Akhand et al., 2020).…”

Deep reinforcement learning‐based active mass driver decoupled control framework considering control–structure interaction effects

“…Eshkevari et al (2023) suggested a DRL-based data-driven approach for active structural control frameworks to obtain optimal control force. Pan et al (2023) developed a probabilistic DRL approach for optimal monitoring of a building adjacent to deep excavation. Long and Büyüköztürk (2020) proposed a novel reinforcement learning agent to act as a centralized power manager in the energy harvesting sensor network.…”

“…Pan et al. (2023) developed a probabilistic DRL approach for optimal monitoring of a building adjacent to deep excavation. Long and Büyüköztürk (2020) proposed a novel reinforcement learning agent to act as a centralized power manager in the energy harvesting sensor network.…”