A Machine Learning-Based Energy Management Agent for Fine Dust Concentration Control in Railway Stations

Abstract

This study developed a reinforcement learning-based energy management agent that controls the fine dust concentration by controlling facilities such as blowers and air conditioners to efficiently manage the fine dust concentration in the station. To this end, we formulated an optimization problem based on the Markov decision-making process and developed a model for predicting the concentration of fine dust in the station by training an artificial neural network (ANN) based on supervised learning to develop the transfer function. In addition to the prediction model, the optimal policy for controlling the blower and air conditioner according to the current state was obtained based on the ANN to which the Deep Q-Network (DQN) algorithm was applied. In the case study, it is confirmed that the ANN and DQN of the predictive model were trained based on the actual data of Nam-Gwangju Station to converge to the optimal policy. The comparison between the proposed method and conventional method shows that the proposed method can use less power consumption but achieved better performance on reducing fine dust concentration than the conventional method. In addition, by increasing the value of the ratio that represents the compensation due to the fine dust reduction, the learned agent achieved more reduction on the fine dust concentration by increasing the power consumption of the blower and air conditioner.

Modeling of Artificial Intelligence-Based Automated Climate Control with Energy Consumption Using Optimal Ensemble Learning on a Pixel Non-Uniformity Metro System

“…Cheng et al [21] proposed "Artificial Intelligence (AI)-Assisted Control of Heating, Ventilation, and Air Conditioning (HVAC)". Only 3 of the 18 AI-based solutions developed for HVAC management over the last two decades have received considerable traction: weather forecasting, optimization, and predictive controls.…”

Analysis and Prediction of the Meteorological Characteristics of Dust Concentrations in Open-Pit Mines

“…Coal is supporting the rapid economic development of China, but coal mining and utilization processes also cause a series of environmental problems [1][2][3], such as greenhouse effects, climate change and dust pollution [4][5][6]. Strong disturbances from mining activities of large open-pit coal mines inevitably lead to the degradation of the fragile ecological environments of mining areas, and dust pollution has always been an associated problem of coal open-pit mining [7][8][9].…”