Outlier Detection Method for Flash Flood Disaster Monitoring Data based on Information Entropy

Abstract

In the research of flash flood disaster monitoring and early warning, the Internet of Things is widely used in real-time information collection. There are abnormal situations such as noise, repetition and errors in a large amount of data collected by sensors, which will lead to false alarm, lower prediction accuracy and other problems. Aiming at the characteristic that outliers flow of sensors will cause obvious fluctuation of information entropy, this paper proposes a local outlier detection method based on information entropy and optimized by sliding window and LOF (Local Outlier Factor). This method can be used to improve the data quality, thus improving the accuracy of disaster prediction. The method is applied to data stream processing of water sensor, and the experimental results show that the method can accurately detect outliers. Compared with the existing detection methods that only use data distance to determine, the test positive rate is improved and the false positive rate is reduced.

The Early Identification of Flash Flood Disasters: Mechanism, Model and Uncertainty

“…Chen et al (2021) realized the raw data acquisition of sensors and various sources and carried out preprocessing such as storage, cleaning, https://doi.org/10.5194/hess-2024-69 Preprint. Discussion started: 8 April 2024 c Author(s) 2024.…”