Anomaly detection of organic pollution in drinking water based on fluorescence spectroscopy and stacked autoencoder

Shi, Jiegen; Cao, Yanjun; Yu, Jie; Hou, Dibo; Ren, Yongqin; Zhang, Guangxin

doi:10.1109/cac51589.2020.9327511

Cited by 2 publications

(2 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The characteristic spectrum of a substance can be used to qualitatively distinguish different samples. 1…”

Section: Introductionmentioning

confidence: 99%

“…The characteristic spectrum of a substance can be used to qualitatively distinguish different samples. 1 In 2022, Wu et al 2 from Tsinghua University collected a fluorescence fingerprint from the Shui-Mu Tsinghua (SMTH) body of water using a fluorescence spectrometer and determined the suspected pollution source through parallel factor analysis and the Tucker congruence coefficient. 2 The three-dimensional fluorescence spectroscopy instrument is large in volume and high in cost, which is not suitable for large-scale deployment and the equipment can only be installed at-line.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Dynamic Multivariate Outlier Detection Algorithm Using Ultraviolet Visible Spectroscopy for Monitoring Surface Water Contamination With Hydrological Fluctuation in Real-Time

Li,

Shao,

Cui

et al. 2023

Appl Spectrosc

View full text Add to dashboard Cite

The contamination of surface water is of great harm. Ultraviolet-visible (UV-Vis) spectroscopy is an effective method to detect water contamination. However, surface water quality is influenced by hydrological fluctuation caused by rain, change of flow, etc., leading to changes of spectral characteristics over time. In the process of contamination detection, such changes cause confusion between hydrological fluctuation spectra and contaminated water spectra, thus increasing the false alarm rate. Besides, missing alarms of contaminated water is a common problem when the signal-to-noise ratio is low. In this paper, a dynamic multivariable outlier sampling rate detection (DM-SRD) algorithm is proposed. A dynamic updating strategy is introduced to increase adaptability to hydrological fluctuation. Additionally, multiple outlier variables are adopted as outlying degree indicators, which increases the accuracy of contamination detection. Two experiments were carried out using spectra collected from real surface water sites and hydrological fluctuation was constructed. To verify the effectiveness of the DM-SRD method, a comparison with the static SRD method and spectral match method was conducted. The results show that the accuracy of the DM-SRD method is 97.8%. Compared with the other two detection methods, DM-SRD significantly reduces false alarm rate and avoids missing alarms. Additionally, the results demonstrate that whether the database contained prior information on hydrological fluctuation or not, DM-SRD maintained high detection accuracy, which indicates great adaptability and robustness.

show abstract

“…The characteristic spectrum of a substance can be used to qualitatively distinguish different samples. 1…”

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Dynamic Multivariate Outlier Detection Algorithm Using Ultraviolet Visible Spectroscopy for Monitoring Surface Water Contamination With Hydrological Fluctuation in Real-Time

Li,

Shao,

Cui

et al. 2023

Appl Spectrosc

View full text Add to dashboard Cite

show abstract

An Efficient Sensory Monitoring & Bacteria Detection System for Contaminated Water

S¹,

Sekar²,

Janani³

2023

2023 International Conference on Advances in Computing, Communication and Applied Informatics (ACCAI)

View full text Add to dashboard Cite

Anomaly detection of organic pollution in drinking water based on fluorescence spectroscopy and stacked autoencoder

Cited by 2 publications

References 12 publications

Dynamic Multivariate Outlier Detection Algorithm Using Ultraviolet Visible Spectroscopy for Monitoring Surface Water Contamination With Hydrological Fluctuation in Real-Time

Dynamic Multivariate Outlier Detection Algorithm Using Ultraviolet Visible Spectroscopy for Monitoring Surface Water Contamination With Hydrological Fluctuation in Real-Time

An Efficient Sensory Monitoring & Bacteria Detection System for Contaminated Water

Contact Info

Product

Resources

About