A Model Transfer Method among Spectrometers Based on Improved Deep Autoencoder for Concentration Determination of Heavy Metal Ions by UV-Vis Spectra

Abstract

Ultraviolet Visible (UV-Vis) spectroscopy detection technology has been widely used in quantitative analysis for its advantages of rapid and non-destructive determination. However, the difference of optical hardware severely restricts the development of spectral technology. Model transfer is one of the effective methods to establish models on different instruments. Due to the high dimension and nonlinearity of spectral data, the existing methods cannot effectively extract the hidden differences in spectra of different spectrometers. Thus, based on the necessity of spectral calibration model transfer between the traditional large spectrometer and the micro-spectrometer, a novel model transfer method based on improved deep autoencoder is proposed to realize spectral reconstruction between different spectrometers. Firstly, two autoencoders are used to train the spectral data of the master and slave instrument, respectively. Then, the hidden variable constraint is added to enhance the feature representation of the autoencoder, which makes the two hidden variables equal. Combined with a Bayesian optimization algorithm for the objective function, the transfer accuracy coefficient is proposed to characterize the model transfer performance. The experimental results show that after model transfer, the spectrum of the slave spectrometer is basically coincident with the master spectrometer and the wavelength shift is eliminated. Compared with the two commonly used direct standardization (DS) and piecewise direct standardization (PDS) algorithms, the average transfer accuracy coefficient of the proposed method is improved by 45.11% and 22.38%, respectively, when there are nonlinear differences between different spectrometers.

Sustainable Financial Fraud Detection Using Garra Rufa Fish Optimization Algorithm with Ensemble Deep Learning

“…An Autoencoder (AE) is a kind of unsupervised DL model that expresses the original information containing complicated features of higher dimension into an abstract form of data at a low dimension, via multilevel NN (MLNN) [25]. An AE is commonly utilized for data dimension reduction and modeling, automatic learning of the non-linear data features, and effective coding.…”

Análisis de imágenes metalográficas mediante el uso de OpenCV para la estimación del contenido de carbono en acero A36.

“…En particular, el análisis de imágenes metalográficas es una herramienta útil para caracterizar la microestructura de los materiales y determinar sus propiedades mecánicas y físicas. En la industria del acero, el porcentaje de carbono es un factor crítico que influye en las propiedades mecánicas del material; por lo tanto, es de gran importancia una determinación precisa del porcentaje de carbono en aceros (Zhu et al, 2023).…”