Systematic Development of a New Variational Autoencoder Model Based on Uncertain Data for Monitoring Nonlinear Processes

Abstract

Deep learning models have been applied to industrial process fault detection because of their ability to approximate the complex nonlinear behavior. They have been proven to outperform the shallow neural network models. However, there are no good guidelines on how to build these deep models. Therefore, a good deep model is often constructed through a trial-and-error exercise. It is not easy to interpret the model because of features that do not have any physical interpretation. In addition, latent variables (or features) in a deep model are not independent. This causes features to overlap with each other, resulting in challenges in evaluating distributions of features and designing suitable monitoring indices. Finally, typical deep learning models in process monitoring are used in a deterministic manner and do not automatically provide confidence levels for each decision. In this paper, a variational autoencoder is utilized to develop a framework for monitoring uncertain nonlinear processes. The learned latent variables are guaranteed to be independent (or orthogonal) of each other under a specific optimization objective with constraints. The proposed method provides the density estimates of latent variables and residuals instead of point estimates. The density functions are used to design appropriate indices for monitoring. A simulation example and an industrial paper machine example are presented to validate the effectiveness of the proposed method.

Deep Convolutional Variational Autoencoder as a 2D-Visualization Tool for Partial Discharge Source Classification in Hydrogenerators

“…In nonlinear processes monitoring, VAE have been recently used for high-dimensional process fault diagnosis. The most relevant characteristics of the process are extracted by the latent variable space by projecting the high-dimensional process data into a lower-dimensional space [8], [29], [31], [32], [34], [39]- [42].…”

Research on Performance Prediction of Technological Innovation Enterprises Based on Deep Learning

“…Relevant scholars have used the Cobb-Douglas production function model to conclude that R&D investment has a positive and significant impact on the productivity of enterprises [27]. Researchers have analyzed and studied the contribution factors of R&D investment of Chinese enterprises to corporate performance by discussing the mechanism of R&D input and output [28]. Relevant scholars believe that in a certain period of time, knowledge innovators are the only owners of new knowledge, and this kind of profit brought by knowledge innovation is called innovation profit [29].…”

Detecting Respiratory Pathologies Using Convolutional Neural Networks and Variational Autoencoders for Unbalancing Data

“…In 2019, variational autoencoders have been widely used to analyze different kind of signals and monitoring them [22,23]. In addition, in Zemouri et al [24], variational autoencoders have been used for train a model as a 2D visualization tool for partial discharge source classification.…”