Method for Data Quality Assessment of Synthetic Industrial Data

Abstract

Sometimes it is difficult, or even impossible, to acquire real data from sensors and machines that must be used in research. Such examples are the modern industrial platforms that frequently are reticent to share data. In such situations, the only option is to work with synthetic data obtained by simulation. Regarding simulated data, a limitation could consist in the fact that the data are not appropriate for research, based on poor quality or limited quantity. In such cases, the design of algorithms that are tested on that data does not give credible results. For avoiding such situations, we consider that mathematically grounded data-quality assessments should be designed according to the specific type of problem that must be solved. In this paper, we approach a multivariate type of prediction whose results finally can be used for binary classification. We propose the use of a mathematically grounded data-quality assessment, which includes, among other things, the analysis of predictive power of independent variables used for prediction. We present the assumptions that should be passed by the synthetic data. Different threshold values are established by a human assessor. In the case of research data, if all the assumptions pass, then we can consider that the data are appropriate for research and can be applied by even using other methods for solving the same type of problem. The applied method finally delivers a classification table on which can be applied any indicators of performed classification quality, such as sensitivity, specificity, accuracy, F1 score, area under curve (AUC), receiver operating characteristics (ROC), true skill statistics (TSS) and Kappa coefficient. These indicators’ values offer the possibility of comparison of the results obtained by applying the considered method with results of any other method applied for solving the same type of problem. For evaluation and validation purposes, we performed an experimental case study on a novel synthetic dataset provided by the well-known UCI data repository.

SOON: Social Network of Machines Solution for Predictive Maintenance of Electrical Drive in Industry 4.0

“…Each of the methods has advantages and disadvantages, based on this fact no unique method can be chosen in any situation. Methods must be chosen and designed based on considerations like the data specificity and data quantity [26]. Sometimes it is a good approach to make hybridizations of the methods.…”

Leakages in District Heating Networks—Model-Based Data Set Quality Assessment and Localization

“…In Iantovics’ paper [ 5 ], a method for data quality assessment of synthetic industrial data is presented. Synthetic data are necessary because sometimes it is difficult to obtain real data from sensors or machines and use them in another context.…”

“…The literature review has shown that there are some useful components in every presented publication, which are also taken up in this paper. From [ 5 , 6 , 7 ], the idea of an indicator to classify good and bad data is used. In this paper, a quality measure will be introduced to compare the different data sets.…”

“…For the events 5, 9, 11, and 13, the affected EA is ranked in the first place. Furthermore, the BCP algorithm ranked the affected EA for nine events (5,9,11,12,13,14,19,20,22) in the first three places. However, some events have a worse PC of only 35.7%, which indicates a worse place in the ranking.…”

Analyze of the socio-economic drivers of land use land cover changes in Western Ethiopia

“…dependent variable of driving forces for LULC dynamics Classi cation Tablea,b Statistics of the Model Goodness-of-t statistics showed that the study to determine whether the model adequately describes the data(Archer & Lemeshow, 2006).Omnibus Tests of Model Coe cients was used to test the model t(Data, 2022). The model is signi cant and the likelihood ratio chi-square test indicated that the full model is a signi cant improvement in t over a null model, x 2 (23.971), P < 0.001.…”