Machine learning methods for generating high dimensional discrete datasets

Abstract

The development of platforms and techniques for emerging Big Data and Machine Learning applications requires the availability of real‐life datasets. A possible solution is to synthesize datasets that reflect patterns of real ones using a two‐step approach: first, a real dataset X is analyzed to derive relevant patterns Z and, then, to use such patterns for reconstructing a new dataset X′ that preserves the main characteristics of X. This survey explores two possible approaches: (1) Constraint‐based generation and (2) probabilistic generative modeling. The former is devised using inverse mining (IFM) techniques, and consists of generating a dataset satisfying given support constraints on the itemsets of an input set, that are typically the frequent ones. By contrast, for the latter approach, recent developments in probabilistic generative modeling (PGM) are explored that model the generation as a sampling process from a parametric distribution, typically encoded as neural network. The two approaches are compared by providing an overview of their instantiations for the case of discrete data and discussing their pros and cons. This article is categorized under: Fundamental Concepts of Data and Knowledge > Big Data Mining Technologies > Machine Learning Algorithmic Development > Structure Discovery

Dezinformácie v ére digitálnej transformácie

“…Syntetický obsah sa vzťahuje na digitálne médiá vytvorené alebo upravené pomocou technológií AI, ako sú generatívne adversárne siete (GAN), ktoré napodobňujú reálny vizuálny alebo zvukový materiál s vysokou presvedčivosťou. Tieto technológie umožňujú vytváranie realistických obrázkov, videí, zvukov a textov, ktoré môžu byť nerozoznateľné od autentického obsahu vytvoreného ľuďmi alebo zachyteného prostredníctvom tradičných metód (Manco, Ritacco, Rullo, Saccá & Serra, 2022).…”

Enhancement of GUI Display Error Detection Using Improved Faster R-CNN and Multi-Scale Attention Mechanism

“…This can be done using techniques such as combinatorial testing and variational autoencoder [25]. Another approach is constraint-based generation, where a dataset is generated to satisfy given support constraints on itemsets [26]. Probabilistic generative modeling is another approach that models data generation as a sampling process from a parametric distribution, often encoded as a neural network [27].…”