Multifractal Characterization and Modeling of Blood Pressure Signals

Santis, Enrico De; Naraei, Parisa; Martino, Alessio; Sadeghian, Alireza; Rizzi, Antonello

doi:10.3390/a15080259

Cited by 1 publication

(1 citation statement)

References 65 publications

(82 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The first one is the Zipf's exponent underlying the Zipf's law on word base [21], [22]. The second one consists of a set of indices estimated through the Multifractal Detrended Fluctuation Analysis (MFDFA) framework [23] allowing to deeply characterize long-range correlations [24] and, in general, to investigate the richness of the correlation structure underlying a given time series [25], [26]. The third set of indices is obtained by means of the Recurrence Quantification Analysis (RQA) [27], a consolidated methodology in the analysis of complex systems that allows characterizing the recurrence structure of a time series in a simple and direct way.…”

Section: Introductionmentioning

confidence: 99%

Human Versus Machine Intelligence: Assessing Natural Language Generation Models Through Complex Systems Theory

De Santis,

Martino,

Rizzi

2024

IEEE Trans. Pattern Anal. Mach. Intell.

Self Cite

View full text Add to dashboard Cite

The introduction of Transformer architectures -with the self-attention mechanism -in automatic Natural Language Generation (NLG) is a breakthrough in solving general task-oriented problems, such as the simple production of long text excerpts that resemble ones written by humans. While the performance of GPT-X architectures is there for all to see, many efforts are underway to penetrate the secrets of these black-boxes in terms of intelligent information processing whose output statistical distributions resemble that of natural language. In this work, through the complexity science framework, a comparative study of the stochastic processes underlying the texts produced by the English version of GPT-2 with respect to texts produced by human beings, notably novels in English and programming codes, is offered. The investigation, of a methodological nature, consists first of all of an analysis phase in which the Multifractal Detrended Fluctuation Analysis and the Recurrence Quantification Analysis (RQA) -together with Zipf's law and approximate entropy -are adopted to characterize long-term correlations, regularities and recurrences in human and machine-produced texts. Results show several peculiarities and trends in terms of long-range correlations and recurrences in the last case. The synthesis phase, on the other hand, uses the complexity measures to build synthetic text descriptors -hence a suitable text embedding -which serve to constitute the features for feeding a machine learning system designed to operate feature selection through an evolutionary technique. Using multivariate analysis it is then shown the grouping tendency of the three analyzed text types, allowing to place GTP-2 texts in between natural language texts and computer codes. Similarly, the classification task demonstrates that, given the high accuracy obtained in the automatic discrimination of text classes, the proposed set of complexity measures is highly informative. These interesting results allow us to add another piece to the theoretical understanding of the surprising results obtained by NLG systems based on deep learning and let us to improve the design of new informetrics or text mining systems for text classification, fake news detection, or even plagiarism detection.

show abstract