Using Onicescu's Informational Energy to Approximate Social Entropy

Rizescu, Dana; Avram, Vasile

doi:10.1016/j.sbspro.2013.12.715

“…167-169 as statistical applications). Onicescu's informational energy has been used in physics [21], information theory in electronic structure theory of atomic and molecular systems [22][23][24], machine learning [17,25], and complex systems [26], among others.…”

Section: Proofmentioning

confidence: 99%

Onicescu’s Informational Energy and Correlation Coefficient in Exponential Families

Nielsen

¹

2022

View full text Add to dashboard Cite

The informational energy of Onicescu is a positive quantity that measures the amount of uncertainty of a random variable. However, contrary to Shannon’s entropy, the informational energy is strictly convex and increases when randomness decreases. We report a closed-form formula for Onicescu’s informational energy and its associated correlation coefficient when the probability distributions belong to an exponential family. We show how to instantiate the generic formula for several common exponential families. Finally, we discuss the characterization of valid thermodynamic process trajectories on a statistical manifold by enforcing that the entropy and the informational energy shall vary in opposite directions.

show abstract

“…The applications of informational energy in social sciences and other systems can be found in [38][39][40]. Applications of informational energy in physics and chemistry are contained in [41][42][43], while applications to statistics and probability can be found in [44,45].…”

Section: Informational Energymentioning

confidence: 99%

Statistics and Machine Learning Experiments in English and Romanian Poetry

Calin¹

2020

Sci

View full text Add to dashboard Cite

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

show abstract

“…The applications of informational energy in social sciences and other systems can be found in [38][39][40]. Applications of informational energy in physics and chemistry are contained in [41][42][43], while applications to statistics and probability can be found in [44,45].…”

Section: Informational Energymentioning

confidence: 99%

Statistics and Machine Learning Experiments in English and Romanian Poetry

Calin¹

2020

Sci

View full text Add to dashboard Cite

This paper presents a quantitative approach to poetry, based on the use of several statistical measures (entropy, informational energy, N-gram, etc.) applied to a few characteristic English writings. We found that English language changes its entropy as time passes, and that entropy depends on the language used and on the author. In order to compare two similar texts, we were able to introduce a statistical method to asses the information entropy between two texts. We also introduced a method of computing the average information conveyed by a group of letters about the next letter in the text. We found a formula for computing the Shannon language entropy and we introduced the concept of N-gram informational energy of a poetry. We also constructed a neural network, which is able to generate Byron-type poetry and to analyze the information proximity to the genuine Byron poetry.

show abstract

Using Onicescu's Informational Energy to Approximate Social Entropy

Cited by 7 publications

References 6 publications

Onicescu’s Informational Energy and Correlation Coefficient in Exponential Families

Onicescu’s Informational Energy and Correlation Coefficient in Exponential Families

Statistics and Machine Learning Experiments in English and Romanian Poetry

Statistics and Machine Learning Experiments in English and Romanian Poetry

Contact Info

Product

Resources

About