2019
DOI: 10.1103/physreve.100.032305
|View full text |Cite
|
Sign up to set email alerts
|

Quantifying high-order interdependencies via multivariate extensions of the mutual information

Abstract: This article introduces a model-agnostic approach to study statistical synergy, a form of emergence in which patterns at large scales are not traceable from lower scales. Our framework leverages various multivariate extensions of Shannon's mutual information, and introduces the O-information as a metric capable of characterising synergy-and redundancy-dominated systems. We develop key analytical properties of the O-information, and study how it relates to other metrics of highorder interactions from the statis… Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

1
153
0

Year Published

2020
2020
2023
2023

Publication Types

Select...
5
3

Relationship

2
6

Authors

Journals

citations
Cited by 127 publications
(174 citation statements)
references
References 50 publications
1
153
0
Order By: Relevance
“…Here we are describing in the connectome an organization that cannot be explained in terms of node-to-node relationships, similar to the description of interactions between more than a pair of nodes (high order interdependencies) using information theory tools [40,41].…”
Section: Discussionmentioning
confidence: 99%
“…Here we are describing in the connectome an organization that cannot be explained in terms of node-to-node relationships, similar to the description of interactions between more than a pair of nodes (high order interdependencies) using information theory tools [40,41].…”
Section: Discussionmentioning
confidence: 99%
“…Together, these results show that, once the receptor distribution is fixed, the network strength distribution is both necessary and sufficient to explain the entropic effects of 5HT2A-R activation. Of course, this is not to say that strength explains every aspect of 5HT2A-R action -other topological network features are known to mediate transitions of consciousness in other contexts, 24 and investigating which network properties explain high-order dynamical signatures 25 of psychedelics remains an exciting avenue of future work.…”
Section: The Specific Connectivity Strength Distribution Explains Relmentioning
confidence: 99%
“…However, it is known that some high-level subjective effects of psychedelics (such as complex imagery 7 and ego dissolution 28 ) are related to network, as opposed to single region, dynamics. Therefore, building a richer statistical description of the brain's dynamics using recent information-theoretic tools (such as multivariate extensions of mutual information 25 ) remains an exciting open problem.…”
Section: Current Limitations and Future Researchmentioning
confidence: 99%
“…More formally, we say that [21]: Definition: A system of random variables is redundancydominated if Ω( 1 , … , ) > 0 and synergy-dominated if Ω( 1 , … , ) < 0.…”
Section: Definitionmentioning
confidence: 99%
“…[20] and study the effects of aging on the high-order interactions in the human brain, with a special focus on interdependencies between four or more brain regions. To this end, we employ the recently proposed O-Information [21], which can be considered to be revision of the measure of neural complexity proposed by Tononi, Sporns and Edelman [22] under the light of Partial Information Decomposition [23]. In particular, the O-Information captures the balance between redundancies and synergies in arbitrary sets of variables, thus extending the properties of the interaction information of three variables to larger sets [24].…”
Section: Introductionmentioning
confidence: 99%