2009
DOI: 10.1162/neco.2008.03-08-727
|View full text |Cite
|
Sign up to set email alerts
|

Recurrent Infomax Generates Cell Assemblies, Neuronal Avalanches, and Simple Cell-Like Selectivity

Abstract: Recently multineuronal recording has allowed us to observe patterned firings, synchronization, oscillation, and global state transitions in the recurrent networks of central nervous systems. We propose a learning algorithm based on the process of information maximization in a recurrent network, which we call recurrent infomax (RI). RI maximizes information retention and thereby minimizes information loss through time in a network. We find that feeding in external inputs consisting of information obtained from … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

5
70
0

Year Published

2011
2011
2020
2020

Publication Types

Select...
8
2

Relationship

0
10

Authors

Journals

citations
Cited by 55 publications
(75 citation statements)
references
References 33 publications
5
70
0
Order By: Relevance
“…Analytical and numerical studies predict that critical systems have maximized dynamic range (Kinouchi and Copelli, 2006), information transmission (Beggs and Plenz, 2003; Tanaka et al, 2009), and entropy of events and states (Haldeman and Beggs, 2005; Ramo et al, 2007). By experimentally manipulating the balance of excitation and inhibition, neuronal avalanche dynamics has been shown to maximize the dynamic range (Shew et al, 2009), pattern variability (Stewart and Plenz, 2006), and information capacity and input-output mutual information (Shew et al, 2011), and to represent the most diverse state of intermittent phase locking between distant cortical sites (Yang et al, 2012).…”
Section: Discussionmentioning
confidence: 99%
“…Analytical and numerical studies predict that critical systems have maximized dynamic range (Kinouchi and Copelli, 2006), information transmission (Beggs and Plenz, 2003; Tanaka et al, 2009), and entropy of events and states (Haldeman and Beggs, 2005; Ramo et al, 2007). By experimentally manipulating the balance of excitation and inhibition, neuronal avalanche dynamics has been shown to maximize the dynamic range (Shew et al, 2009), pattern variability (Stewart and Plenz, 2006), and information capacity and input-output mutual information (Shew et al, 2011), and to represent the most diverse state of intermittent phase locking between distant cortical sites (Yang et al, 2012).…”
Section: Discussionmentioning
confidence: 99%
“…Importantly, avalanche size, s, distributes according to a power law, P(s) ϳ s ␣ with exponent ␣ close to Ϫ1.5, a hallmark of critical state dynamics (Plenz and Thiagarajan, 2007;Klaus et al, 2011). Both theoretical (Kinouchi and Copelli, 2006;Rämö et al, 2007;Tanaka et al, 2009) and empirical studies (Shew et al, 2009(Shew et al, , 2011 suggest that avalanches optimize various aspects of information processing in cortical networks.…”
Section: Higher-order Interactions Are Essential For Neuronal Avalancmentioning
confidence: 99%
“…Scale-free dynamics and other features predicted at criticality were previously shown to emerge during adaptation, but were not present during the intense transient response following stimulus onset [16]. Importantly, cortical slice experiments [20] and theory [2123] suggest that when a network operates near criticality, it is optimal for stimulus discrimination, although these studies did not address adaptation. Similarly, Fisher information is predicted to peak at criticality [24].…”
Section: Introductionmentioning
confidence: 99%