Mechanisms for Spontaneous Symmetry Breaking in Developing Visual Cortex

Fumarola, Francesco; Hein, Bettina; Miller, Kenneth D.

doi:10.1103/physrevx.12.031024

Cited by 2 publications

(3 citation statements)

References 79 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The existence of a discontinuous phase transition indicates large free energy barrier, which may render the optimal synaptic weight matrix inaccessible to local Hebbian learning processes [12,29,30]. This issue waits to be further explored.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Energy--Information Trade-off Induces Continuous and Discontinuous Phase Transitions in Lateral Predictive Coding

Huang¹,

Zhou²,

Miao³

et al. 2023

Preprint

View full text Add to dashboard Cite

Lateral predictive coding is a recurrent neural network which creates energy-efficient internal representations by exploiting statistical regularity in external sensory inputs. Here we investigate the trade-off between energy minimization and information robustness in a linear model of lateral predictive coding. We observe phase transitions in the synaptic weight matrix at several critical trade-off temperatures, especially a continuous transition which breaks permutation symmetry and builds cyclic dominance, and a discontinuous transition with the associated sudden emergence of tight competition between excitatory and inhibitory interactions. Self-organized hierarchical structures also form in the network at low temperatures. Our results indicate the structural complexity of lateral predictive coding networks.

show abstract

Section: Discussionmentioning

confidence: 99%

“…Most studies on predictive coding have focused on the feedforward and feedback interactions, and have largely ignored lateral interactions within the same layer of neurons. But lateral (recurrent) interactions are abundant in biological neural networks and they play significant roles in perception and inference [9][10][11][12].…”

Section: Introductionmentioning

confidence: 99%

Energy--Information Trade-off Induces Continuous and Discontinuous Phase Transitions in Lateral Predictive Coding

Huang¹,

Zhou²,

Miao³

et al. 2023

Preprint

View full text Add to dashboard Cite

show abstract

“…Such orientation selectivity develops in baby animals before they first open their eyes and, therefore, before they have any visual experience. Francesco Fumarola at the RIKEN Center for Brain Science, Japan, and his colleagues have now devised a model that explains this surprising observation [1].…”

mentioning

confidence: 99%

Solving a Puzzle in Brain Development

Wilkinson¹

2022

Physics

View full text Add to dashboard Cite

Mechanisms for Spontaneous Symmetry Breaking in Developing Visual Cortex

Cited by 2 publications

References 79 publications

Energy--Information Trade-off Induces Continuous and Discontinuous Phase Transitions in Lateral Predictive Coding

Energy--Information Trade-off Induces Continuous and Discontinuous Phase Transitions in Lateral Predictive Coding

Solving a Puzzle in Brain Development

Contact Info

Product

Resources

About