Internally generated sequences in learning and executing goal-directed behavior

Pezzulo, Giovanni; Meer, Matthijs A. A. van der; Lansink, Carien S.; Pennartz, Cyriel M. A.

doi:10.1016/j.tics.2014.06.011

Cited by 209 publications

(217 citation statements)

References 120 publications

(184 reference statements)

Supporting

Mentioning

196

Contrasting

Order By: Relevance

“…Appendix F touches on further extensions that consider not the path integral of expected free energy but the expected path integral of free energy and the distinction between naive and sophisticated schemes. This distinction may be particularly important for understanding planning and metacognition and their physiological correlates (Lisman & Redish, 2009;Penny et al, 2013;Pezzulo et al, 2014).…”

Section: Resultsmentioning

confidence: 99%

“…This functional anatomy rests on reciprocal message passing among expected policies (e.g., in the striatum) and expected precision (e.g., in the substantia nigra). Expectations about policies depend on expected outcomes and states of the world for example, in the prefrontal cortex (Mushiake, Saito, Sakamoto, Itoyama, & Tanji, 2006) and hippocampus (Pezzulo, van der Meer, Lansink, & Pennartz, 2014). Crucially, this scheme entails reciprocal interactions between the prefrontal cortex and basal ganglia (Botvinick & An, 2009), in particular, selection of expected motor outcomes by the basal ganglia (Mannella & Baldassarre, 2015).…”

Section: 7mentioning

confidence: 99%

See 1 more Smart Citation

Active Inference: A Process Theory

et al. 2017

Self Cite

View full text Add to dashboard Cite

This is the published version of the paper.This version of the publication may differ from the final published version. behavior prescribed by these dynamics has a degree of face validity, providing a formal explanation for reward seeking, context learning, and epistemic foraging. Technically, the fact that a gradient descent appears to be a valid description of neuronal activity means that variational free energy is a Lyapunov function for neuronal dynamics, which therefore conform to Hamilton's principle of least action. Permanent repository link

show abstract

Section: Resultsmentioning

confidence: 99%

Section: 7mentioning

confidence: 99%

Active Inference: A Process Theory

et al. 2017

Self Cite

View full text Add to dashboard Cite

show abstract

“…We thus correlated burst-LFP synchronization of neurons recorded at LFP recording sites that provided theta-phase or gamma-amplitude variations for theta-gamma correlations (SI Result S13). We found that burst synchronization to remote LFP gamma activity varied proportionally with the degree of theta-phase correlation with low-gamma amplitudes (35)(36)(37)(38)(39)(40)(41)(42)(43)(44)(45)(46)(47)(48)(49)(50), an effect that was limited to those LFP sites that showed significant theta-gamma correlations (Spearman rank correlation r = 0.2, P = 0.044; Table S2 and SI Result S13). To our knowledge, these findings provide the first quantitative evidence that recording sites with LFP theta phases that engage in longrange gamma correlations also host neurons whose burst firing events synchronize long-range to gamma activity.…”

Section: Theta-gamma Correlation and Its Relation To Synchronization Ofmentioning

confidence: 95%

“…This result links findings on interareal burst synchronization (12) with the current report of functionally relevant theta-gamma correlations and suggests that interareal thetagamma interactions of different LFPs may directly or indirectly relate to burst firing of neurons within the theta-frequencymodulated circuits. Intriguingly, firing of bursts or firing of sequences during brief periods of theta-nested gamma-band activity is strongly implicated in rodent hippocampus and striatum to carry unique information about internally maintained goals (e.g., the location of the most rewarded outcome) (44,45). Our results suggest that theta-nested gamma modulations may serve as a means to organize and integrate such covertly (internally) generated information to ensure the flexible control of attention during goal-directed behaviors.…”

Section: Theta-gamma Correlation As Means To Coordinate Attention Infmentioning

confidence: 99%

Theta–gamma coordination between anterior cingulate and prefrontal cortex indexes correct attention shifts

Voloh

Valiante

Everling

et al. 2015

Proc. Natl. Acad. Sci. U.S.A.

138

129

View full text Add to dashboard Cite

Anterior cingulate and lateral prefrontal cortex (ACC/PFC) are believed to coordinate activity to flexibly prioritize the processing of goal-relevant over irrelevant information. This between-area coordination may be realized by common low-frequency excitability changes synchronizing segregated high-frequency activations. We tested this coordination hypothesis by recording in macaque ACC/PFC during the covert utilization of attention cues. We found robust increases of 5-10 Hz (theta) to 35-55 Hz (gamma) phaseamplitude correlation between ACC and PFC during successful attention shifts but not before errors. Cortical sites providing theta phases (i) showed a prominent cue-induced phase reset, (ii) were more likely in ACC than PFC, and (iii) hosted neurons with burst firing events that synchronized to distant gamma activity. These findings suggest that interareal theta-gamma correlations could follow mechanistically from a cue-triggered reactivation of rule memory that synchronizes theta across ACC/PFC.T he anterior cingulate and prefrontal cortex (ACC/PFC) of primates are key structures that ensure the flexible deployment of attention during goal-directed behavior (1, 2). To achieve such flexible control, diverse streams of information need to be taken into account, which are encoded by neuronal populations in anatomically segregated subfields of the ACC/ PFC (3, 4). Information about the expected values of possible attentional targets are prominently encoded in medial prefrontal cortices and ACC, whereas the rules and task goals that structure goal-directed behavior are prominently encoded in the lateral PFC (5, 6). Flexible biasing of attention thus requires the integration of information across anatomically segregated cortical circuits. One candidate means to achieve such interareal integration is by synchronizing local processes in distant brain areas to a common process. A rich set of predominantly rodent studies have documented such interareal neuronal interactions in the form of a phase-amplitude (P-A) correlations between lowfrequency periodic excitability fluctuation and high-frequency gamma-band activity (7-9). It is, however, unknown whether there are reliable cross-frequency P-A interactions between those primate ACC/PFC nodes that underlie flexible attention shifts and, if so, whether P-A correlations are reliably linked to the actual successful deployment of attention (10, 11). We thus set out to test for and characterize P-A interactions during covert control processes by recording local field potential (LFP) activity in macaque ACC/PFC subfields during attentional stimulus selection. ResultsWe recorded LFP activity from 1,104 between-channel pairs of electrodes (344 individual LFP channels) within different subfields in ACC/PFC of two macaques engaged in an attention task (Fig. 1A). In the following, we report results pooled across monkeys and show that individual monkey results were consistent and qualitatively similar in SI Result S1. These recordings were from a dataset that was previously analy...

show abstract

“…A useful biological illustration of a dual mode of operation of brain mechanisms is the phenomenon of "internally generated sequences" in the hippocampus, and beyond [132]. In short, dynamical patterns of neuronal activations that code for behavioural trajectories (i.e., sequence of place cells) are observed in the rodent hippocampus both when animals are actively engaged in overt spatial navigation, and when they are disengaged from the sensorimotor loop, e.g., when they sleep or groom after consuming a food-the latter depending on an internally-generated, spontaneous mode of neuronal processing that generally does not require external sensory inputs.…”

Section: Model-based Approaches To Active Perception and Control: Conmentioning

confidence: 99%

Model-Based Approaches to Active Perception and Control

Pezzulo

Rigoli

Iodice

et al. 2017

Entropy

Self Cite

View full text Add to dashboard Cite

Abstract:There is an on-going debate in cognitive (neuro) science and philosophy between classical cognitive theory and embodied, embedded, extended, and enactive ("4-Es") views of cognition-a family of theories that emphasize the role of the body in cognition and the importance of brain-body-environment interaction over and above internal representation. This debate touches foundational issues, such as whether the brain internally represents the external environment, and "infers" or "computes" something. Here we focus on two (4-Es-based) criticisms to traditional cognitive theories-to the notions of passive perception and of serial information processing-and discuss alternative ways to address them, by appealing to frameworks that use, or do not use, notions of internal modelling and inference. Our analysis illustrates that: an explicitly inferential framework can capture some key aspects of embodied and enactive theories of cognition; some claims of computational and dynamical theories can be reconciled rather than seen as alternative explanations of cognitive phenomena; and some aspects of cognitive processing (e.g., detached cognitive operations, such as planning and imagination) that are sometimes puzzling to explain from enactive and non-representational perspectives can, instead, be captured nicely from the perspective that internal generative models and predictive processing mediate adaptive control loops.

show abstract

Internally generated sequences in learning and executing goal-directed behavior

Cited by 209 publications

References 120 publications

Active Inference: A Process Theory

Active Inference: A Process Theory

Theta–gamma coordination between anterior cingulate and prefrontal cortex indexes correct attention shifts

Model-Based Approaches to Active Perception and Control

Contact Info

Product

Resources

About