Structuring Knowledge with Cognitive Maps and Cognitive Graphs

Peer, Michael; Brunec, Iva K.; Newcombe, Nora S.; Epstein, Russell A.

doi:10.1016/j.tics.2020.10.004

Cited by 176 publications

(161 citation statements)

References 183 publications

Supporting

Mentioning

134

Contrasting

Unclassified

Order By: Relevance

“…Theories of medial-lateral organization can account for the presence of scene-preferring visually responsive regions in the medial ventral temporal cortex because scene-selective PPA occurs in peripherally-biased ventral temporal cortex and responds preferentially to larger objects like houses. However, theories of anterior-posterior organization do not explain how visual scene representations in PPA are transformed into allocentric spatial representations in the anterior medial temporal lobe 11,12,16,62 . The present results address this knowledge gap, suggesting that a distinct area might subserve this process: the place-memory responsive region is well-positioned to integrate visual information represented in PPA with the allocentric spatial representations thought to reside in the hippocampus and entorhinal cortex 11,62 .…”

Section: Discussionmentioning

confidence: 99%

“…However, theories of anterior-posterior organization do not explain how visual scene representations in PPA are transformed into allocentric spatial representations in the anterior medial temporal lobe 11,12,16,62 . The present results address this knowledge gap, suggesting that a distinct area might subserve this process: the place-memory responsive region is well-positioned to integrate visual information represented in PPA with the allocentric spatial representations thought to reside in the hippocampus and entorhinal cortex 11,62 . Thus, by introducing areas that may interface between the visual cortex and memory structures, the present work fills this important gap in our understanding of how the brain may implement visually guided behaviors.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

A network linking scene perception and spatial memory systems in posterior cerebral cortex

et al. 2021

View full text Add to dashboard Cite

The neural systems supporting scene-perception and spatial-memory systems of the human brain are well-described. But how do these neural systems interact? Here, using fine-grained individual-subject fMRI, we report three cortical areas of the human brain, each lying immediately anterior to a region of the scene perception network in posterior cerebral cortex, that selectively activate when recalling familiar real-world locations. Despite their close proximity to the scene-perception areas, network analyses show that these regions constitute a distinct functional network that interfaces with spatial memory systems during naturalistic scene understanding. These “place-memory areas” offer a new framework for understanding how the brain implements memory-guided visual behaviors, including navigation.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

A network linking scene perception and spatial memory systems in posterior cerebral cortex

et al. 2021

View full text Add to dashboard Cite

show abstract

“…The present results address this knowledge gap, suggesting that a distinct area might subserve this process: the place-memory responsive region is well-positioned to integrate visual information represented in PPA with the allocentric spatial representations thought to reside in hippocampus and entorhinal cortex 11,62 . Thus, by introducing areas that may interface between visual cortex and memory structures, the present work fills this important gap in our understanding of how the brain may implement visually guided behaviors.…”

Section: Topography Of Scene-perception and Place-memory Areasmentioning

confidence: 52%

“…Theories of medial-lateral organization can account for the presence of scene-preferring visually responsive regions in medial ventral temporal cortex, because scene-selective areas occur in peripherally-biased ventral temporal cortex and prefer large objects. However, theories of anterior-posterior organization do not explain how visual scene representations in PPA are transformed into allocentric spatial representations in anterior medial temporal lobe 11,12,16,62 .…”

Section: Topography Of Scene-perception and Place-memory Areasmentioning

confidence: 99%

A network linking scene perception and spatial memory systems in posterior cerebral cortex

Steel

Billings

Silson

et al. 2020

Preprint

View full text Add to dashboard Cite

word count: 75 Main text word count: 1,913ABSTRACT Here, we report a new link between the spatial-memory and scene-perception systems of the human brain. Using fine-grained individual-subject fMRI, we describe three cortical areas, each lying immediately anterior to a region of the scene perception network, that are selectively activated when recalling familiar places. Network analyses show that these regions constitute a distinct functional network and interface with memory systems during naturalistic scene understanding. These regions may bridge perception and memory, supporting visually-guided navigation. MAIN TEXTSuccessful navigation requires integrating the current field-of-view with memory of the larger spatial context. While the neural systems supporting visual scene processing in posterior cerebral cortex 1-7 and spatial memory in the hippocampus and medial temporal lobe 8-15 are welldescribed in humans, little is known about how visual and spatio-mnemonic systems interface in the brain. Two disparate lines of inquiry yield different hypotheses. On the one hand, explicit recall of visual scenes (i.e. mental imagery) is thought to reinstate the same activity as perception in visual regions of the brain, including areas of the scene-perception network (parahippocampal place area (PPA), occipital place area (OPA), and medial place area (MPA)) [16][17][18][19] . On the other hand, theories of scene processing have posited that memory-based representations are not colocalized with perceptual representations, but instead, that visual information transitions from perceptual to memory-based representations moving anteriorly from areas of the sceneperception network 1,20-23 . Distinguishing between these possibilities is critical to understanding the neural mechanisms underlying navigation. Do scene perception and place memory share common neural substrates in the human brain?To address these issues, we used individual-subject fMRI to map the topology of sceneperception and place-memory related activity in the human brain in fine-grained detail and assess whether these responses are co-localized at the individual subject level. First, we independently localized the three regions of the scene-perception network by comparing activation when participants viewed images of scenes, people, and objects (Methods). Next, in the same subjects, we localized areas that showed preferential BOLD-activation when participants (N=14) recalled personally familiar places (e.g. their house) and people (e.g. their mother).This analysis revealed a striking topological pattern. In all participants, we found three clusters of place-memory activity proximate to, but distinct from, the three areas of the scene-perception network, which we refer to as 'place-memory areas' for brevity ( Figure 1). Across the lateral, ventral and medial cortical surfaces, the pairs of place-memory and scene-perception areas

show abstract

“…Other studies have pointed out that the hippocampus may encode representations that are predictive of future locations, so called successor representations (SRs), that can be used for reinforcement learning (RL) (Stachenfeld et al, 2017), and that grid-like patterns in the entorhinal cortex and ventromedial PFC may represent coordinates of a non-spatial space (Constantinescu et al, 2016). Thus, today the cognitive map in the hippocampalentorhinal system is often thought to represent relationships of locations and events beyond physical space, from conceptual knowledge to social cognition (for reviews and perspectives, see Kaplan et al, 2017;Epstein et al, 2017;Schafer & Schiller, 2018;Behrens et al, 2018;Bellmund et al, 2018;Peer et al, 2020;Bottini & Doeller, 2020;Spiers, 2020). Map-like representations also exist beyond the MTL, most notably in the medial prefrontal and orbitofrontal cortex (OFC) (Wilson et al, 2014;Schuck et al, 2016;Constantinescu et al, 2016, for a review, see e.g., Schuck et al, 2018), suggesting that relational information derived from past events is also stored in neocortical brain areas.…”

mentioning

confidence: 99%

Replay in minds and machines

Wittkuhn¹,

Chien²,

Hall-McMaster³

2021

Preprint

View full text Add to dashboard Cite

Experience-related brain activity patterns have been found to reactivate during sleep, wakeful rest, and brief pauses from active behavior. In parallel, machine learning research has found that experience replay can lead to substantial performance improvements in artificial agents. Together, these lines of research have significantly expanded our understanding of the potential computational benefits replay may provide to biological and artificial agents alike. We provide an overview of findings in replay research from neuroscience and machine learning and summarize the computational benefits an agent can gain from replay that cannot be achieved through direct interactions with the world itself. These benefits include faster learning and data efficiency, less forgetting, prioritizing important experiences, as well as improved planning and generalization. In addition to the benefits of replay for improving an agent's decision-making policy, we highlight the less-well studied aspect of replay in representation learning, wherein replay could provide a mechanism to learn the structure and relevant aspects of the environment. Thus, replay might help the agent to build task-appropriate state representations.

show abstract

Structuring Knowledge with Cognitive Maps and Cognitive Graphs

Cited by 176 publications

References 183 publications

A network linking scene perception and spatial memory systems in posterior cerebral cortex

A network linking scene perception and spatial memory systems in posterior cerebral cortex

A network linking scene perception and spatial memory systems in posterior cerebral cortex

Replay in minds and machines

Contact Info

Product

Resources

About