Two ‘what’ pathways for action and object recognition

Wurm, Moritz F.; Caramazza, Alfonso

doi:10.1016/j.tics.2021.10.003

Cited by 75 publications

(82 citation statements)

References 126 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Specifically, while the lagged representations of pixelwise and optical flow magnitude were most strongly represented in visual areas, the lagged representations of body posture and optical flow direction similarly engaged nodes of the AON. This is most evident for relative body posture, arguably a high-level representation closely related to a conceptual representation, which was represented most strongly in LOTC, corroborating LOTC’s central role in action recognition 26,27 . The searchlight analysis (Fig.…”

Section: Resultssupporting

confidence: 57%

Predictive neural representations of naturalistic dynamic input

Vries

Wurm

2022

Preprint

Self Cite

View full text Add to dashboard Cite

Our capacity to interact with our dynamic world in a timely manner (e.g., catch a ball) suggests that our brain generates predictions of unfolding external dynamics. While theories assume such neural predictions, empirical evidence typically only captures a snapshot or indirect consequence of prediction, and uses simple static stimuli of which predictability is manipulated. However, the rich dynamics of predictive representations remain largely unexplored. We present a novel dynamic extension to representational similarity analysis (RSA) that uses temporally variable models to capture naturalistic dynamic stimuli, and demonstrate both lagged and predictive neural representations in source-reconstructed MEG data. Interestingly, the predictive representations show a hierarchical pattern, such that higher-level stimulus features are predicted earlier in time, while lower-level features are predicted closer in time to the actual sensory input. This promising new approach opens the door for addressing important outstanding questions on how our brain represents and predicts our dynamic world.

show abstract

Section: Resultssupporting

confidence: 57%

Predictive neural representations of naturalistic dynamic input

Vries

Wurm

2022

Preprint

Self Cite

View full text Add to dashboard Cite

show abstract

“…The joint participation of alEC and MTG in these processes supports the idea that the specialized role of alEC in temporal relational memory [38][39][40][41] is functionally related to the specialization of the semantic site that is eventually updated with similar learning; in this case, MTG to event and action concepts 25,26,77 , which have relational structure as a core property [27][28][29]33,78 . We thus suggest that alEC and MTG together form a potentially specialized system for building event knowledge from experience.…”

Section: Implications For Theories Of Neural Organization Of Episodic...mentioning

confidence: 66%

“…We focused on right-lateralized MTG following our prior work showing relational memory for novel visual events, learned one week prior, in this area 35 as well as the many findings connecting this anatomical region to semantic memory for actions, tools, and events 25,26 . For visual stimuli, MTG responses are often bilateral 20,96,97 and include signatures of generalization for action categories across actors 98,99 , effectors 100 or physical manners of execution 101,102 and of event memory 103 .…”

Section: Relationship To Prior Work On Mtgmentioning

confidence: 99%

Integration of event experiences to build relational knowledge in the human brain

Leshinskaya

Nguyen

Ranganath

2022

Preprint

View full text Add to dashboard Cite

We investigated how the human brain integrates experiences of specific events to build general knowledge about typical event structure. We examined an episodic area important for temporal relations, anterior-lateral entorhinal cortex (alEC), and a semantic area important for action concepts, middle temporal gyrus (MTG). Participants underwent fMRI while watching sequences of novel events and recalling their temporal relations over two sessions one week apart. Across different contexts, the roles of these events could either be consistent, or conflict; integrative representations should weaken in the conflicting condition. We found integrative representations that emerged quickly in alEC, and only subsequently in MTG, which showed a significant change across sessions. Thus, alEC is important in building integrative representations early in learning and may be a gateway to semantic knowledge in MTG. We suggest that both episodic and semantic systems participate in integrating new information when it is aligned with their content specializations.

show abstract

“…In the motor domain, neuroimaging studies previously reported contribution of the left IFG and left OTC to tool-use behaviors 4,5 . More generally these cortical areas are part of the dorsal stream coding for goal-directed movements of the upper limbs 28,29 and have been recently proposed to represent a gradient from abstract to more concrete motor representations 30 . The OTC would encode conceptual information of action that does not depend on the movement kinematics, the context or the object manipulated (e.g.…”

Section: Discussionmentioning

confidence: 99%

“…hammering is a back and forth movement regardless of the direction of object involved) 30,31 . Interestingly, the OTC appears to store an abstract representation of a movement well beyond action production or observation 13 .…”

Section: Discussionmentioning

confidence: 99%

The tool-use cortical network contributes to semantic neural representations

Thibault

Koun

Salemme

et al. 2022

Preprint

View full text Add to dashboard Cite

Tool use and language are two highly refined human abilities which may have co-evolved, thus resulting in neural commonalities. We recently provided evidence for shared neural resources between tool use and syntax. However, the debate is still open on whether semantics and phonology also recruit neurofunctional supplies common to tool use. Here we tested the hypothesis that activity within the tool-use network contributes to semantic and phonological neural representations. To this aim, we identified the tool-use network with fMRI while participants used pliers. The same participants underwent, a semantic and a phonological task to evidence the underlying networks. Through a series of representational similarity analyses we tested whether activity in tool-use clusters contributed to neural representations of semantic and phonological stimuli. The results revealed that semantic activity patterns within the left inferior frontal gyrus and left occipitotemporal cortex, activated by tool use, displayed significant similarity between nouns belonging to the same semantic category. Activity in tool-use related areas therefore contributes to semantics. By contrast, no significant relationship was observed for the activity patterns elicited by phonological stimuli. These findings suggest that semantics is grounded within the tool-use network, reinforcing the hypothesis of a functional link between semantics and tool use.

show abstract

Two ‘what’ pathways for action and object recognition

Cited by 75 publications

References 126 publications

Predictive neural representations of naturalistic dynamic input

Predictive neural representations of naturalistic dynamic input

Integration of event experiences to build relational knowledge in the human brain

The tool-use cortical network contributes to semantic neural representations

Contact Info

Product

Resources

About