Integrative and distinctive coding of perceptual and conceptual object features in the ventral visual stream

Martin, Chris B.; Douglas, Danielle; Newsome, Rachel N.; Man, Louisa Ly; Barense, Morgan D.

doi:10.1101/186924

Cited by 5 publications

(7 citation statements)

References 85 publications

(11 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…6) strikingly similar to the one observed in response to images of similar categories in vision. In contrast to previous studies that have used linguistic stimuli to investigate the pre-existing representation of categories in VOTC (Borghesani et al, 2016;Martin, Douglas, Newsome, Man, & Barense, 2017;Peelen et al, 2013;Peelen & Downing, 2017;Striem-Amit, Wang, Bi, & Caramazza, 2018;Wang et al, 2015), we employed sensory-related non-linguistic stimuli (sounds), in order to investigate both the sensory (acoustic) and categorical nature of the representation implemented in VOTC. To the limit of our knowledge, only one recent study investigated the macroscopic functional organization of VOTC during categorical processing of auditory and visual stimuli in sighted and in blind individuals (Hurk et al, 2017).…”

Section: Discussionmentioning

confidence: 99%

Categorical representation from sound and sight in the ventral occipito-temporal cortex of sighted and blind

Mattioni

Rezk

Battal

et al. 2019

Preprint

View full text Add to dashboard Cite

and Olivier Collignon (olivier.collignon@uclouvain.be). AbstractThe Ventral Occipito-Temporal Cortex (VOTC) shows reliable category selective response to visual information. Do the development, topography and information content of this categorical organization depend on visual input or even visual experience? To further address this question, we used fMRI to characterize the brain responses to eight categories (4 living, 4 non-living) presented acoustically in sighted and early blind individuals, and visually in a separate sighted group. Using a combination of decoding and representational similarity analyses, we observed that VOTC reliably encodes sounds categories in the sighted and blind groups, using a representational structure strikingly similar to the one found in vision. Moreover, we found that the representational connectivity between VOTC and large-scale brain networks was substantially similar across modalities and groups. Blind people however showed higher decoding accuracies and higher inter-subject consistency for the representation of sounds in VOTC, and the correlation between the representational structure of visual and auditory categories was almost double in the blind when compared to the sighted group. Crucially, we also demonstrate that VOTC represents the categorical membership of sounds rather that their acoustic features in both groups. Our results suggest that early visual deprivation triggers an extension of the intrinsic categorical organization of VOTC that is at least partially independent from vision.

show abstract

Section: Discussionmentioning

confidence: 99%

Categorical representation from sound and sight in the ventral occipito-temporal cortex of sighted and blind

Mattioni

Rezk

Battal

et al. 2019

Preprint

View full text Add to dashboard Cite

show abstract

“…Two recent papers adopted a similar approach but included a condition of perceptual similarity crossed with semantic dissimilarity (Bracci & de Beeck, 2016;Martin, Douglas, Newsome, Man, & Barense, 2018). Prima facie, both of these studies managed to overcome our concerns with this condition.…”

Section: Introductionmentioning

confidence: 99%

“…However, we suggest that while nominally semantically dissimilar, perceptually similar objects continue to share many functional semantic features. Martin et al (2018) posit that hairdryers, electric drills, and handguns share similar shapes, but are conceptually distinct. However, these objects have many semantic properties in common: they are graspable, have handles, and are commonly held in a similar orientation, etc.…”

Section: Introductionmentioning

confidence: 99%

The relative contributions of visual and semantic information in the neural representation of object categories

2019

View full text Add to dashboard Cite

Introduction How do multiple sources of information interact to form mental representations of object categories? It is commonly held that object categories reflect the integration of perceptual features and semantic/knowledge‐based features. To explore the relative contributions of these two sources of information, we used functional magnetic resonance imaging (fMRI) to identify regions involved in the representation object categories with shared visual and/or semantic features. Methods Participants (N = 20) viewed a series of objects that varied in their degree of visual and semantic overlap in the MRI scanner. We used a blocked adaptation design to identify sensitivity to visual and semantic features in a priori visual processing regions and in a distributed network of object processing regions with an exploratory whole‐brain analysis. Results Somewhat surprisingly, within higher‐order visual processing regions—specifically lateral occipital cortex (LOC)—we did not obtain any difference in neural adaptation for shared visual versus semantic category membership. More broadly, both visual and semantic information affected a distributed network of independently identified category‐selective regions. Adaptation was seen a whole‐brain network of processing regions in response to visual similarity and semantic similarity; specifically, the angular gyrus (AnG) adapted to visual similarity and the dorsomedial prefrontal cortex (DMPFC) adapted to both visual and semantic similarity. Conclusions Our findings suggest that perceptual features help organize mental categories throughout the object processing hierarchy. Most notably, visual similarity also influenced adaptation in nonvisual brain regions (i.e., AnG and DMPFC). We conclude that category‐relevant visual features are maintained in higher‐order conceptual representations and visual information plays an important role in both the acquisition and neural representation of conceptual object categories.

show abstract

“…Regarding the more complex representations, Murray and Bussey gave a central role to the perirhinal cortex (PRC), which they claimed performed critical roles in organizing visual features of objects, as well as in organizing semantic features-in virtue of its anatomical location, they argued the PRC 'allows the linking of representations stored in diverse sensory and motor areas' (150). Martin et al (2018) note that more recent work on the PRC suggests two separate ideas. First, that the PRC plays a critical role for object representations organized in terms of conceptual feature conjunctions.…”

Section: Mixed Formatsmentioning

confidence: 98%

“…In connection with this option, a recent paper out of Morgan Barense's lab provides some tantalizing data (Martin et al 2018). One motivation behind the experiment is, as the experimenters note, the representational-hierarchical model of object coding originally put forward by Murray and Bussey (1999).…”

Section: Mixed Formatsmentioning

confidence: 99%

Intelligent action guidance and the use of mixed representational formats

Shepherd

2018

Synthese

View full text Add to dashboard Cite

My topic is the intelligent guidance of action. In this paper I offer an empirically grounded case for four ideas: that [a] cognitive processes of practical reasoning play a key role in the intelligent guidance of action, [b] these processes could not do so without significant enabling work done by both perception and the motor system, [c] the work done by perceptual and motor systems can be characterized as the generation of information (often conceptually structured information) specialized for action guidance, which in turn suggests that [d] the cognitive processes of practical reasoning that play a key role in the guidance of intelligent action are not the abstract, syllogistic ones philosophers often treat as the paradigm of practical reasoning. Rather, these cognitive processes are constrained by, and work well with, the specialized concepts outputted by perception and the feedback outputted by sensorimotor processes.

show abstract

Integrative and distinctive coding of perceptual and conceptual object features in the ventral visual stream

Cited by 5 publications

References 85 publications

Categorical representation from sound and sight in the ventral occipito-temporal cortex of sighted and blind

Categorical representation from sound and sight in the ventral occipito-temporal cortex of sighted and blind

The relative contributions of visual and semantic information in the neural representation of object categories

Intelligent action guidance and the use of mixed representational formats

Contact Info

Product

Resources

About