Similarity and categorization: From vision to touch

Gaißert, Nina; Bülthoff, HH; Wallraven, Christian

doi:10.1016/j.actpsy.2011.06.007

Cited by 27 publications

(20 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Our behavioral results confirm those of previous studies [Cooke et al, ; Gaißert et al, ; Gaißert and Wallraven, ; Gaißert et al, ; Wallraven et al, ], showing that visually‐ trained object shape knowledge clearly transfers to the haptic domain. Indeed, all participants showed above‐chance performance in the haptic test.…”

Section: Discussionsupporting

confidence: 91%

“Can touch this”: Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways

2016

Self Cite

View full text Add to dashboard Cite

Previous studies on visuo-haptic shape processing provide evidence that visually learned shape information can transfer to the haptic domain. In particular, recent neuroimaging studies have shown that visually learned novel objects that were haptically tested recruited parts of the ventral pathway from early visual cortex to the temporal lobe. Interestingly, in such tasks considerable individual variation in cross-modal transfer performance was observed. Here, we investigate whether this individual variation may be reflected in microstructural characteristics of white-matter (WM) pathways. We first trained participants on a fine-grained categorization task of novel shapes in the visual domain, followed by a haptic categorization test. We then correlated visual training-performance and haptic test-performance, as well as performance on a symbol-coding task requiring visuo-motor dexterity with microstructural properties of WM bundles potentially involved in visuo-haptic processing (the inferior longitudinal fasciculus [ILF], the fronto-temporal part of the superior longitudinal fasciculus [SLF ] and the vertical occipital fasciculus [VOF]). Behavioral results showed that haptic categorization performance was good on average but exhibited large inter-individual variability. Haptic performance also was correlated with performance in the symbol-coding task. WM analyses showed that fast visual learners exhibited higher fractional anisotropy (FA) in left SLF and left VOF. Importantly, haptic test-performance (and symbol-coding performance) correlated with FA in ILF and with axial diffusivity in SLF . These findings provide clear evidence that individual variation in visuo-haptic performance can be linked to microstructural characteristics of WM pathways. Hum Brain Mapp 38:842-854, 2017. © 2016 Wiley Periodicals, Inc.

show abstract

Section: Discussionsupporting

confidence: 91%

“Can touch this”: Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways

2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…A high correlation in the weighing of texture and shape cues for discriminating objects was also shown for such different exploratory procedures as contour following (serial exploration) and gripping (parallel exploration) 2 . Such similar weighting across exploration modes is useful for building stable high-level viewpoint-independent shape representations across the senses, as have been shown for vision and touch 31 32 33 34 . If shape perception depends too much on the exploration mode used, such high-level shape representations could hardly be consistent.…”

Section: Discussionmentioning

confidence: 93%

Haptic adaptation to slant: No transfer between exploration modes

Dam

Plaisier

Glowania

et al. 2016

Sci Rep

View full text Add to dashboard Cite

Human touch is an inherently active sense: to estimate an object’s shape humans often move their hand across its surface. This way the object is sampled both in a serial (sampling different parts of the object across time) and parallel fashion (sampling using different parts of the hand simultaneously). Both the serial (moving a single finger) and parallel (static contact with the entire hand) exploration modes provide reliable and similar global shape information, suggesting the possibility that this information is shared early in the sensory cortex. In contrast, we here show the opposite. Using an adaptation-and-transfer paradigm, a change in haptic perception was induced by slant-adaptation using either the serial or parallel exploration mode. A unified shape-based coding would predict that this would equally affect perception using other exploration modes. However, we found that adaptation-induced perceptual changes did not transfer between exploration modes. Instead, serial and parallel exploration components adapted simultaneously, but to different kinaesthetic aspects of exploration behaviour rather than object-shape per se. These results indicate that a potential combination of information from different exploration modes can only occur at down-stream cortical processing stages, at which adaptation is no longer effective.

show abstract

“…From behavioral studies, we know that participants trained in the visual modality to recognize novel objects show partial or near-complete transfer to the haptic modality, and vice versa (Lawson, 2009; Lacey, Peters, & Sathian, 2007; Norman, Norman, Clayton, Lianekhammy, & Zielke, 2004), and that object similarity is judged in similar ways across modalities (Gaissert & Wallraven, 2012; Gaissert, Bülthoff, & Wallraven, 2011; Gaissert, Wallraven, & Bülthoff, 2010; Cooke, Jäkel, Wallraven, & Bülthoff, 2007; Cooke, Kannengiesser, Wallraven, & Bülthoff, 2006). Those findings suggest that participants base their similarity judgments on a multisensory representation.…”

Section: Introductionmentioning

confidence: 99%

Multisensory Part-based Representations of Objects in Human Lateral Occipital Cortex

Erdogan

Chen

Garcea

et al. 2016

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

The format of high-level object representations in temporal-occipital cortex is a fundamental and as yet unresolved issue. Here we use fMRI to show that human lateral occipital cortex (LOC) encodes novel 3-D objects in a multisensory and part-based format. We show that visual and haptic exploration of objects leads to similar patterns of neural activity in human LOC and that the shared variance between visually and haptically induced patterns of BOLD contrast in LOC reflects the part structure of the objects. We also show that linear classifiers trained on neural data from LOC on a subset of the objects successfully predict a novel object based on its component part structure. These data demonstrate a multisensory code for object representations in LOC that specifies the part structure of objects.

show abstract

Similarity and categorization: From vision to touch

Cited by 27 publications

References 45 publications

“Can touch this”: Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways

“Can touch this”: Cross-modal shape categorization performance is associated with microstructural characteristics of white matter association pathways

Haptic adaptation to slant: No transfer between exploration modes

Multisensory Part-based Representations of Objects in Human Lateral Occipital Cortex

Contact Info

Product

Resources

About