Whole brain mapping of visual and tactile convergence in the macaque monkey

Guipponi, Olivier; Cléry, Justine; Odouard, Soline; Wardak, Claire; Hamed, Suliann Ben

doi:10.1016/j.neuroimage.2015.05.022

Cited by 34 publications

(34 citation statements)

References 76 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Such associations can be reciprocal: for instance, tactile stimulation has been shown to modify activity within the visual cortex of blindfolded participants ( Merabet et al, 2007 ). These findings are also consistent with recent monkey studies which showed that visual areas respond to tactile stimulations alone and S2 (around the upper bank of the lateral sulcus) also responds to visual stimulations alone ( Guipponi et al, 2015 , Hihara et al, 2015 ).…”

Section: Discussionsupporting

confidence: 93%

Look but don't touch: Visual cues to surface structure drive somatosensory cortex

et al. 2016

View full text Add to dashboard Cite

When planning interactions with nearby objects, our brain uses visual information to estimate shape, material composition, and surface structure before we come into contact with them. Here we analyse brain activations elicited by different types of visual appearance, measuring fMRI responses to objects that are glossy, matte, rough, or textured. In addition to activation in visual areas, we found that fMRI responses are evoked in the secondary somatosensory area (S2) when looking at glossy and rough surfaces. This activity could be reliably discriminated on the basis of tactile-related visual properties (gloss, rough, and matte), but importantly, other visual properties (i.e., coloured texture) did not substantially change fMRI activity. The activity could not be solely due to tactile imagination, as asking explicitly to imagine such surface properties did not lead to the same results. These findings suggest that visual cues to an object's surface properties evoke activity in neural circuits associated with tactile stimulation. This activation may reflect the a-priori probability of the physics of the interaction (i.e., the expectation of upcoming friction) that can be used to plan finger placement and grasp force.

show abstract

Section: Discussionsupporting

confidence: 93%

Look but don't touch: Visual cues to surface structure drive somatosensory cortex

et al. 2016

View full text Add to dashboard Cite

show abstract

“…Earlier studies in monkeys reported visuo-tactile multisensory neurons in the prefrontal, somatosensory, posterior parietal, and superior temporal regions of the cortex [15,16]. To our knowledge, however, neither single-neuron nor fMRI activity in response to tactile/haptic stimuli has been reported in the ventral visual cortex [17], except for task-related responses in V4 during a tactile-visual matching task [18]. Our findings, together with our earlier results [3], provide new evidence that the PIT can represent haptic-related information about visually presented objects.…”

Section: Representation Of Non-visual Information In the Ventral Visumentioning

confidence: 79%

Crossmodal Association of Visual and Haptic Material Properties of Objects in the Monkey Ventral Visual Cortex

et al. 2016

View full text Add to dashboard Cite

Just by looking at an object, we can recognize its non-visual properties, such as hardness. The visual recognition of non-visual object properties is generally accurate [1], and influences actions toward the object [2]. Recent studies suggest that, in the primate brain, this may involve the ventral visual cortex, which represents objects in a way that reflects not only visual but also non-visual object properties, such as haptic roughness, hardness, and weight [3-7]. This new insight raises a fundamental question: how does the visual cortex come to represent non-visual properties--knowledge that cannot be acquired directly through vision? Here we addressed this unresolved question using fMRI in macaque monkeys. Specifically, we explored whether and how simple visuo-haptic experience--just seeing and touching objects made of various materials--can shape representational content in the visual cortex. We measured brain activity evoked by viewing images of objects before and after the monkeys acquired the visuo-haptic experience and decoded the representational space from the activity patterns [8]. We show that simple long-term visuo-haptic experience greatly impacts representation in the posterior inferior temporal cortex, the higher ventral visual cortex. After the experience, but not before, the activity pattern in this region well reflected the haptic material properties of the experienced objects. Our results suggest that neural representation of non-visual object properties in the visual cortex emerges through long-term crossmodal exposure to objects. This highlights the importance of unsupervised learning of crossmodal associations through everyday experience [9-12] for shaping representation in the visual cortex.

show abstract

“…[ 34 , 35 ]) and human (e.g. [ 68 , 69 – 71 ]) primates. A recent neuroimaging study for example showed that changing the hand posture during the application of mechanical nociceptive stimuli modulated the activity of the parietal cortex [ 72 ].…”

Section: Discussionmentioning

confidence: 99%

Shaping visual space perception through bodily sensations: Testing the impact of nociceptive stimuli on visual perception in peripersonal space with temporal order judgments

et al. 2017

View full text Add to dashboard Cite

Coordinating spatial perception between body space and its external surrounding space is essential to adapt behaviors to objects, especially when they are noxious. Such coherent multisensory representation of the body extended into external space is conceptualized by the notion of peripersonal reference frame, mapping the portion of space in which somatic and extra-somatic inputs interact closely. Studies on crossmodal interactions between nociception and vision have been scarce. Here we investigated how the perception of visual stimuli, especially those surrounding the body, can be impacted by a nociceptive and potentially harmful stimulus inflicted on a particular body part. In two temporal order judgment tasks, participants judged which of two lateralized visual stimuli, presented either near or far from the body, had been presented first. Visual stimuli were preceded by nociceptive stimuli, either applied unilaterally (on one single hand) or bilaterally (on both hands simultaneously). In Experiment 1 participants’ hands were always placed next to the visual stimuli presented near the trunk, while in Experiment 2 they could also be placed next to the visual stimuli presented far from the trunk. In Experiment 1, the presence of unilateral nociceptive stimuli prioritized the perception of visual stimuli presented in the same side of space as the stimulated hand, with a significantly larger effect when visual stimuli were presented near the body than when presented farther away. Experiment 2 showed that these visuospatial biases were related to the spatial congruency between the hand on which nociceptive stimuli were applied and the visual stimuli, independently of the relative distance of both the stimulated hand and the visual stimuli from the trunk. Indeed, nociceptive stimuli mostly impacted the perception of the closest visual stimuli. It is hypothesized that these crossmodal interactions may rely on representations of the space directly surrounding specific body parts.

show abstract

Whole brain mapping of visual and tactile convergence in the macaque monkey

Cited by 34 publications

References 76 publications

Look but don't touch: Visual cues to surface structure drive somatosensory cortex

Look but don't touch: Visual cues to surface structure drive somatosensory cortex

Crossmodal Association of Visual and Haptic Material Properties of Objects in the Monkey Ventral Visual Cortex

Shaping visual space perception through bodily sensations: Testing the impact of nociceptive stimuli on visual perception in peripersonal space with temporal order judgments

Contact Info

Product

Resources

About