Synaesthesia has previously been linked with imagery abilities, although an understanding of a causal role for mental imagery in broader synaesthetic experiences remains elusive. This can be partly attributed to our relatively poor understanding of imagery in sensory domains beyond vision. Investigations into the neural and behavioural underpinnings of mental imagery have nevertheless identified an important role for imagery in perception, particularly in mediating cross-modal interactions. However, the phenomenology of synaesthesia gives rise to the assumption that associated cross-modal interactions may be encapsulated and specific to synaesthesia. As such, evidence for a link between imagery and perception may not generalize to synaesthesia. Here, we present results that challenge this idea: first, we found enhanced somatosensory imagery evoked by visual stimuli of body parts in mirror-touch synaesthetes, relative to other synaesthetes or controls. Moreover, this enhanced imagery generalized to tactile object properties not directly linked to their synaesthetic associations. Second, we report evidence that concurrent experience evoked in grapheme—colour synaesthesia was sufficient to trigger visual-to-tactile correspondences that are common to all. Together, these findings show that enhanced mental imagery is a consistent hallmark of synaesthesia, and suggest the intriguing possibility that imagery may facilitate the cross-modal interactions that underpin synaesthesic experiences. This article is part of a discussion meeting issue ‘Bridging senses: novel insights from synaesthesia’.

Sustained multisensory integration over long inter-stimulus time delays is typically found in older adults, particularly those with a history of falls. However, the extent to which the temporal precision of audio-visual integration is associated with longitudinal fall or fall risk trajectories is unknown. A large sample of older adults (N = 2319) were grouped into longitudinal trajectories of self-reported fall incidents (i.e., decrease, stable, or increase in number) and, separately, their performance on a standard, objective measure of fall risk, Timed Up and Go (TUG; stable, moderate decline, severe decline). Multisensory integration was measured once as susceptibility to the Sound-Induced Flash Illusion (SIFI) across three stimulus onset asynchronies (SOAs): 70 ms, 150 ms and 230 ms. Older adults with an increasing fall number showed a significantly different pattern of performance on the SIFI than non-fallers, depending on age: For adults with increasing incidents of falls, those aged 53–59 years showed a much smaller difference in illusion susceptibility at 70 ms versus 150 ms than those aged 70 + years. In contrast, non-fallers showed a more comparable difference between these SOA conditions across age groups. There was no association between TUG performance trajectories and SIFI susceptibility. These findings suggests that a fall event is associated with distinct temporal patterns of multisensory integration in ageing and have implications for our understanding of the mechanisms underpinning brain health in older age.

The neural representation of multisensory space near the body is modulated by the active use of long tools in non-human primates. Here, we investigated whether the electrophysiological correlates of visuo-tactile integration in near and far space were modulated by active tool use in healthy humans. Participants responded to a tactile target delivered to one hand while an irrelevant visual stimulus was presented ipsilaterally in near or far space. This crossmodal task was performed after the use of either short or long tools.Crucially, the P100 components elicited by visuo-tactile stimuli was enhanced on far as compared to near space trials after the use of long tools, while no such difference was present after short tool use. Thus, we found increased neural responses in brain areas encoding tactile stimuli to the body when visual stimuli were presented close to the tip of the tool after long tool use. This increased visuo-tactile integration on far space trials following the use of long tools might indicate a transient remapping of multisensory space. We speculate that performing voluntary actions with long tools strengthens the representation of sensory information arising within portions of space (i.e. the hand and the tip of the tool) that are most functionally relevant to one's behavioural goals.

Sustained integration of sensory inputs over increased temporal delays is associated with reduced cognitive and physical functioning in older adults and adverse outcomes such as falls. Here, we explored the relationship between multisensory integration and a clinically relevant measure of balance/postural control; Sit-to-Stand Time, the efficiency with which an older adult can transition between a seated and a standing posture. We investigated whether temporal multisensory integration was associated with performance on the Five-Times Sit-to-Stand Test (FTSST) in a large sample of 2556 older adults (mean age = 63.62 years, SD = 7.50; 55% female) drawn from The Irish Longitudinal Study on Ageing (TILDA). K-means clustering was applied to FTSST data, yielding three clusters characterised by fast (mean = 10.88 s; n = 1122), medium (mean = 14.34 s; n = 1133) and slow (mean = 18.97 s; n = 301) sit-to-stand times. At wave 3 of TILDA, older adults participated in the Sound Induced Flash Illusion (SIFI), a measure of the precision of temporal audio–visual integration, which included three audio–visual stimulus onset asynchronies (SOAs): 70, 150 and 230 ms. Older adults with the slowest sit-to-stand times were more susceptible to the SIFI at the longest SOA (230 ms) compared to the shortest SOA (70 ms) relative to those with the fastest times (p = 0.02). Older adults who take longer to repeatedly transition from a seated to a standing posture exhibit an expanded temporal binding window for audio–visual events, supporting a link between multisensory perception and balance/postural control in ageing.

Previous studies have suggested that discrete cross-sensory events could be incorrectly combined in the brain of older adults with a history of falls, possibly undermining motor and balance control. Based on previous findings that multisensory integration is modifiable with practice, even in an ageing population, we designed a serious game, named CityQuest, to train typical, everyday multisensory processes including sensori-motor control, spatial navigation, obstacle avoidance and balance control. Played over several sessions, this game was shown to improve these functions in older adults with and without a history of falls, depending on the specific condition of the game on which they were trained. Here, using voxel-based morphometry analysis of anatomical magnetic resonance imaging (MRI) data, we investigated structural changes in the brain of a smaller group of older adults from those who successfully completed this five-week intervention. A grey-matter (GM) volume increase in the precentral gyrus, and GM volume reduction in the inferior temporal and orbitofrontal gyri, was found for all participants. Changes in GM volume within regions of the cerebellum were differentially associated with fall-prone and healthy older adults. Furthermore, a greater GM volume increase in the precentral gyrus was observed in participants who performed the full CityQuest intervention relative to those required to avoid obstacles only. Our results support previous evidence that multisensory training can affect structural changes in the older brain and have implications for programmes designed for the successful rehabilitation of perceptual and cognitive functions.

We investigated the neural underpinnings of texture categorisation using exemplars that were previously learned either within modalities (visual training and visual test) or across modalities (tactile training and visual test). Previous models of learning suggest a decrease in activation in brain regions that are typically involved in cognitive control during task acquisition, but a concomitant increase in activation in brain regions associated with the representation of the acquired information. In our study, participants were required to learn to categorise fabrics of different textures as either natural or synthetic. Training occurred over several sessions, with each fabric presented either visually or through touch to a participant. Pre- and post-training tests, in which participants categorised visual images only of the fabrics, were conducted during a functional magnetic resonance imaging (fMRI) scan. Consistent with previous research on cognitive processes involved in task acquisition, we found that categorisation training was associated with a decrease in activation in brain regions associated with cognitive systems involved in learning, including the superior parietal cortex, dorsal anterior cingulate cortex (dACC), and the right dorsolateral prefrontal cortex (DLFC). Moreover, these decreases were independent of training modality. In contrast, we found greater activation to visual textures in a region within the left medial occipital cortex (MOC) following training. There was no overall evidence of an effect of training modality in the main analyses, with texture-specific regional changes associated with both within- (visual) and cross- (touch) modal training. However, further analyses suggested that, unlike categorisation performance following within-modal training, crossmodal training was associated with bilateral activation of the MOC. Our results support previous evidence for a multisensory representation of texture within early visual regions of the cortex and provide insight into how multisensory categories are formed in the brain.

No abstract

No abstract