Cross‐modal predictive processing depends on context rather than local contingencies

Dercksen, Tjerk T.; Stuckenberg, Maria V.; Schröger, Erich; Wetzel, Nicole; Widmann, Andreas

doi:10.1111/psyp.13811

Cited by 4 publications

(4 citation statements)

References 39 publications

(102 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In other words, these two processing systems may not be organized in a modular fashion in a situation where the intention-based prediction system is in charge. From a more general view, this perspective is in line with studies showing that context is highly relevant for modulations of early auditory processing (e.g., Dercksen et al, 2021); and, vice-versa, the execution of a simple action (e.g., a right button-press) depends on the specific context, for example, whether the button-press denotes a "yes" or a "no"-answer (Aberbach-Goodman et al, 2022).…”

Section: Strong Impact Of Action Intention On Mismatch Negativity Whe...supporting

confidence: 74%

Intention-based predictive information modulates auditory deviance processing

Widmann

Schröger²

2022

Front. Neurosci.

Self Cite

View full text Add to dashboard Cite

The human brain is highly responsive to (deviant) sounds violating an auditory regularity. Respective brain responses are usually investigated in situations when the sounds were produced by the experimenter. Acknowledging that humans also actively produce sounds, the present event-related potential study tested for differences in the brain responses to deviants that were produced by the listeners by pressing one of two buttons. In one condition, deviants were unpredictable with respect to the button-sound association. In another condition, deviants were predictable with high validity yielding correctly predicted deviants and incorrectly predicted (mispredicted) deviants. Temporal principal component analysis revealed deviant-specific N1 enhancement, mismatch negativity (MMN) and P3a. N1 enhancements were highly similar for each deviant type, indicating that the underlying neural mechanism is not affected by intention-based expectation about the self-produced forthcoming sound. The MMN was abolished for predictable deviants, suggesting that the intention-based prediction for a deviant can overwrite the prediction derived from the auditory regularity (predicting a standard). The P3a was present for each deviant type but was largest for mispredicted deviants. It is argued that the processes underlying P3a not only evaluate the deviant with respect to the fact that it violates an auditory regularity but also with respect to the intended sensorial effect of an action. Overall, our results specify current theories of auditory predictive processing, as they reveal that intention-based predictions exert different effects on different deviance-specific brain responses.

show abstract

Section: Strong Impact Of Action Intention On Mismatch Negativity Whe...supporting

confidence: 74%

Intention-based predictive information modulates auditory deviance processing

Widmann

Schröger²

2022

Front. Neurosci.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Second, there is evidence for cross-modal prediction for spoken languages ( Sánchez-García et al, 2011 , 2013 ). Third, the cross-modal prediction has also been found for other non-linguistic cognitive domains, such as perception of emotions ( Jessen and Kotz, 2013 ) and music ( Dercksen et al, 2021 ). Given this evidence for cross-modal interactions in both linguistic and non-linguistic domains, further studies might investigate whether bimodal bilinguals make cross-modal linguistic predictions.…”

Section: Discussionmentioning

confidence: 91%

Predictive Processing in Sign Languages: A Systematic Review

2022

View full text Add to dashboard Cite

The objective of this article was to review existing research to assess the evidence for predictive processing (PP) in sign language, the conditions under which it occurs, and the effects of language mastery (sign language as a first language, sign language as a second language, bimodal bilingualism) on the neural bases of PP. This review followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework. We searched peer-reviewed electronic databases (SCOPUS, Web of Science, PubMed, ScienceDirect, and EBSCO host) and gray literature (dissertations in ProQuest). We also searched the reference lists of records selected for the review and forward citations to identify all relevant publications. We searched for records based on five criteria (original work, peer-reviewed, published in English, research topic related to PP or neural entrainment, and human sign language processing). To reduce the risk of bias, the remaining two authors with expertise in sign language processing and a variety of research methods reviewed the results. Disagreements were resolved through extensive discussion. In the final review, 7 records were included, of which 5 were published articles and 2 were dissertations. The reviewed records provide evidence for PP in signing populations, although the underlying mechanism in the visual modality is not clear. The reviewed studies addressed the motor simulation proposals, neural basis of PP, as well as the development of PP. All studies used dynamic sign stimuli. Most of the studies focused on semantic prediction. The question of the mechanism for the interaction between one’s sign language competence (L1 vs. L2 vs. bimodal bilingual) and PP in the manual-visual modality remains unclear, primarily due to the scarcity of participants with varying degrees of language dominance. There is a paucity of evidence for PP in sign languages, especially for frequency-based, phonetic (articulatory), and syntactic prediction. However, studies published to date indicate that Deaf native/native-like L1 signers predict linguistic information during sign language processing, suggesting that PP is an amodal property of language processing.Systematic Review Registration[https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42021238911], identifier [CRD42021238911].

show abstract

“…Studies in the field typically use d prime as an index of accuracy, which identifies the signal detection but cannot attribute the difference on either of the two conditions. Nonetheless, congruent processing relies mostly on predictive coding principles [ 58 ]. As such, the audiovisual stimuli in the congruent condition does not violate the underlying predictions, and hence, engages predominantly top-down mechanisms, which are not explicitly trained in musicians.…”

Section: Discussionmentioning

confidence: 99%

The relationship between musical training and the processing of audiovisual correspondences: Evidence from a reaction time task

Ihalainen

Kotsaridis²,

Vivas³

et al. 2023

PLoS ONE

View full text Add to dashboard Cite

Numerous studies have reported both cortical and functional changes for visual, tactile, and auditory brain areas in musicians, which have been attributed to long-term training induced neuroplasticity. Previous investigations have reported advantages for musicians in multisensory processing at the behavioural level, however, multisensory integration with tasks requiring higher level cognitive processing has not yet been extensively studied. Here, we investigated the association between musical expertise and the processing of audiovisual crossmodal correspondences in a decision reaction-time task. The visual display varied in three dimensions (elevation, symbolic and non-symbolic magnitude), while the auditory stimulus varied in pitch. Congruency was based on a set of newly learned abstract rules: “The higher the spatial elevation, the higher the tone”, “the more dots presented, the higher the tone”, and “the higher the number presented, the higher the tone”, and accuracy and reaction times were recorded. Musicians were significantly more accurate in their responses than non-musicians, suggesting an association between long-term musical training and audiovisual integration. Contrary to what was hypothesized, no differences in reaction times were found. The musicians’ advantage on accuracy was also observed for rule-based congruency in seemingly unrelated stimuli (pitch-magnitude). These results suggest an interaction between implicit and explicit processing–as reflected on reaction times and accuracy, respectively. This advantage was generalised on congruency in otherwise unrelated stimuli (pitch-magnitude pairs), suggesting an advantage on processes requiring higher order cognitive functions. The results support the notion that accuracy and latency measures may reflect different processes.

show abstract

Cross‐modal predictive processing depends on context rather than local contingencies

Cited by 4 publications

References 39 publications

Intention-based predictive information modulates auditory deviance processing

Intention-based predictive information modulates auditory deviance processing

Predictive Processing in Sign Languages: A Systematic Review

The relationship between musical training and the processing of audiovisual correspondences: Evidence from a reaction time task

Contact Info

Product

Resources

About