Semantic relation vs. surprise: The differential effects of related and unrelated co-verbal gestures on neural encoding and subsequent recognition

Straube, Benjamin; Meyer, Léa; Green, Antonia; Kircher, Tilo

doi:10.1016/j.brainres.2014.04.012

Cited by 22 publications

(11 citation statements)

References 75 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The present work explored the role of cognitive load from both word abstractness and social constraint of gesture prohibition, and it incorporated motion-capture technology to test quantitative measures of movement in the same model. An important limitation of present work is that participants could see their hands, confounding with production any recourse to neural mechanisms sensitive to gesture perception in concrete and abstract speech contexts (Straube, Green, Bromberger, & Kircher, 2011), particularly in relation to subsequent memory (Straube, Meyer, Green, & Kircher, 2014). Confederate recall might have helped to disentangle such perception-production confounds, but because we used the same confederate repeatedly (within each gender), these recall scores would themselves have repetition effects requiring further disentangling.…”

Section: Discussionmentioning

confidence: 97%

Gesturing more diminishes recall of abstract words when gesture is allowed and concrete words when it is taboo

Matthews-Saugstad

Raymakers

Kelty-Stephen

2017

Quarterly Journal of Experimental Psychology

View full text Add to dashboard Cite

Gesture during speech can promote or diminish recall for conversation content. We explored effects of cognitive load on this relationship, manipulating it at two scales: individual-word abstractness and social constraints to prohibit gestures. Prohibited gestures can diminish recall but more so for abstract-word recall. Insofar as movement planning adds to cognitive load, movement amplitude may moderate gesture effects on memory, with greater permitted- and prohibited-gesture movements reducing abstract-word recall and concrete-word recall, respectively. We tested these effects in a dyadic game in which 39 adult participants described words to confederates without naming the word or five related words. Results supported our expectations and indicated that memory effects of gesturing depend on social, cognitive, and motoric aspects of discourse.

show abstract

Section: Discussionmentioning

confidence: 97%

Gesturing more diminishes recall of abstract words when gesture is allowed and concrete words when it is taboo

Matthews-Saugstad

Raymakers

Kelty-Stephen

2017

Quarterly Journal of Experimental Psychology

View full text Add to dashboard Cite

show abstract

“…The stimuli have been extensively validated and successfully made use of in other studies. 7,8,25,26,46–49 The videos looked as natural as possible and differed only in type of co-verbal gesture and relatedness. Iconic and metaphoric gestures were chosen in concordance with McNeill’s definitions, illustrating form, size or movement of something concrete the speaker is referring to (iconic gestures), or being speech–related on an abstract semantic level (metaphoric gestures).…”

Section: Methodsmentioning

confidence: 99%

“…1,2 In real life, gestures usually occur in the context of spoken language. These co-verbal gestures accompany speech and thereby improve understanding, 3,4 learning, 5,6 memory performance, 5,7,8 and reduce processing during communication. 7…”

Section: Introductionmentioning

confidence: 99%

Transcranial Direct Current Stimulation Improves Semantic Speech–Gesture Matching in Patients With Schizophrenia Spectrum Disorder

Schülke

Straube

2018

Schizophrenia Bulletin

Self Cite

View full text Add to dashboard Cite

Background Patients with schizophrenia spectrum disorders (SSD) have severe deficits in speech and gesture processing that contribute considerably to the burden of this disorder. Brain imaging shows left inferior frontal gyrus involvement for impaired processing of co-verbal gestures in patients with schizophrenia. Recently, transcranial direct current stimulation (tDCS) of the left frontal lobe has been shown to modulate processing of co-verbal gestures in healthy subjects. Although tDCS has been used to reduce symptoms of patients with SSD, the effects of tDCS on gesture processing deficits remain hitherto unexplored. Objective Here we tested the hypothesis that inhibitory cathodal tDCS of the left frontal lobe decreases pathological dysfunction and improves semantic processing of co-verbal gestures in patients with SSD. Methods We measured ratings and reaction times in a speech–gesture semantic relatedness assessment task during application of frontal, frontoparietal, parietal, and sham tDCS to 20 patients with SSD and 29 healthy controls. Results We found a specific effect of tDCS on speech–gesture relatedness ratings of patients. Frontal compared to parietal and sham stimulation significantly improved the differentiation between related and unrelated gestures. Placement of the second electrode (right frontal vs parietal) did not affect the effect of left frontal stimulation, which reduced the preexisting difference between patients and healthy controls. Conclusion Here we show that left frontal tDCS can improve semantic co-verbal gesture processing in patients with SSD. tDCS could be a viable tool to normalize processing in the left frontal lobe and facilitate direct social communicative functioning in patients with SSD.

show abstract

“…Gestures can for instance enhance language understanding [12], and mediate social learning and memory processes [13,14]. Recently, gesture performance has been shown to be impaired in patients with schizophrenia.…”

Section: Introductionmentioning

confidence: 99%

Gesture Performance in First- and Multiple-Episode Patients with Schizophrenia Spectrum Disorders

et al. 2016

View full text Add to dashboard Cite

Background/Aim: Gesturing plays an important role in social behavior and social learning. Deficits are frequent in schizophrenia and may contribute to impaired social functioning. Information about deficits during the course of the disease and presence of severity and patterns of impairment in first-episode patients is missing. Hence, we aimed to investigate gesturing in first- compared to multiple-episode schizophrenia patients and healthy controls. Methods: In 14 first-episode patients, 14 multiple-episode patients and 16 healthy controls matched for age, gender and education, gesturing was assessed by the comprehensive Test of Upper Limb Apraxia. Performance in two domains of gesturing - imitation and pantomime - was recorded on video. Raters of gesture performance were blinded. Results: Patients with multiple episodes had severe gestural deficits. For almost all gesture categories, performance was worse in multiple- than in first-episode patients. First-episode patients demonstrated subtle deficits with a comparable pattern. Conclusions: Subjects with multiple psychotic episodes have severe deficits in gesturing, while only mild impairments were found in first-episode patients independent of age, gender, education and negative symptoms. The results indicate that gesturing is impaired at the onset of disease and likely to further deteriorate during its course.

show abstract

Semantic relation vs. surprise: The differential effects of related and unrelated co-verbal gestures on neural encoding and subsequent recognition

Cited by 22 publications

References 75 publications

Gesturing more diminishes recall of abstract words when gesture is allowed and concrete words when it is taboo

Gesturing more diminishes recall of abstract words when gesture is allowed and concrete words when it is taboo

Transcranial Direct Current Stimulation Improves Semantic Speech–Gesture Matching in Patients With Schizophrenia Spectrum Disorder

Gesture Performance in First- and Multiple-Episode Patients with Schizophrenia Spectrum Disorders

Contact Info

Product

Resources

About