Working Memory for Linguistic and Non-linguistic Manual Gestures: Evidence, Theory, and Application

Rudner, Mary

doi:10.3389/fpsyg.2018.00679

Cited by 23 publications

(25 citation statements)

References 106 publications

(179 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Hence, working memory and language processing seem to be thoroughly connected. This is also true for working memory and the integration of gesture (14,21,61). For that reason, not only sentence level but also specifically working memory for speech and gesture should be taken into account.…”

Section: Current Treatments For Patients With Schizophreniamentioning

confidence: 99%

“…(15, 31)] on behavioral outcome and neural activation. In a second task, participants conduct an n-back task (one back and two back), where again different videos (speech, gesture and speech-gesture videos) are presented, but some of them are repeated directly (one back) or indirectly/with one new video in between [two back: see (61) for a review about a comparable approach].…”

Section: Tasksmentioning

confidence: 99%

“…Participants are supposed to rate the matching of gesture and speech content [see (68,86)]. Considering the connection between speech/gesture perception and working memory (14,21,61), the second perceptual task is a speechgesture-n-back task (one back, two back and three back with speech, gesture and speech + gesture videos).…”

Section: Msg Training Proceduresmentioning

confidence: 99%

See 2 more Smart Citations

A Multimodal Speech-Gesture Training Intervention for Patients With Schizophrenia and Its Neural Underpinnings – the Study Protocol of a Randomized Controlled Pilot Trial

Riedl¹,

Nagels²,

Sammer³

et al. 2020

Front. Psychiatry

View full text Add to dashboard Cite

Dysfunctional social communication is one of the most stable characteristics in patients with schizophrenia that also affects quality of life. Interpreting abstract speech and integrating nonverbal modalities is particularly affected. Considering the impact of communication on social life but failure to treat communication dysfunctions with usual treatment, we will investigate the possibility to improve verbal and non-verbal communication in schizophrenia by applying a multimodal speech-gesture training (MSG training). Here we describe the newly developed MSG training program and the study design for the first clinical investigation. The intervention contains perceptive rating (match/mismatch of sentence and gesture) and memory tasks (n-back tasks), imitation and productive tasks (e.g., SG fluency-similar to verbal fluency where words are accompanied by gesture). In addition, we offer information about gesture as metalearning element as well as homework for reasons of transfer to everyday life as part of every session. In the MSG training intervention, we offer eight sessions (60 min each) of training. The first pilot study is currently conducted as a single-center, randomized controlled trial of speech-gesture intervention versus wait-list control with a follow-up. Outcomes are measured through pre-post-fMRI and standardized psychological questionnaires comparing two subject groups (30 patients with schizophrenia and 30 healthy controls). Patients and healthy controls are randomized in two intervention groups (with 20 being in the wait-training group and 10 in the training-follow-up group). With our study design we will be able to demonstrate the beneficial effect of the MSG training intervention on behavioral and neural levels.Clinical Trial Registration: DRKS.de, identifier DRKS00015118.

show abstract

Section: Current Treatments For Patients With Schizophreniamentioning

confidence: 99%

Section: Tasksmentioning

confidence: 99%

See 1 more Smart Citation

A Multimodal Speech-Gesture Training Intervention for Patients With Schizophrenia and Its Neural Underpinnings – the Study Protocol of a Randomized Controlled Pilot Trial

Riedl¹,

Nagels²,

Sammer³

et al. 2020

Front. Psychiatry

View full text Add to dashboard Cite

show abstract

“…We focused particularly on non-signing DHH children, because DHH children are likely more attuned to relying on visual cues (e.g. speech reading or a speaker's gestures) than hearing children because their access to the speech signal is limited (Rudner, 2018). The question here is whether experience with this limited access is required to focus on visual input, or whether children who normally do not need such extra cues for speech comprehension can rely on them when auditory input is distorted by babble noise.…”

Section: Present Studymentioning

confidence: 99%

Sign effects in spoken word learning by oral deaf and hard-of-hearing children, and by hearing children

2020

View full text Add to dashboard Cite

Previous research found a beneficial effect of augmentative signs (signs from a sign language used alongside speech) on spoken word learning by signing deaf and hard-of-hearing (DHH) children. The present study compared oral DHH children, and hearing children in a condition with babble noise in order to investigate whether prolonged experience with limited auditory access is required for a sign effect to occur. Nine- to 11-year-old children participated in a word learning task in which half of the words were presented with an augmentative sign. Non-signing DHH children ( N = 19) were trained in normal sound, whereas a control group of hearing peers ( N = 38) were trained in multi-speaker babble noise. The researchers also measured verbal short-term memory (STM). For the DHH children, there was a sign effect on speed of spoken word recognition, but not accuracy, and no interaction between the sign effect in reaction times and verbal STM. The hearing children showed no sign effect for either speed or accuracy. These results suggest that not necessarily sign language knowledge, but rather prolonged experience with limited auditory access is required for children to benefit from signs for spoken word learning regardless of children’s verbal STM.

show abstract

“…Hearing impairment is a highly prevalent neurological condition that is associated with changes in brain organization, i.e., neural plasticity (Jayakody et al, 2018). This applies not only to pre-lingual hearing impairment and profound deafness (Lomber et al, 2010; Rudner, 2018) but also to acquired hearing loss (Ito et al, 1993; Cardin, 2016; Jayakody et al, 2018). Even mild hearing loss leads to neural plasticity (Campbell and Sharma, 2014) and recently we showed hearing-related variation in regional brain volume in a large middle-aged non-clinical cohort (Rudner et al, 2019).…”

Section: Introductionmentioning

confidence: 99%

Visual Rhyme Judgment in Adults With Mild-to-Severe Hearing Loss

et al. 2019

Self Cite

View full text Add to dashboard Cite

Adults with poorer peripheral hearing have slower phonological processing speed measured using visual rhyme tasks, and it has been suggested that this is due to fading of phonological representations stored in long-term memory. Representations of both vowels and consonants are likely to be important for determining whether or not two printed words rhyme. However, it is not known whether the relation between phonological processing speed and hearing loss is specific to the lower frequency ranges which characterize vowels or higher frequency ranges that characterize consonants. We tested the visual rhyme ability of 212 adults with hearing loss. As in previous studies, we found that rhyme judgments were slower and less accurate when there was a mismatch between phonological and orthographic information. A substantial portion of the variance in the speed of making correct rhyme judgment decisions was explained by lexical access speed. Reading span, a measure of working memory, explained further variance in match but not mismatch conditions, but no additional variance was explained by auditory variables. This pattern of findings suggests possible reliance on a lexico-semantic word-matching strategy for solving the rhyme judgment task. Future work should investigate the relation between adoption of a lexico-semantic strategy during phonological processing tasks and hearing aid outcome.

show abstract

Working Memory for Linguistic and Non-linguistic Manual Gestures: Evidence, Theory, and Application

Cited by 23 publications

References 106 publications

A Multimodal Speech-Gesture Training Intervention for Patients With Schizophrenia and Its Neural Underpinnings – the Study Protocol of a Randomized Controlled Pilot Trial

A Multimodal Speech-Gesture Training Intervention for Patients With Schizophrenia and Its Neural Underpinnings – the Study Protocol of a Randomized Controlled Pilot Trial

Sign effects in spoken word learning by oral deaf and hard-of-hearing children, and by hearing children

Visual Rhyme Judgment in Adults With Mild-to-Severe Hearing Loss

Contact Info

Product

Resources

About