How symbolic gestures and words interact with each other

Barbieri, Filippo; Buonocore, Antimo; Volta, Riccardo Dalla; Gentilucci, Maurizio

doi:10.1016/j.bandl.2009.01.002

Cited by 40 publications

(41 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The data of experiments 1 and 2 seem to differ from those by Gentilucci and colleagues (Barbieri et al, 2009;Bernardis and Gentilucci, 2006;Gentilucci et al, 2006). These authors found that integration resulted in an increase in F2 rather than F1.…”

Section: Discussion (Behavioural Experiments 1 and 2)contrasting

confidence: 76%

“…In previous studies (Barbieri et al, 2009;Bernardis and Gentilucci, 2006;Gentilucci et al, 2006) using tasks in which gestures and words were produced at the same time, the two signals were reciprocally integrated when they were both meaningful and congruent. That is, the gesture affected voice spectra of words and, conversely, the word affected the gesture kinematics.…”

Section: Discussion (Behavioural Experiments 1 and 2)mentioning

confidence: 94%

See 1 more Smart Citation

Gesture and word analysis: the same or different processes?

2015

Self Cite

View full text Add to dashboard Cite

Section: Discussion (Behavioural Experiments 1 and 2)contrasting

confidence: 76%

Section: Discussion (Behavioural Experiments 1 and 2)mentioning

confidence: 94%

Gesture and word analysis: the same or different processes?

2015

Self Cite

View full text Add to dashboard Cite

“…Furthermore, mismatching information between a word's semantics and gestural shape can lead to incongruity effects during communication [Barbieri et al, 2009;Bernardis and Gentilucci, 2006;Bernardis et al, 2008;Chieffi et al, 2009;Kircher et al, 2009]. Our findings confirm the close relationship between gesture and language and extend it to word learning in a foreign language.…”

Section: Behavioral Studysupporting

confidence: 84%

The impact of iconic gestures on foreign language word learning and its neural substrate

Macedonia¹,

Müller²,

Friederici³

2011

Human Brain Mapping

228

184

View full text Add to dashboard Cite

Vocabulary acquisition represents a major challenge in foreign language learning. Research has demonstrated that gestures accompanying speech have an impact on memory for verbal information in the speakers' mother tongue and, as recently shown, also in foreign language learning. However, the neural basis of this effect remains unclear. In a within-subjects design, we compared learning of novel words coupled with iconic and meaningless gestures. Iconic gestures helped learners to significantly better retain the verbal material over time. After the training, participants' brain activity was registered by means of fMRI while performing a word recognition task. Brain activations to words learned with iconic and with meaningless gestures were contrasted. We found activity in the premotor cortices for words encoded with iconic gestures. In contrast, words encoded with meaningless gestures elicited a network associated with cognitive control. These findings suggest that memory performance for newly learned words is not driven by the motor component as such, but by the motor image that matches an underlying representation of the word's semantics.

show abstract

“…These studies have shown that the integration between meaningful gestures and speech occurs at a high semantic level and that the combination of both expressive means leads to effects that are not simply a linear combination of perceiving either emblems or speech alone (Barbieri et al, 2009;Gentilucci, Bernardis, Crisi, & Dalla Volta, 2006). On the whole, the prevailing view in the literature is that speech and gesture share a unified decoding process at the semantic level.…”

Section: Communicative Intention Processingmentioning

confidence: 97%

“…Several studies have investigated the reciprocal influences and the cross-modal interactions between speech and emblem gestures (Barbieri, Buonocore, Volta, & Gentilucci, 2009;Kircher et al, 2009;Xu, Gannon, Emmorey, Smith, & Braun, 2009;Nakamura et al, 2004). These studies have shown that the integration between meaningful gestures and speech occurs at a high semantic level and that the combination of both expressive means leads to effects that are not simply a linear combination of perceiving either emblems or speech alone (Barbieri et al, 2009;Gentilucci, Bernardis, Crisi, & Dalla Volta, 2006).…”

Section: Communicative Intention Processingmentioning

confidence: 99%

Intention Processing in Communication: A Common Brain Network for Language and Gestures

Enrici

Adenzato

Cappa

et al. 2011

Journal of Cognitive Neuroscience

View full text Add to dashboard Cite

Abstract■ Human communicative competence is based on the ability to process a specific class of mental states, namely, communicative intention. The present fMRI study aims to analyze whether intention processing in communication is affected by the expressive means through which a communicative intention is conveyed, that is, the linguistic or extralinguistic gestural means. Combined factorial and conjunction analyses were used to test two sets of predictions: first, that a common brain network is recruited for the comprehension of communicative intentions independently of the modality through which they are conveyed; second, that additional brain areas are specifically recruited depending on the communicative modality used, reflecting distinct sensorimotor gateways. Our results clearly showed that a common neural network is engaged in communicative intention processing independently of the modality used. This network includes the precuneus, the left and right posterior STS and TPJ, and the medial pFC. Additional brain areas outside those involved in intention processing are specifically engaged by the particular communicative modality, that is, a peri-sylvian language network for the linguistic modality and a sensorimotor network for the extralinguistic modality. Thus, common representation of communicative intention may be accessed by modality-specific gateways, which are distinct for linguistic versus extralinguistic expressive means. Taken together, our results indicate that the information acquired by different communicative modalities is equivalent from a mental processing standpoint, in particular, at the point at which the actorʼs communicative intention has to be reconstructed. ■

show abstract

How symbolic gestures and words interact with each other

Cited by 40 publications

References 38 publications

Gesture and word analysis: the same or different processes?

Gesture and word analysis: the same or different processes?

The impact of iconic gestures on foreign language word learning and its neural substrate

Intention Processing in Communication: A Common Brain Network for Language and Gestures

Contact Info

Product

Resources

About