While several studies have investigated the temporal relationship between co-speech gestures and prosodic structure, little is known about their potential interaction at the level of their encoding of pragmatic meaning. Here we report the results of two complementary intonationgesture matching tasks which investigate the potential co-dependencies between intonation patterns related to epistemic commitment operators and their associated gestures in Catalan. In Experiment 1, participants were shown audio-muted videos in which a speaker performed gestures conveying epistemic information of certainty or uncertainty while uttering statements and questions. The subjects were then asked to produce a stipulated target word, the goal being to examine whether they would produce the word with a tune that was semantically consistent with the gestures they had seen. In Experiment 2, participants were primed by hearing intonation patterns conveying epistemic information (certainty-uncertainty) and were then asked to select one of two silent videos which seemed to best match the intonation they had heard. The results suggest converging positive effects in both matching tasks and suggest a close interrelation between the pragmatic representations of intonation and gesture that needs to be taken into account when investigating multimodal pragmatic encoding. Highlights• One-to-one correspondences can be made between prosodic tunes and gesture sets used to convey epistemic meanings • Speakers can be successfully primed by epistemic gestures to produce corresponding epistemic intonation. • Listeners can be successfully primed by epistemic intonation to visually select corresponding epistemic gestures. • Results support the idea of a tight interplay between intonational meaning and gestural meaning.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.