The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies

Arachchige, Kendra Kandana; Loureiro, Isabelle Simoes; Blekić, Wivine; Rossignol, Mandy; Lefèbvre, Laurent

doi:10.3389/fpsyg.2021.634074

Cited by 14 publications

(9 citation statements)

References 132 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Overall, students were satisfied with the auxiliary memorization learning method. Integrating gesture memory (body language) for assistance and supplementing it with rhyme (text descriptions) could improve students' understanding of concepts and uncover the internal relationship between the knowledge points behind the gestures (Kandana Arachchige et al, 2021). It also helped students overcome the common challenges in learning the extraocular muscle functions: incomplete extraocular muscle function memory, incorrect identification of the main functions and muscle positions, missing items in comprehensive use, and confusion over muscle functions.…”

Section: Discussionmentioning

confidence: 99%

A new method of learning the function of the extraocular muscles

2023

View full text Add to dashboard Cite

Understanding and memorizing the primary, secondary, and tertiary functions of the vertical recti and oblique extraocular muscles play a decisive role in correctly diagnosing various types of strabismus, determining the location of nervous system lesions, and formulating correct treatment plans. However, for beginners, rapid learning, memorization, and application of these extraocular muscle functions are challenging. To improve the teaching of strabismus in ophthalmology and help students overcome the core learning difficulties, our team developed a gesture method based on a functional diagram of the extraocular muscles and a corresponding rhyme to teach clinical medicine students. The effects of the gesture method were determined by using in‐class quizzes and self‐confidence levels. Students’ evaluations of the gesture method were assessed using a questionnaire survey. The gesture method significantly improved the mean scores on the tests (4.85 ± 1.65 vs. 6.31 ± 1.87 vs. 6.80 ± 1.45, all p < 0.001) and self‐confidence scores (20.83 ± 4.06 vs. 27.38 ± 4.88 vs. 28.69 ± 3.53, all p < 0.001) of the students. The evaluations showed that the students were satisfied with the auxiliary memorization learning method. This new method could help students better understand and remember the function of the extraocular muscles, and is a valuable auxiliary teaching strategy.

show abstract

Section: Discussionmentioning

confidence: 99%

A new method of learning the function of the extraocular muscles

2023

View full text Add to dashboard Cite

show abstract

“…Second, we did not differentiate between the types of iconic gestures (i.e., action, shape, position). Because of the potential difference of importance for comprehension between these types of iconic gestures (see Kandana Arachchige et al, 2021 ), it would be interesting to see whether and how visual attention is distinctively allocated to all of them. Finally, in the current study, although some sentences (16/50 items) retained some meaning in the event of a total degradation (e.g., “He kept his papers in the red boxes he bought from the shop” remains understandable without “red”) and others did not (e.g., “He mixed his cement mixture,” makes little sense without “mixed”), we do not believe this had an effect on the observed results.…”

Section: Discussionmentioning

confidence: 99%

Covert Attention to Gestures Is Sufficient for Information Uptake

et al. 2021

Self Cite

View full text Add to dashboard Cite

Numerous studies have explored the benefit of iconic gestures in speech comprehension. However, only few studies have investigated how visual attention was allocated to these gestures in the context of clear versus degraded speech and the way information is extracted for enhancing comprehension. This study aimed to explore the effect of iconic gestures on comprehension and whether fixating the gesture is required for information extraction. Four types of gestures (i.e., semantically and syntactically incongruent iconic gestures, meaningless configurations, and congruent iconic gestures) were presented in a sentence context in three different listening conditions (i.e., clear, partly degraded or fully degraded speech). Using eye tracking technology, participants’ gaze was recorded, while they watched video clips after which they were invited to answer simple comprehension questions. Results first showed that different types of gestures differently attract attention and that the more speech was degraded, the less participants would pay attention to gestures. Furthermore, semantically incongruent gestures appeared to particularly impair comprehension although not being fixated while congruent gestures appeared to improve comprehension despite also not being fixated. These results suggest that covert attention is sufficient to convey information that will be processed by the listener.

show abstract

“…In recent years, different aspects of Iconicity in gesture-speech recognition have been the topic of linguistics and educational research. Iconic gestures have been identified to be helpful in speech comprehension by multiple research studies surveyed in [13]. Iconic gestures also contribute to better understanding and increased word production in school aged children ([3]).…”

Section: Introductionmentioning

confidence: 99%

EdGCon: Auto-assigner of Iconicity Ratings Grounded by Lexical Properties to Aid in Generation of Technical Gestures

Hossain

Kamboj

Maity

et al. 2023

Proceedings of the 38th ACM/SIGAPP Symposium on Applied Computing

View full text Add to dashboard Cite

Gestures that share similarities in their forms and are related in their meanings, should be easier for learners to recognize and incorporate into their existing lexicon. In that regard, to be more readily accepted as standard by the Deaf and Hard of Hearing community, technical gestures in American Sign Language (ASL) will optimally share similar in forms with their lexical neighbors. We utilize a lexical database of ASL, ASL-LEX, to identify lexical relations within a set of technical gestures. We use automated identification for 3 unique sub-lexical properties in ASL-location, handshape and movement. 𝐸𝑑𝐺𝐶𝑜𝑛 assigned an iconicity rating based on the lexical property similarities of the new gesture with an existing set of technical gestures and the relatedness of the meaning of the new technical word to that of the existing set of technical words. We collected 30 ad hoc crowdsourced technical gestures from different internet websites and tested them against 31 gestures from the DeafTEC technical corpus. We found that 𝐸𝑑𝐺𝐶𝑜𝑛 was able to correctly auto-assign the iconicity ratings 80.76% of the time. 1

show abstract

The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies

Cited by 14 publications

References 132 publications

A new method of learning the function of the extraocular muscles

A new method of learning the function of the extraocular muscles

Covert Attention to Gestures Is Sufficient for Information Uptake

EdGCon: Auto-assigner of Iconicity Ratings Grounded by Lexical Properties to Aid in Generation of Technical Gestures

Contact Info

Product

Resources

About