Children use visual speech to compensate for non-intact auditory speech

Jerger, Susan; Damian, Markus F.; Tye‐Murray, Nancy; Abdi, Hervé

doi:10.1016/j.jecp.2014.05.003

Cited by 35 publications

(55 citation statements)

References 65 publications

(103 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The CNH group—whose ages yielded a group-mean and -distribution akin to that in the CHI group—was formed from a pool of 132 CNH from associated projects (see Jerger et al 2014; Jerger et al 2016). Ages (yr;mo) ranged from 4;1 to 14;9 ( M =9;2) in the CHI and 4;2 to 14;5 ( M =9;1) in the CNH.…”

Section: Methodsmentioning

confidence: 99%

“…Our question was whether the intact visual speech would “restore or fill-in” the non-intact auditory speech in which case performance for the same auditory stimulus would differ depending upon the presence/absence of visual speech. Responses illustrating this influence of visual speech on a repetition task (Jerger et al 2014) are perceiving /bag/ for AV input but /ag/ for auditory input. To study the influence of visual speech on phonological priming, these stimuli were administered via the multi-modal picture word (PW) task.…”

Section: New Distractors: Non-intact Auditory Onsetsmentioning

confidence: 99%

See 1 more Smart Citation

Phonological Priming in Children with Hearing Loss: Effect of Speech Mode, Fidelity, and Lexical Status

et al. 2016

Self Cite

View full text Add to dashboard Cite

Objectives Our research determined 1) how phonological priming of picture naming was affected by the mode (auditory-visual [AV] vs auditory), fidelity (intact vs non-intact auditory onsets), and lexical status (words vs nonwords) of speech stimuli in children with prelingual sensorineural hearing impairment (CHI) vs. children with normal hearing (CNH); and 2) how the degree of hearing impairment (HI), auditory word recognition, and age influenced results in CHI. Note that some of our AV stimuli were not the traditional bimodal input but instead they consisted of an intact consonant/rhyme in the visual track coupled to a non-intact onset/rhyme in the auditory track. Example stimuli for the word bag are: 1) AV: intact visual (b/ag) coupled to non-intact auditory (−b/ag) and 2) Auditory: static face coupled to the same non-intact auditory (−b/ag). Our question was whether the intact visual speech would “restore or fill-in” the non-intact auditory speech in which case performance for the same auditory stimulus would differ depending upon the presence/absence of visual speech. Design Participants were 62 CHI and 62 CNH whose ages had a group-mean and -distribution akin to that in the CHI group. Ages ranged from 4 to 14 years. All participants met the following criteria: 1) spoke English as a native language, 2) communicated successfully aurally/orally, and 3) had no diagnosed or suspected disabilities other than HI and its accompanying verbal problems. The phonological priming of picture naming was assessed with the multi-modal picture word task. Results Both CHI and CNH showed greater phonological priming from high than low fidelity stimuli and from AV than auditory speech. These overall fidelity and mode effects did not differ in the CHI vs. CNH—thus these CHI appeared to have sufficiently well specified phonological onset representations to support priming and visual speech did not appear to be a disproportionately important source of the CHI’s phonological knowledge. Two exceptions occurred, however. First—with regard to lexical status—both the CHI and CNH showed significantly greater phonological priming from the nonwords than words, a pattern consistent with the prediction that children are more aware of phonetics-phonology content for nonwords. This overall pattern of similarity between the groups was qualified by the finding that CHI showed more nearly equal priming by the high vs. low fidelity nonwords than the CNH; in other words, the CHI were less affected by the fidelity of the auditory input for nonwords. Second, auditory word recognition—but not degree of HI or age—uniquely influenced phonological priming by the nonwords presented AV. Conclusions With minor exceptions, phonological priming in CHI and CNH showed more similarities than differences. Importantly, we documented that the addition of visual speech significantly increased phonological priming in both groups. Clinically these data support intervention programs that view visual speech as a powerful asset for developing spoken language in C...

show abstract

Section: Methodsmentioning

confidence: 99%

Section: New Distractors: Non-intact Auditory Onsetsmentioning

confidence: 99%

Phonological Priming in Children with Hearing Loss: Effect of Speech Mode, Fidelity, and Lexical Status

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…Specific numbers, ranging from five users to 20 users (See Section 2), have already been suggested despite the fact that more users are typically used for statistical analysis (such as Jerger et al [2014]). There is also a considerable number of views which argue against these suggested numbers [Bevan et al 2003;Alroobaea and Mayhew 2014;Schmettow 2012].…”

Section: Introductionmentioning

confidence: 99%

Eye tracking scanpath analysis on web pages

Eraslan

Yeşi̇lada

Harper

2016

Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research &Amp; Applications

View full text Add to dashboard Cite

The number of users required for usability studies has been a controversial issue over 30 years. Some researchers suggest a certain number of users to be included in these studies. However, they do not focus on eye tracking studies for analysing eye movement sequences of users (i.e., scanpaths) on web pages. We investigate the effects of the number of users on scanpath analysis with our algorithm that was designed for identifying the most commonly followed path by multiple users. Our experimental results suggest that it is possible to approximate the same results with a smaller number of users. The results also suggest that more users are required when they serendipitously browse on web pages in comparison with when they search for specific information or items. We observed that we could achieve 75% similarity to the results of 65 users with 27 users for searching tasks and 34 users for browsing tasks. This study guides researchers to determine the ideal number of users for analysing scanpaths on web pages based on their budget and time.

show abstract

“…Clearly, previous research has shown a greater influence of visual speech on children’s performance when task demands were modified to be more child-appropriate (Desjardins et al, 1997; Lalonde & Holt, 2015). Further, sensitivity to visual speech has been shown to vary in the same children as a function of stimulus/task demands (Jerger, Damian, Tye-Murray & Abdi, 2014). …”

Section: Introductionmentioning

confidence: 99%

Children perceive speech onsets by ear and eye

et al. 2016

Self Cite

View full text Add to dashboard Cite

Adults use vision to perceive low-fidelity speech; yet how children acquire this ability is not well understood. The literature indicates that children show reduced sensitivity to visual speech from kindergarten to adolescence. We hypothesized that this pattern reflects the effects of complex tasks and a growth period with harder-to-utilize cognitive resources, not lack of sensitivity. We investigated sensitivity to visual speech in children via the phonological priming produced by low-fidelity (non-intact onset) auditory speech presented audiovisually (see dynamic face articulate consonant/rhyme b/ag; hear non-intact onset/rhyme: −b/ag) vs. auditorily (see still face; hear exactly same auditory input). Audiovisual speech produced greater priming from four to fourteen years, indicating that visual speech filled in the non-intact auditory onsets. The influence of visual speech depended uniquely on phonology and speechreading. Children – like adults – perceive speech onsets multimodally. Findings are critical for incorporating visual speech into developmental theories of speech perception.

show abstract

Children use visual speech to compensate for non-intact auditory speech

Cited by 35 publications

References 65 publications

Phonological Priming in Children with Hearing Loss: Effect of Speech Mode, Fidelity, and Lexical Status

Phonological Priming in Children with Hearing Loss: Effect of Speech Mode, Fidelity, and Lexical Status

Eye tracking scanpath analysis on web pages

Children perceive speech onsets by ear and eye

Contact Info

Product

Resources

About