Synchronization between preverbal vocal behavior and motor action in early infancy. II: An acoustical examination of the functional significance of the synchronization.

Ejiri, Keiko; Masataka, Nobuo

doi:10.4992/jjpsy.69.433

Cited by 4 publications

(2 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…At 2 mo, infants can remember and discriminate rhythms and melodies ( 34 , 35 ), and they also first show clear evidence of actively engaging with others in a socially contingent and interactive manner ( 36 ): they coo in response to faces ( 37 ), begin to use eye contact contingently ( 27 , 33 ), and smile reciprocally in relation to caregiver vocalization and affective state ( 37 ). Later, by the age of 6 mo, infants are already highly experienced in musical games ( 38 ) and face-to-face play ( 39 ), and they increasingly produce their own rhythmic behaviors [such as rhythmic babbling and hand movements ( 40 )].…”

mentioning

confidence: 99%

Music of infant-directed singing entrains infants’ social visual behavior

Lense

Shultz

Astésano

et al. 2022

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

Infant-directed singing is a culturally universal musical phenomenon known to promote the bonding of infants and caregivers. Entrainment is a widely observed physical phenomenon by which diverse physical systems adjust rhythmic activity through interaction. Here we show that the simple act of infant-directed singing entrains infant social visual behavior on subsecond timescales, increasing infants’ looking to the eyes of a singing caregiver: as early as 2 months of age, and doubling in strength by 6 months, infants synchronize their eye-looking to the rhythm of infant-directed singing. Rhythmic entrainment also structures caregivers’ own cueing, enhancing their visual display of social-communicative content: caregivers increase wide-eyed positive affect, reduce neutral facial affect, reduce eye motion, and reduce blinking, all in time with the rhythm of their singing and aligned in time with moments when infants increase their eye-looking. In addition, if the rhythm of infant-directed singing is experimentally disrupted—reducing its predictability—then infants’ time-locked eye-looking is also disrupted. These results reveal generic processes of entrainment as a fundamental coupling mechanism by which the rhythm of infant-directed singing attunes infants to precisely timed social-communicative content and supports social learning and development.

show abstract

mentioning

confidence: 99%

Music of infant-directed singing entrains infants’ social visual behavior

Lense

Shultz

Astésano

et al. 2022

Proc. Natl. Acad. Sci. U.S.A.

View full text Add to dashboard Cite

show abstract

“…A parallel transition between two rates of vocal production can be observed in human speech development. In the first year of life, infants begin to produce rhythmic babblings (repeated consonant-vowel-like sequences like 'bababa') synchronized with mouth open-close cycles that are below 3 Hz [68] and coordinated with rhythmic limb movements [69][70][71][72][73]. From slower and more variable vocal rhythms in infancy, faster and more regular envelope-mouth synchronization above 4 Hz as in adult speech emerge gradually during development [8,74].…”

Section: Two Rates Of Av Regularitymentioning

confidence: 99%

Untitled

View full text Add to dashboard Cite

Modulation transfer functions for audiovisual speech

et al. 2022

View full text Add to dashboard Cite

Temporal synchrony between facial motion and acoustic modulations is a hallmark feature of audiovisual speech. The moving face and mouth during natural speech is known to be correlated with low-frequency acoustic envelope fluctuations (below 10 Hz), but the precise rates at which envelope information is synchronized with motion in different parts of the face are less clear. Here, we used regularized canonical correlation analysis (rCCA) to learn speech envelope filters whose outputs correlate with motion in different parts of the speakers face. We leveraged recent advances in video-based 3D facial landmark estimation allowing us to examine statistical envelope-face correlations across a large number of speakers (∼4000). Specifically, rCCA was used to learn modulation transfer functions (MTFs) for the speech envelope that significantly predict correlation with facial motion across different speakers. The AV analysis revealed bandpass speech envelope filters at distinct temporal scales. A first set of MTFs showed peaks around 3-4 Hz and were correlated with mouth movements. A second set of MTFs captured envelope fluctuations in the 1-2 Hz range correlated with more global face and head motion. These two distinctive timescales emerged only as a property of natural AV speech statistics across many speakers. A similar analysis of fewer speakers performing a controlled speech task highlighted only the well-known temporal modulations around 4 Hz correlated with orofacial motion. The different bandpass ranges of AV correlation align notably with the average rates at which syllables (3-4 Hz) and phrases (1-2 Hz) are produced in natural speech. Whereas periodicities at the syllable rate are evident in the envelope spectrum of the speech signal itself, slower 1-2 Hz regularities thus only become prominent when considering crossmodal signal statistics. This may indicate a motor origin of temporal regularities at the timescales of syllables and phrases in natural speech.

show abstract

Synchronization between preverbal vocal behavior and motor action in early infancy. II: An acoustical examination of the functional significance of the synchronization.

Cited by 4 publications

References 0 publications

Music of infant-directed singing entrains infants’ social visual behavior

Music of infant-directed singing entrains infants’ social visual behavior

Untitled

Modulation transfer functions for audiovisual speech

Contact Info

Product

Resources

About