Chromatic and Anisotropic Cross-Recurrence Quantification Analysis of Interpersonal Behavior

Cox, Ralf F. A.; Steen, Steffie van der; Guevara, Marlenny; Jonge-Hoekstra, Lisette de; Dijk, Marijn van

doi:10.1007/978-3-319-29922-8_11

Cited by 26 publications

(42 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Generally, such structures indicate instances where behaviors which are briefly expressed by one subsystem are accompanied by episodes of lingering in the matching behavior by the other subsystem. This provides information about the shared dynamics of the gesture–speech interaction, and specifically about the strength and direction of the coupling between the two subsystems, as we shall demonstrate (see Cox et al, 2016 ). Thus far, research using CRQA has focused on diagonal and vertical lines.…”

Section: Methodsmentioning

confidence: 65%

“…To capture the asymmetric dynamic attunement between gestures and speech, we performed anisotropic CRQA ( Cox et al, 2016 ), by calculating recurrence measures for the horizontal and vertical line structures separately and comparing them. The first measure derived from the line structures is ‘Laminarity,’ defined as the proportion of recurrent points that are part of a vertical (LAM V ) or horizontal (LAM H ) line structure.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Asymmetric Dynamic Attunement of Speech and Gestures in the Construction of Children’s Understanding

et al. 2016

Self Cite

View full text Add to dashboard Cite

As children learn they use their speech to express words and their hands to gesture. This study investigates the interplay between real-time gestures and speech as children construct cognitive understanding during a hands-on science task. 12 children (M = 6, F = 6) from Kindergarten (n = 5) and first grade (n = 7) participated in this study. Each verbal utterance and gesture during the task were coded, on a complexity scale derived from dynamic skill theory. To explore the interplay between speech and gestures, we applied a cross recurrence quantification analysis (CRQA) to the two coupled time series of the skill levels of verbalizations and gestures. The analysis focused on (1) the temporal relation between gestures and speech, (2) the relative strength and direction of the interaction between gestures and speech, (3) the relative strength and direction between gestures and speech for different levels of understanding, and (4) relations between CRQA measures and other child characteristics. The results show that older and younger children differ in the (temporal) asymmetry in the gestures–speech interaction. For younger children, the balance leans more toward gestures leading speech in time, while the balance leans more toward speech leading gestures for older children. Secondly, at the group level, speech attracts gestures in a more dynamically stable fashion than vice versa, and this asymmetry in gestures and speech extends to lower and higher understanding levels. Yet, for older children, the mutual coupling between gestures and speech is more dynamically stable regarding the higher understanding levels. Gestures and speech are more synchronized in time as children are older. A higher score on schools’ language tests is related to speech attracting gestures more rigidly and more asymmetry between gestures and speech, only for the less difficult understanding levels. A higher score on math or past science tasks is related to less asymmetry between gestures and speech. The picture that emerges from our analyses suggests that the relation between gestures, speech and cognition is more complex than previously thought. We suggest that temporal differences and asymmetry in influence between gestures and speech arise from simultaneous coordination of synergies.

show abstract

Section: Methodsmentioning

confidence: 65%

Section: Methodsmentioning

confidence: 99%

Asymmetric Dynamic Attunement of Speech and Gestures in the Construction of Children’s Understanding

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…captures the unpredictability of a system's state (i.e., behavioral category). We calculated Shannon entropy by means of the following formula: Recurrence -the re-occurrence of states over time -is a central property of complex dynamical systems, such as the weather, mechanical engines, and also humans (Abney et al, 2014;Cox et al, 2016;Riley & Turvey, 2002;Wijnants et al, 2012). These recurrences are represented in a Recurrence Plot (RP), which, for categorical time series, is created by plotting that time series against itself in a plane and marking all instances that pertain to the same state in x and y with a dot (see Figure 3, panel d).…”

Section: Discussionmentioning

confidence: 99%

“…The Shannon entropy of the frequency HAND MOVEMENTS, SPEECH, AND TASK PROPERTIES [PREPRINT] 17 distribution of the diagonal line lengths gives a measure of complexity of the system (Pellecchia & Shockley, 2005;Webber Jr. & Zbilut, 2005). However, in categorical RQA, vertical and horizontal lines (Cox et al, 2016;Xu et al, 2020), and the rectangular block structures (Leonardi, 2018), are much more informative about a system's dynamics, instead of diagonal lines (also see Figure 3, panel d). Therefore, the Shannon entropy of the frequency distribution of the size of the block structures in the RP is better measure of a system's Complexity, specifically suited for categorical data (Leonardi, 2018).…”

Section: Discussionmentioning

confidence: 99%

Movers and shakers of cognition: Hand movements, speech, task properties, and variability

Jonge-Hoekstra¹,

Steen²,

Cox³

2019

Preprint

Self Cite

View full text Add to dashboard Cite

Children move their hands to explore, learn and communicate about hands-on tasks. Their hand movements seem to be “learning” ahead of speech. Children shape their hand movements in accordance with spatial and temporal task properties, such as when they feel an object or simulate it’s movements. Their speech does not directly correspond to these spatial and temporal task properties, however. We aimed to understand whether and how hand movements’ are leading cognitive development due to their ability to correspond to spatiotemporal task properties, while speech is unable to do so. We explored whether hand movements’ and speech’s variability changed with a change in spatiotemporal task properties, using two variability measures: Diversity indicates adaptation, while Complexity indicates flexibility. In two experiments, we asked children (4-7 years) to predict and explain about balance scale problems, whereby we either manipulated the length of the balance scale or the mass of the weights after half of the trials. In three out of four conditions, we found a change in Complexity for both hand movements and speech between first and second half of the task. In one of these conditions, we found a relation between the differences in Complexity and Diversity of hand movements and speech. Changes in spatiotemporal task properties thus often influenced both hand movements’ and speech’s flexibility, but there seem to be differences in how they did so. We provided many directions for future research, to further unravel the relations between hand movements, speech, task properties, variability, and cognitive development.

show abstract

“…Interrater agreements for assistance provided by mothers, exploratory utensil use by infants, and feeding-relevant utensil use by infants were k D :80, :71, and :78, respectively. The methods of cross-recurrence quantification analysis used in this part of the investigation have been described in detail elsewhere (Cox, van der Steen, Guevara, de Jonge-Hoekstra, & van Dijk, 2016;Warlaumont et al, 2014).…”

Section: Data Codingmentioning

confidence: 99%

Mother-Infant Interaction in the Emergence of a Tool-Using Skill at Mealtime: A Process of Affordance Selection

Nonaka

Goldfield

2018

Ecological Psychology

View full text Add to dashboard Cite

This study provides a detailed description of the process of the emergence of the utensil-using skill of infants to control encounters with food and mother-infant joint action that surrounds the emergence of this context-specific skill. Longitudinal observations from the first contact with a utensil to the beginning of successful selffeeding with a utensil found that there was an extended period of exploratory utensil use that precedes the use of the utensil for the goal of feeding around which adults organized the environment where such feeding-irrelevant activities of the infants were tolerated. Subsequently, adults gradually introduced and highlighted the opportunities for infants' functional feeding encounters, often by adjusting the position of objects on the table. Overall, we found the process of what may be called affordance selection-in which a definite set of opportunities for action among many available were selected by adults to invite certain spontaneous behaviors of developing infants. This study adds to the growing realization that normally occurring experiences of rich affordances matter in the development of specific behavior in a given cultural context.

show abstract

Chromatic and Anisotropic Cross-Recurrence Quantification Analysis of Interpersonal Behavior

Cited by 26 publications

References 27 publications

Asymmetric Dynamic Attunement of Speech and Gestures in the Construction of Children’s Understanding

Asymmetric Dynamic Attunement of Speech and Gestures in the Construction of Children’s Understanding

Movers and shakers of cognition: Hand movements, speech, task properties, and variability

Mother-Infant Interaction in the Emergence of a Tool-Using Skill at Mealtime: A Process of Affordance Selection

Contact Info

Product

Resources

About