Making Math Graphs More Accessible in Remote Learning: Using Sonification to Introduce Discontinuity in Calculus

Ohshiro, Keita; Hurst, Amy; DuBois, Luke

doi:10.1145/3441852.3476533

Cited by 8 publications

(1 citation statement)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Previous researchers have explored ways to enhance similar crafting activities, such as knitting and weaving, through sonification [3,6]. The benefits of sonification have been explored in multiple contexts such as to improve performance in training for sports [10] and to make visual elements more accessible for the visually impaired [5,8]. In [6] the authors note how sonification made knitting a much more engaging experience and encouraged participants to experiment with their technique.…”

Section: Introductionmentioning

confidence: 99%

Cro-Create: Weaving Sound Using Crochet Gestures

Bruen,

Kwon,

Jeon

2023

Creativity and Cognition

View full text Add to dashboard Cite

Cro-Create is a crochet gesture recognition sonifier for individual and collaborative use. In single user mode, Cro-Create directly scales and maps numerical palm orientation values detected by a motion sensor to sound. In dual user mode, the system affords users with additional auditory feedback by detecting when two users' gestures are synchronized by segmenting the gestural procedure of making a stitch in crochet into three stages and utilizing a dynamic time warping algorithm to classify and recognize these stages; when the system determines that both users have produced the same gesture, the sonification is complemented by a distinguishable chord. Through this demonstration we introduce our tool to share procedural state for the physical craftmaking process, crochet, through sound. CCS CONCEPTS• Human-centered computing → Collaborative and social computing devices; Collaborative interaction; Auditory feedback; Gestural input.

show abstract