Issues in Auditory Display

Eldridge, Alice

doi:10.1162/artl.2006.12.2.259

Cited by 15 publications

(12 citation statements)

References 38 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…• H2: STS patterns with distinct structural traits (e.g., failed attempts) that manifest across multiple movement features will be classified with greater accuracy, confidence, and speed than others (Vinken et al, 2013). • H3: Repeated exposure to the sonified sequences over the course of the experiment will lead to learning effects that manifest as increased accuracy, increased confidence and decreased response time (Eldridge, 2006;Vinken et al, 2013).…”

Section: Hypothesesmentioning

confidence: 99%

An Embodied Sonification Model for Sit-to-Stand Transfers

2022

View full text Add to dashboard Cite

Interactive sonification of biomechanical quantities is gaining relevance as a motor learning aid in movement rehabilitation, as well as a monitoring tool. However, existing gaps in sonification research (issues related to meaning, aesthetics, and clinical effects) have prevented its widespread recognition and adoption in such applications. The incorporation of embodied principles and musical structures in sonification design has gradually become popular, particularly in applications related to human movement. In this study, we propose a general sonification model for the sit-to-stand (STS) transfer, an important activity of daily living. The model contains a fixed component independent of the use-case, which represents the rising motion of the body as an ascending melody using the physical model of a flute. In addition, a flexible component concurrently sonifies STS features of clinical interest in a particular rehabilitative/monitoring situation. Here, we chose to represent shank angular jerk and movement stoppages (freezes), through perceptually salient pitch modulations and bell sounds. We outline the details of our technical implementation of the model. We evaluated the model by means of a listening test experiment with 25 healthy participants, who were asked to identify six normal and simulated impaired STS patterns from sonified versions containing various combinations of the constituent mappings of the model. Overall, we found that the participants were able to classify the patterns accurately (86.67 ± 14.69% correct responses with the full model, 71.56% overall), confidently (64.95 ± 16.52% self-reported rating), and in a timely manner (response time: 4.28 ± 1.52 s). The amount of sonified kinematic information significantly impacted classification accuracy. The six STS patterns were also classified with significantly different accuracy depending on their kinematic characteristics. Learning effects were seen in the form of increased accuracy and confidence with repeated exposure to the sound sequences. We found no significant accuracy differences based on the participants' level of music training. Overall, we see our model as a concrete conceptual and technical starting point for STS sonification design catering to rehabilitative and clinical monitoring applications.

show abstract

Section: Hypothesesmentioning

confidence: 99%

An Embodied Sonification Model for Sit-to-Stand Transfers

2022

View full text Add to dashboard Cite

show abstract

“…Their hypothesis emphasized that real-time feedback is critical for PD gait rehabilitation because “closer feedback to the time of action” facilitates the learning process. Their strategy seemed potentially effective as their participants who received five sessions of training for two to three weeks exhibited greater audiovisual scores, enhanced percentage of good steps, and homogeneous cadence, although a small sample size of six participants sometimes raises questions about the validity of such results [ 6 ]. The work of Carvalho et al was based on the “auditory alarm” variant of auditory AF, which produces sound without tone modulation when the movement variable exceeds the allocated threshold.…”

Section: Reviewmentioning

confidence: 99%

The Role of Augmented Feedback on Motor Learning: A Systematic Review

Moinuddin¹,

Goel²,

Sethi³

2021

Cureus

View full text Add to dashboard Cite

In motor learning, augmented feedback (AF) is the information provided by sources outside the body and encompasses visual feedback, auditory feedback, and multimodal augmented feedback. This review aims to examine the most recent evidence on these different modality types in healthy and diseased populations and athletes. The reporting of this review was guided by the standards of the “Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA)” statement with the aim to examine the most recent evidence on these feedback types in healthy and diseased populations and athletes. The literature search for this review has been limited to electronic journals with the search engines ISI Web of Knowledge, OvidSP EMBASE, and PubMed databases. This review considers visual feedback as the cornerstone of all augmented feedback types by citing its superiority in learning complex skills by medical students and balance maintenance by older adults. The review also deciphers the role of auditory augmented feedback in encumbering already burdened visual connections in the rehabilitation of patients with Parkinson’s disease (PD) and prosthetic limbs and further argues why the multimodal feedback model seems to be the most efficient way to offer feedback in learning motor tasks by alluding to multifaceted “skill training communication model” in the prevention of sports injuries such as anterior cruciate ligament tears. Multimodal augmented feedback seems to be the most effective and appropriate way to give feedback during motor learning in healthy and diseased populations and athletes as its stimuli are perceived faster and tend to be retained longer compared with the unimodal stimuli of auditory and visual feedback mechanisms.

show abstract

“…5 Compared to visual feedback, auditory feedback can reduce perceptual and cognitive workload as well as distraction. 128,129 There is research on electronic textile sensors and auditory feedback used in lower limb monitoring and interactive biofeedback. 130 To the best of our knowledge, use of this feedback method in combination with a neuro–computer interface has not yet been reported.…”

Section: Human Intent–controlled Neurostimulation and Sensory Feedbackmentioning

confidence: 99%

A review: Motor rehabilitation after stroke with control based on human intent

Xie

et al. 2018

Proc Inst Mech Eng H

View full text Add to dashboard Cite

Strokes are a leading cause of acquired disability worldwide, and there is a significant need for novel interventions and further research to facilitate functional motor recovery in stroke patients. This article reviews motor rehabilitation methods for stroke survivors with a focus on rehabilitation controlled by human motor intent. The review begins with the neurodevelopmental principles of motor rehabilitation that provide the neuroscientific basis for intuitively controlled rehabilitation, followed by a review of methods allowing human motor intent detection, biofeedback approaches, and quantitative motor rehabilitation assessment. Challenges for future advances in motor rehabilitation after stroke using intuitively controlled approaches are addressed.

show abstract

Issues in Auditory Display

Cited by 15 publications

References 38 publications

An Embodied Sonification Model for Sit-to-Stand Transfers

An Embodied Sonification Model for Sit-to-Stand Transfers

The Role of Augmented Feedback on Motor Learning: A Systematic Review

A review: Motor rehabilitation after stroke with control based on human intent

Contact Info

Product

Resources

About