Mapping Sonification for Perception and Action in Motor Skill Learning

Dyer, John; Stapleton, Paul; Rodger, Matthew

doi:10.3389/fnins.2017.00463

Cited by 29 publications

(33 citation statements)

References 41 publications

(44 reference statements)

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The use of real-time movement information extends the benefits of discrete rhythmic auditory stimuli by adding an auditory component to the movement cycle either with natural movement sounds or movement sonification (Effenberg, 2005; Sigrist et al, 2013; Effenberg et al, 2016; Bevilacqua et al, 2016; Dyer et al, 2017a). Robust evidence suggests that merely listening to action-related sounds activates the neural processes necessary to produce those sounds (e.g., Aziz-Zadeh et al, 2004; Lewis et al, 2005; Pizzamiglio et al, 2005; Aziz-Zadeh et al, 2006; Gazzola et al, 2006; Caetano et al, 2007; Pazzaglia et al, 2008; Alaerts et al, 2009; Engel et al, 2009; Ticini et al, 2012; reviewed in Aglioti and Pazzaglia, 2010).…”

Section: Resultsmentioning

confidence: 99%

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

et al. 2019

View full text Add to dashboard Cite

The role of auditory information on perceptual-motor processes has gained increased interest in sports and psychology research in recent years. Numerous neurobiological and behavioral studies have demonstrated the close interaction between auditory and motor areas of the brain, and the importance of auditory information for movement execution, control, and learning. In applied research, artificially produced acoustic information and real-time auditory information have been implemented in sports and rehabilitation to improve motor performance in athletes, healthy individuals, and patients affected by neurological or movement disorders. However, this research is scattered both across time and scientific disciplines. The aim of this paper is to provide an overview about the interaction between movement and sound and review the current literature regarding the effect of natural movement sounds, movement sonification, and rhythmic auditory information in sports and motor rehabilitation. The focus here is threefold: firstly, we provide an overview of empirical studies using natural movement sounds and movement sonification in sports. Secondly, we review recent clinical and applied studies using rhythmic auditory information and sonification in rehabilitation, addressing in particular studies on Parkinson’s disease and stroke. Thirdly, we summarize current evidence regarding the cognitive mechanisms and neural correlates underlying the processing of auditory information during movement execution and its mental representation. The current state of knowledge here reviewed provides evidence of the feasibility and effectiveness of the application of auditory information to improve movement execution, control, and (re)learning in sports and motor rehabilitation. Findings also corroborate the critical role of auditory information in auditory-motor coupling during motor (re)learning and performance, suggesting that this area of clinical and applied research has a large potential that is yet to be fully explored.

show abstract

Section: Resultsmentioning

confidence: 99%

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

et al. 2019

View full text Add to dashboard Cite

show abstract

“…However, the observed advantage was diminished at the 24 h post-retention test. Dyer et al (2017) postulate that the “guidance effect” can be avoided if sonification focuses on enhancement of the naturally occurring task feedback. This stance follows the proposal by Jacobs and Michaels (2007) that motor learning is in fact the training of attention to attend to streams of information that are relevant to task performance.…”

Section: Discussionmentioning

confidence: 99%

“…From an ecological psychology perspective, motor skill acquisition can be defined as an improved use and handing of informational variables available in the environment (Jacobs and Michaels, 2007; Huys et al, 2009; Gray, 2010; Huet et al, 2011). In that sense, novices can be described as perceivers with pre-existing skills for perception and action learning who adapt their performance in response to training of their attention (Dyer et al, 2017). Alternatively, the concept of perception guiding action can be referred to as a feed-forward model of human motor control.…”

Section: Introductionmentioning

confidence: 99%

The Limitations of Being a Copycat: Learning Golf Putting Through Auditory and Visual Guidance

et al. 2019

Self Cite

View full text Add to dashboard Cite

The goal of this study was to investigate whether sensory cues carrying the kinematic template of expert performance (produced by mapping movement to a sound or visual cue) displayed prior to and during movement execution can enhance motor learning of a new skill (golf putting) in a group of novices. We conducted a motor learning study on a sample of 30 participants who were divided into three groups: a control, an auditory guide and visual guide group. The learning phase comprised of two sessions per week over a period of 4 weeks, giving rise to eight sessions. In each session participants made 20 shots to three different putting distances. All participants had their measurements taken at separate sessions without any guidance: baseline, transfer (different distances) and retention 2 weeks later. Results revealed a subtle improvement in goal attainment and a decrease in kinematic variability in the sensory groups (auditory and visual) compared to the control group. The comparable changes in performance between the visual and auditory guide groups, particularly during training, supports the idea that temporal patterns relevant to motor control can be perceived similarly through either visual or auditory modalities. This opens up the use of auditory displays to inform motor learning in tasks or situations where visual attention is otherwise constrained or unsuitable. Further research into the most useful template actions to display to learners may thus still support effective auditory guidance in motor learning.

show abstract

“…Movement sonification may represent an innovative strategy to enrich a learning environment and promote the development of movement creativity. It consists of mapping a movement parameter into sound, and depending on how the specified movement parameter (s) change (s) a sound is triggered or changes characteristics, e.g., frequency and amplitude (Effenberg, 2005;Hermann et al, 2011;Dyer et al, 2017). For example, a sound tone is triggered when a joint angle exceeds a certain threshold (e.g., Boocock et al, 2019) or a music melody is progressively distorted in reference to the amplitude of a joint angle increase (e.g., Lorenzoni et al, 2019).…”

Section: Movement Sonificationmentioning

confidence: 99%

“…Given the inherent tight link between movement and sound (Stanton and Spence, 2020), movement sonification has recently gained an increased interest in the motor learning and control field as a suitable strategy to deliver augmented feedback (Sigrist et al, 2013;Dyer et al, 2015). In fact, sonification of a movement parameter has been shown to enhance a multimodal perception of intrinsic feedback (e.g., proprioceptive information) and the dynamics of perception-action coupling (Dyer et al, 2017), typically resulting in improved motor learning and performance (for reviews, see Effenberg et al, 2016;Schaffert et al, 2019). Here, we discuss how movement sonification can also be used to influence movement creativity.…”

Section: Movement Sonificationmentioning

confidence: 99%

A Perspective on Implementing Movement Sonification to Influence Movement (and Eventually Cognitive) Creativity

2020

View full text Add to dashboard Cite

Mapping Sonification for Perception and Action in Motor Skill Learning

Cited by 29 publications

References 41 publications

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

A Review on the Relationship Between Sound and Movement in Sports and Rehabilitation

The Limitations of Being a Copycat: Learning Golf Putting Through Auditory and Visual Guidance

A Perspective on Implementing Movement Sonification to Influence Movement (and Eventually Cognitive) Creativity

Contact Info

Product

Resources

About