Hands-Free Accessible Digital Musical Instruments: Conceptual Framework, Challenges, and Perspectives

Abstract

Exponential increases of available computational resources, miniaturization, and sensors, are enabling the development of digital musical instruments that use non-conventional interaction paradigms and interfaces. This scenario opens up new opportunities and challenges in the creation of accessible instruments to include persons with disabilities into music practice. This work focuses in particular on instruments dedicated to people who can not use limbs, for whom the only means for musical expression are the voice and a small number of traditional instruments. First, a modular and adaptable conceptual framework is discussed for the design of accessible digital musical instruments targeted at performers with motor impairments. Physical interaction channels available from the neck upwards (head, mouth, eyes, brain) are analyzed in terms of potential and limitations for musical interaction. Second, a systematic survey of previously developed instruments is presented: each is analyzed in terms of design choices, physical interaction channels and related sensors, mapping strategies, performer interface and feedback. As a result of this survey, several open research directions are discussed, including the use of unconventional interaction channels, musical control mappings, multisensory feedback, design, evaluation, and adaptation. INDEX TERMS Accessibile interfaces, Music technology, Digital musical instruments, Inclusive music practice VOLUME ...

Accessible Music for Everyone: Discovering Resources

“…Furthermore, the field of accessible digital musical instruments (ADMI), dedicated to instruments designed for people with disabilities, is growing rapidly, with the recognition that adaptations of existing digital musical instruments can promote inclusive music making [14][15][16]. ADMI offer opportunities to engage with a wider range of sounds than acoustic instruments can provide.…”

“…ADMI offer opportunities to engage with a wider range of sounds than acoustic instruments can provide. Some ADMI use eye-tracking through head movements [14][15][16], releasing the user from interfaces dependence such as keyboard and mouse to interact with sounds. Furthermore, some authors have implemented a simple study method, based on a set of exercises, to aid the use of ADMI [16], thus providing greater opportunities for exploration, improvisation, empowerment and fluidity in music production for users with or without SN [14][15][16][17][18][19]22].…”

Looking into the Design of Accessible Musical Instruments for Musicians with Physical Disabilities

“…In particular, our study found that 3 of all 20 instruments were designed with the intention to be controlled in multiple different ways. However, having these various methods of input makes a single instrument highly more useful to a wider range of users -yet these multi-input devices are largely unexplored [8]. Many of the organizations studied within this survey, such as OHMI Trust and Drake Music, frequently work alongside engineering educators and students to develop their prototypes and encourage collaboration between engineers and disabled musicians to create effective, accessible music technology.…”

“…Similarly, there is space for exploring different mappings strategies and more complex mapping cardinalities." [8]. Though prior research has proven the presence of design and study of accessible music instruments, further study must be done to determine how prototypes and past concepts have been effectively used by physically disabled musicians, whether intended for that audience or otherwise proven useful to that audience.…”