A User-Defined Gesture Set for Music Interaction in Immersive Virtual Environment

Leng, Hoo Yong; Norowi, Noris Mohd; Jantan, Azrul Hazri

doi:10.1145/3077343.3077348

Cited by 13 publications

(1 citation statement)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To realize this, we gathered requirements from potential users, namely professional gamelan musicians to give insights into designing the virtual bonang. In music interaction, user requirements are elicited in various types of projects such as mid-air interaction (Brown et al, 2018;Leng et al, 2018), gesture recognition (Françoise & Bevilacqua, 2018), motivations for building new DMIs (Emerson & Egermann, 2020), user-defined gestures (Leng et al, 2017), as well as evaluations of DMI (Brown et al, 2020). In our work, we seek to find out the requirements to design a natural virtual musical instrument of the Malay bonang.…”

Section: Introductionmentioning

confidence: 99%

Playing Gamelan Bonang in the Air: User Requirements for Designing a Digital Musical Instrument for the Malay Bonang

Ahmad Saffian,

Mohd Norowi,

Abdullah

et al. 2022

MJM

View full text Add to dashboard Cite

In recent years, computer technologies have been impactful in the design and development of Digital Musical Instruments (DMIs). As music interaction became prominent in the Human-Computer Interaction (HCI) field, emphasis on user requirement upon the design of musical interfaces has also grown since the last decade. Although designing new DMIs is becoming very popular, it is often determined by the designers and often not reflective of users’ needs. In this study, we explored user requirements for the design of a virtual musical instrument of the Malay bonang, an instrument found in the Malay gamelan ensemble. The requirements were elicited from a group of gamelan experts to establish the bonang playing techniques to be mapped to the virtual instrument which we called Air Bonang. Findings revealed that in designing the Air Bonang that is natural and expressive, the fundamental playing techniques of the bonang should be integrated into the system using mid-air interaction. In addition, exploratory techniques might also be integrated into the Air Bonang to leverage musical expression. The outcome of the study proposes design criteria that encompass three aspects of a natural Air Bonang, namely, embodiment, expressiveness, and feedback.

show abstract