Mobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument

Michon, Romain; Smith, Julius O.; Wright, Matthew; Chafe, Chris; Granzow, John; Wang, Ge

doi:10.3390/app7121311

Cited by 8 publications

(9 citation statements)

References 20 publications

(20 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…As a result, the projects were explicitly expected to break from the traditional paradigm of musical instruments and present new models of musical expression. Michon et al (2017) presented a framework enabling speedy design and prototyping of passive mobile device augmentations. This framework was suitable for developers with a background in music and sound design.…”

Section: Background and Related Workmentioning

confidence: 99%

Music Technology Education and a Plugin-Based Platform as a Tool to Enhance Creativity, Multidisciplinarity, Creative Design, and Collaboration Skills

Peretz¹,

Hollander²,

Harel³

2021

JEP

View full text Add to dashboard Cite

Music technology is known to have the ability to enhance creativity and creative development among students. A high level of engagement has been shown among students who studied and developed musical projects, and among students who were intellectually involved in the process of meaningful exploration. When students develop a music technology project, they use their software design skills to build and combine different artistic and computational components. Here we present a creative education method for computer science and software engineering students, it uses Muzilator, a plugin-based web platform that enables developers to develop a project as a set of independent web applications (plugins). Students can share their plugins with others or use plugins developed by others. We examined 75 projects of teams of computer science students who participated in a Computer Music course. We studied the characteristics of these projects and Muzilator's effectiveness as a creative education and collaboration tool. Some of our results show that Muzilator-based projects received higher creativity and multidisciplinarity ratings than did other projects, and that high-risk projects were more creative and artistic than low-risk ones. We also found a gender-dependency: women tended more than men to develop interactive applications, while men tended to choose more theoretic (algorithmic), non-interactive projects.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Music Technology Education and a Plugin-Based Platform as a Tool to Enhance Creativity, Multidisciplinarity, Creative Design, and Collaboration Skills

Peretz¹,

Hollander²,

Harel³

2021

JEP

View full text Add to dashboard Cite

show abstract

“…MHDs have very particular sensors and actuators, which are endemic to them and fundamental to their operability. In addition to the many sensors and actuators bundled with the MHDs, there are several projects and prototypes that aim to expand their control methods and sensory feedback with external add-ons (a comprehensive breakdown of augmenting approaches is available in [20]). However, an MHD self-contained DMI must conform to the device specifications and available capabilities.…”

Section: Device Specificationsmentioning

confidence: 99%

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

Clement

Moreira

Rosa

et al. 2021

MTI

View full text Add to dashboard Cite

Mobile handheld devices, such as smartphones and tablets, have become some of the most prominent ubiquitous terminals within the information and communication technology landscape. Their transformative power within the digital music domain changed the music ecosystem from production to distribution and consumption. Of interest here is the ever-expanding number of mobile music applications. Despite their growing popularity, their design in terms of interaction perception and control is highly arbitrary. It remains poorly addressed in related literature and lacks a clear, systematized approach. In this context, our paper aims to provide the first steps towards defining guidelines for optimal sonic interaction design practices in mobile music applications. Our design approach is informed by user data in appropriating mobile handheld devices. We conducted an experiment to learn links between control gestures and musical parameters, such as pitch, duration, and amplitude. A twofold action—reflection protocol and tool-set for evaluating the aforementioned links—are also proposed. The results collected from the experiment show statistically significant trends in pitch and duration control gesture mappings. On the other hand, amplitude appears to elicit a more diverse mapping approach, showing no definitive trend in this experiment.

show abstract

“…Smartphone has already been used as musical instruments in some studies [9], [10]. In 2013, a study related to gamelan and Augmented Reality was conducted by [8].…”

Section: Related Workmentioning

confidence: 99%

Development of Augmented Reality (AR) Based Gamelan Simulation with Leap Motion Control

Permana

Tolle

Utaminingrum

et al. 2019

Int. J. Interact. Mob. Technol.

View full text Add to dashboard Cite

One of the traditional musical instrument from Indonesia is gamelan, that is now less desirable because people nowadays prefer to play modern musical instruments, or because of its expensive price. This study combines the modern technology of AR and Leap Motion and also utilizes the sophisticated smartphone to develop a gamelan simulation that is presentable to the user. There are two kinds of an experiment performed in this research. The first is Augmented Reality (AR) experiment which authenticates that the distance and the height parameters are the keys to get a 100% success in running the gamelan simulation. The distance is ranged from 45 cm to 65 cm and the height is ranged from 25 cm to 30 cm. And the second one is the usability evaluation to five users, who resolves the completion task very well, acquires the result of 86.48%.

show abstract

Mobile Music, Sensors, Physical Modeling, and Digital Fabrication: Articulating the Augmented Mobile Instrument

Cited by 8 publications

References 20 publications

Music Technology Education and a Plugin-Based Platform as a Tool to Enhance Creativity, Multidisciplinarity, Creative Design, and Collaboration Skills

Music Technology Education and a Plugin-Based Platform as a Tool to Enhance Creativity, Multidisciplinarity, Creative Design, and Collaboration Skills

Musical Control Gestures in Mobile Handheld Devices: Design Guidelines Informed by Daily User Experience

Development of Augmented Reality (AR) Based Gamelan Simulation with Leap Motion Control

Contact Info

Product

Resources

About