User-Centric Context-Aware Mobile Applications for Embodied Music Listening

Camurri, Antonio; Volpe, Gualtiero; Vinet, Hugues; Bresin, Roberto; Fabiani, Marco; Dubus, Gaël; Maestre, Esteban; Casamada, Jordi Llop; Kleimola, Jari; Oksanen, Sami; Välimäki, Vesa; Seppänen, Jarno

doi:10.1007/978-3-642-12630-7_3

Cited by 6 publications

(5 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Instances of the model and of the system that can be experienced through a hand-held mobile device have been developed in the framework of the EU ICT SAME Project: sample videos of the systems are available on the Web 4 [Camurri et al 2009]. Besides the obviously needed changes in the way navigation is performed and expressive features are extracted, such applications would allow active listening to music at home or in other personal environments without the need of large surfaces or complex video tracking systems.…”

Section: Discussionmentioning

confidence: 99%

A system for embodied social active listening to sound and music content

Volpe

Camurri

2011

J. Comput. Cult. Herit.

Self Cite

View full text Add to dashboard Cite

This article introduces a model and a system for embodied social active listening to sound and music content. The model is based on the simultaneous navigation/exploration of multiple maps, starting from a low-level physical map, up to a high-level emotional, affective map. The paper discusses the concepts underlying such a model, the system implementing it, and two concrete examples: The Orchestra Explorer designed for the Museo degli Strumenti Musicali at Accademia Nazionale di Santa Cecilia, Roma, Italy, and the interactive dance and music performance The Bow Is bent and Drawn (composer Nicola Ferrari), presented at Casa Paganini, Genova, Italy, in occasion of the opening concert of the 8th Intl. Conference on New Interfaces for Musical Expression (NIME08), June 4, 2008, and in museum interactive experiences at Festival della Scienza, Genova. This work is part of current research at Casa Paganini—InfoMus on embodied social active listening to sound and music content through the analysis and processing of expressiveness in human full-body movement and gesture. A user-centric interactive multimedia system architecture is proposed, operating on prerecorded music. From the perspective of valorization of cultural heritage, this research provides engaging paradigms of interaction with prerecorded music content, enabling a large number of nonexpert users to rediscover the musical heritage (e.g., classical and contemporary music) they may not be familiar with. Research was carried out in the framework of the EU-ICT Project SAME (Sound and Music for Everyone, Everyday, Everywhere, Every Way, www.sameproject.eu, 2008–2010) and has been recently extended to active experience of audiovisual content, and in particular to cultural heritage and museum scenarios: the novel interactive permanent museum exhibition Viaggiatori di Sguardo has been designed and developed at Palazzo Ducale, Genova, enabling visitors to explore virtually the UNESCO Heritage Palazzi dei Rolli in Genova

show abstract

Section: Discussionmentioning

confidence: 99%

A system for embodied social active listening to sound and music content

Volpe

Camurri

2011

J. Comput. Cult. Herit.

Self Cite

View full text Add to dashboard Cite

show abstract

“…A survey of music applications like those described in the previous Sections (Sync'n'Move, Audio Explorer, Zagora) have been presented and evaluated at the Agora Festival (IR-CAM, Paris, France, June 2009) [7]. Starting from usability questionnaires filled up by about 30 participants we inferred that users generally liked the SAME platform applications.…”

Section: Platform Evaluationmentioning

confidence: 99%

“…The Zagora server application [7] exploits such features to detect the user environmental situation using audio analysis. Based on such a contextual information, Zagora generates a music playlist pertinent to the current location or activity.…”

Section: Context Descriptors Extractionmentioning

confidence: 99%

Human movement expressivity for mobile active music listening

Mancini

Varni

Kleimola

et al. 2010

J Multimodal User Interfaces

Self Cite

View full text Add to dashboard Cite

In this paper we describe the SAME networked platform for context-aware, experience-centric mobile music applications, and we present an implementation of the SAME active music listening paradigm: the Mobile Conductor. It allows the user to express herself in conducting a virtual ensemble playing a MIDI piece of music by means of her mobile phone. The mobile phone detects the user’s hand movement and molds the music performance style by modulating its speed, volume, and intonation

show abstract

“…Indeed, music is a media for expressing emotional states, moods, personality traits and stances [3], and music performance is an inherently expressive and social activity.…”

Section: Introductionmentioning

confidence: 99%

Social retrieval of music content in multi-user performance

Mancini¹,

Volpe²,

Varni³

et al. 2015

EAI Endorsed Transactions on Creative Technologies

Self Cite

View full text Add to dashboard Cite

An emerging trend in interactive music performance consists of the audience directly participating in the performance by means of mobile devices. This is a step forward with respect to concepts like active listening and collaborative music making: non-expert members of an audience are enabled to directly participate in a creative activity such as the performance. This requires the availability of technologies for capturing and analysing in real-time the natural behaviour of the users/performers, with particular reference to nonverbal expressive and social behaviour. This paper presents a prototype of a non-verbal expressive and social search engine and active listening system, enabling two teams of non-expert users to act as performers. The performance consists of real-time sonic manipulation and mixing of music pieces selected according to features characterising performers' movements captured by mobile devices. The system is described with specific reference to the SIEMPRE Podium Performance, a non-verbal socio-mobile music performance presented at the Art & ICT Exhibition that took place in Vilnius (LI) in November 2013.

show abstract

User-Centric Context-Aware Mobile Applications for Embodied Music Listening

Cited by 6 publications

References 4 publications

A system for embodied social active listening to sound and music content

A system for embodied social active listening to sound and music content

Human movement expressivity for mobile active music listening

Social retrieval of music content in multi-user performance

Contact Info

Product

Resources

About