Visualization of music performance as an aid to listener's comprehension

Hiraga, Rumi; Matsuda, Noriyuki

doi:10.1145/989863.989878

Cited by 13 publications

(4 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Crossmodal interfaces present information intended for one type of display using a different type of display modality, such as using vibrations to represent sound [1], sound to represent images [2]; [3], or images to represent sound [4]. These interfaces are used to augment existing modalities with an extraneous modality, such as music visualizations [5] to replace one modality with stimuli from another.…”

Section: A Backgroundmentioning

confidence: 99%

Enhancing entertainment through a multimodal chair interface

Branje

Karam

Fels

et al. 2009

2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH)

View full text Add to dashboard Cite

The Emoti-Chair is a new universal design for a multimodal entertainment chair to create a tactile entertainment experience for accompanying audio/visual presentations. We presented the Emoti-Chair as part of an exhibit at a public science museum focusing on children's perspectives on global warming and energy use. We asked museum-goers who experienced the chair to answer questions about their experience in the Emoti-Chair. Major findings indicated that the chair was generally found to be comfortable and enjoyable and that young children enjoyed the experience more than adults or youth.

show abstract

Section: A Backgroundmentioning

confidence: 99%

Enhancing entertainment through a multimodal chair interface

Branje

Karam

Fels

et al. 2009

2009 IEEE Toronto International Conference Science and Technology for Humanity (TIC-STH)

View full text Add to dashboard Cite

show abstract

“…Hiraga also presents research alongside Noriyki in the paper titled, Visualization of Music Performance as an Aid to Listener's Comprehension [26]. The goal of the research is to provide a static and pragmatic music visualization to aid listeners in understanding a musical performance.…”

Section: Pragmatic Music Visualizationsmentioning

confidence: 99%

“…The authors utilize three major elements of music: (1) tempo change; (2) articulation; and (2) dynamics change. They are utilized to create a static visualization that expresses the emotional characteristics of music [26]. It is interesting that the authors claim to create a visualization that aids listener's comprehension, yet claim to express the complex emotions of music without utilizing colour, animation or a psychological model of audio-tovisual translations.…”

Section: Pragmatic Music Visualizationsmentioning

confidence: 99%

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

Pouris¹

2023

Preprint

View full text Add to dashboard Cite

Visualizations have existed for millennia as ways to communicate information. Visualizations are ubiquitous tools used every day to help navigate cities and aid in learning complex tasks. Tasks are made simpler when applying various visualization methods to large data sets to discover trends that are otherwise difficult to notice. More recently, music visualization systems have been created to convey music in the visual domain; however, they are not based on any psychological model of auditory and visual equivalents. This thesis discusses a music visualization system called MusicViz, which facilitates in the visual communication of the informative and entertainment aspect of music based on psychologically justified translation principals. MusicViz is combined with a vibro-feedback chair called the Emoti-Chair, which translates auditory music to vibrations along the user’s back. The combined system is coined VITA (Visually Immersive and Tactile Animation). A usability evaluation of the VITA showed it is an enjoyable experience.

show abstract

“…Initiatives with the goal of making the music search process more efficient focus on visualizations which convey the acoustical properties of music such as pitch, tempo and musical structure [6,7,8,9,10,11].…”

Section: Introductionmentioning

confidence: 99%

A Novel Interface for Audio Search

Ali

Aarabi

2006

2006 IEEE International Conference on Multimedia and Expo

View full text Add to dashboard Cite

In this paper a novel cyclic interface for searching through a song database is proposed. The method, which merges multiple audio streams on a server and broadcasts only a single merged stream, allows the user to hear different parts of each audio stream by cycling through all available streams. Experimental results on 21 users illustrate that the proposed interface requires less listening time as compared to traditional list-based interfaces when the desired song/audio clip is among one of the audio streams. The average search time for the proposed interface was 7.3 seconds, compared to 12.1 seconds for the traditional list-based interface when searching for a song which is included among the audio streams.

show abstract

Visualization of music performance as an aid to listener's comprehension

Cited by 13 publications

References 5 publications

Enhancing entertainment through a multimodal chair interface

Enhancing entertainment through a multimodal chair interface

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

A Novel Interface for Audio Search

Contact Info

Product

Resources

About