Visualization in Audio-Based Music Information Retrieval

Cooper, Matthew; Foote, Jonathan; Pampalk, Elias; Tzanetakis, George

doi:10.1162/comj.2006.30.2.42

Cited by 20 publications

(25 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Considering it is difficult to pre-attentively differentiate classical music from rock music with the MISUAL system, how can an individual expect to classify large music libraries when the differences between genres are so fine? [24] presents further research into static pragmatic visualizations for genre categorization. This paper covers multiple different techniques for music information retrieval visualization.…”

Section: Pragmatic Music Visualizationsmentioning

confidence: 99%

See 1 more Smart Citation

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

Pouris¹

2023

Preprint

View full text Add to dashboard Cite

Visualizations have existed for millennia as ways to communicate information. Visualizations are ubiquitous tools used every day to help navigate cities and aid in learning complex tasks. Tasks are made simpler when applying various visualization methods to large data sets to discover trends that are otherwise difficult to notice. More recently, music visualization systems have been created to convey music in the visual domain; however, they are not based on any psychological model of auditory and visual equivalents. This thesis discusses a music visualization system called MusicViz, which facilitates in the visual communication of the informative and entertainment aspect of music based on psychologically justified translation principals. MusicViz is combined with a vibro-feedback chair called the Emoti-Chair, which translates auditory music to vibrations along the user’s back. The combined system is coined VITA (Visually Immersive and Tactile Animation). A usability evaluation of the VITA showed it is an enjoyable experience.

show abstract

Section: Pragmatic Music Visualizationsmentioning

confidence: 99%

“…This paper covers multiple different techniques for music information retrieval visualization. The commonalities between all the techniques in [24], including MISUAL's, are audio parameterization [24]. Audio is converted to data using Mel-Frequency Cepstral Coefficients, Fourier transforms and/or component analysis [24].…”

Section: Pragmatic Music Visualizationsmentioning

confidence: 99%

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

Pouris¹

2023

Preprint

View full text Add to dashboard Cite

show abstract

“…What matters in the end is the sound as such, not how it has been generated. Music Information Retrieval (MIR) offers methods that can help: Sounds can be classified and searched for by acoustic similarity, partially supported by visualization [3]. However, these methods are clearly limited in that they produce imprecise or wrong results in a substantial number of cases.…”

Section: Problem Settingmentioning

confidence: 99%

“…These data are represented through the spatial distance on the screen. This mapping from the wave form to geometric location employs MelFrequency Cepstral Coefficients and a self-organizing map, standard tools from Music Information Retrieval, which typically are applied to visualize collections of music files as landscapes of genres [3].…”

Section: Overview Of the Proposed Solutionmentioning

confidence: 99%

Aurally and visually enhanced audio search with soundtorch

Heise

Hlatky

Loviscach

2009

CHI '09 Extended Abstracts on Human Factors in Computing Systems

View full text Add to dashboard Cite

Finding a specific or an artistically appropriate sound in a vast collection comprising thousands of audio files containing recordings of, say, footsteps, gunshots, and thunderclaps easily becomes a chore. To improve on this, we have developed an enhanced auditory and graphical zoomable user interface that leverages the human brain's capability to single out sounds from a spatial mixture: The user shines a virtual flashlight onto an automatically created 2D arrangement of icons that represent sounds. All sounds within the light cone are played back in parallel through a surround sound system. A GPU-accelerated visualization facilitates identifying the icons on the screen with acoustic items in the dense cloud of sound. Test show that the user can pick the "right" sounds more quickly and/or with more fun than with standard file-by-file auditioning.

show abstract

“…Given that such annotations are for retrieval purpose only, they will not contribute to the audio content itself. As for presenting audio content, there are lots efforts in terms of abstracting audio elements to visual cues [24] [25]. Among them, RadioActive [14] allows users to dictate voice messages.…”

Section: Related Workmentioning

confidence: 99%

An audio wiki supporting mobile collaboration

Wang

Roe

Pham

et al. 2008

Proceedings of the 2008 ACM Symposium on Applied Computing

View full text Add to dashboard Cite

Wikis have proved to be very effective collaboration and knowledge management tools in large variety of fields thanks to their simplicity and flexible nature. Another important development for the internet is the emergence of powerful mobile devices supported by fast and reliable wireless networks. The combination of these developments begs the question of how to extend wikis on mobile devices and how to leverage mobile devices' rich modalities to supplement current wikis. Realizing that composing and consuming through auditory channel is the most natural and efficient way for mobile device user, this paper explores the use of audio as the medium of wiki. Our work, as the first step towards this direction, creates a framework called Mobile Audio Wiki which facilitates asynchronous audiomediated collaboration on the move. In this paper, we present the design of Mobile Audio Wiki. As a part of such design, we propose an innovative approach for a light-weight audio content annotation system for enabling group editing, versioning and cross-linking among audio clips. To elucidate the novel collaboration model introduced by Mobile Audio Wiki, its four usage modes are identified and presented in storyboard format. Finally, we describe the initial design for presentation and navigation of Mobile Audio Wiki.

show abstract

Visualization in Audio-Based Music Information Retrieval

Cited by 20 publications

References 12 publications

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

Designing, Implementing and Evaluating a Cross-Modal Sensory Substitution System for the Effective Communication of the Emotional and Informative Aspects of Music

Aurally and visually enhanced audio search with soundtorch

An audio wiki supporting mobile collaboration

Contact Info

Product

Resources

About