Aspects of Auditory Perception and Cognition for Usable Display Resolution in Data Sonification

Abstract

Abstract. Sonification of data via the mapping of values to frequency of sound is an auditory data analysis technique commonly used to display graph information. The goal for any form of graph is to display numerical information with accuracy and neutrality while exploiting perceptual and cognitive processes. Conveying information in frequency of sound is subject to aspects of pitch perception, largely overlooked to date, that can influence these properties of auditory graphing. This paper identifies some of these aspects and describes potential design limitations and opportunities derived from the musical nature of auditory data representations.

Focused Audification and the optimization of its parameters

“…Earlier research [3,15] recommended using musical pitches (e.g., MIDI notes following the Western 12-tone scale) mapped to the y-axis and time to the x-axis. The Sonification Sandbox [4] was possibly the largest effort to develop a general tool for auditory graphs in such a way.…”

Switching sensory domains

“…Joe Davis' explorations of audio microscopy has enabled him to identify bacteria under a self developed audiomicroscope by listening to the specific audio signatures created by the bacteria floating by [2]. This is an unusual approach situated between the arts and sciences, and sonification is being used in a variety of research fields [5].…”