Intelligible Sonifications

Worrall, David

doi:10.1007/978-3-030-01497-1_4

Cited by 3 publications

(4 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Non-linear waves in the study of the brain [10] and the growing area of Sonification, in which sounds are used to represent the dynamic patterns of nature in time (see [11,12]). Pereira Jr and de Aguiar [13] have also acknowledged the relevance of gesture studies, bio semiotics, and the philosophy of feeling of Susanne Langer as important sources of inspiration.…”

Section: Basics Of Sentiomicsmentioning

confidence: 99%

Untitled

2024

J. Multiscale Neurosci.

View full text Add to dashboard Cite

Sentience, defined as the capacity of feeling, for example, to experience basic sensations such as hunger, thirst and other types of qualitative mental states, is a psychobiological phenomenon that involves dynamic patterns of electrochemical (below 1Hz) and electromagnetic (above 1Hz) waves in living systems. The science we have called Sentiomics studies unconscious dynamic patterns in the brain that define the capacity for feeling. This paper discusses the explanation of creative processes based on unconscious patterns that combine and constructively interfere, generating a conscious output experienced in the living system's first-person perspective. We claim that the Sentiomics approach to wave interferences helps to explain creative intuition, artistic creativity, the formation of dreams, and related phenomena. We raise a hypothesisbased on available evidence, to be experimentally testedthat the dominance of slower synchronized oscillatory frequencies (such as Delta, Theta and Alpha bands) in scalp electroencephalogram spectra makes more room for constructive electrochemical interferences supporting creativity. This research points to the dynamism of the unconscious mind, since such interferences happen without the need of conscious control but are influenced by the degree of attention focusing. Once those dynamic processes are understood, they can be used to enrich mental life, boost creativity in general, and improve decision-making processes.

show abstract

Section: Basics Of Sentiomicsmentioning

confidence: 99%

Untitled

2024

J. Multiscale Neurosci.

View full text Add to dashboard Cite

show abstract

“…Hermann’s taxonomy from 2008 [ 3 ] provides a detailed definition of sonification and auditory display in a scientific context. The Sonification Handbook gave another overview of the field in 2011 [ 2 ], and Worrall’s Sonification Design [ 39 ] put another focus on both theory and design of sonifications in 2019.…”

Section: Related Workmentioning

confidence: 99%

Towards a unified terminology for sonification and visualization

Enge,

Rind,

Iber

et al. 2023

Pers Ubiquit Comput

View full text Add to dashboard Cite

Both sonification and visualization convey information about data by effectively using our human perceptual system, but their ways to transform the data differ. Over the past 30 years, the sonification community has demanded a holistic perspective on data representation, including audio-visual analysis, several times. A design theory of audio-visual analysis would be a relevant step in this direction. An indispensable foundation for this endeavor is a terminology describing the combined design space. To build a bridge between the domains, we adopt three of the established theoretical constructs from visualization theory for the field of sonification. The three constructs are the spatial substrate, the visual mark, and the visual channel. In our model, we choose time to be the temporal substrate of sonification. Auditory marks are then positioned in time, such as visual marks are positioned in space. Auditory channels are encoded into auditory marks to convey information. The proposed definitions allow discussing visualization and sonification designs as well as multi-modal designs based on a common terminology. While the identified terminology can support audio-visual analytics research, it also provides a new perspective on sonification theory itself.

show abstract

“…The design framework proposed by Barrass [Bar12] emphasizes the fusion of aesthetics and functionality to improve the accessibility and meaningfulness of sonifications for a broader audience. The work of Worrall in 2019 [Wor19b] formalized sonification techniques into a framework that also highlighted the challenges and advantages of these sonification techniques, as well as the importance of understanding processes and choices that influence sound representation. The sonification design canvas , introduced by Lenzi in 2021 [Len21], is a contribution to the construction of a more comprehensive design framework, with the aim of integrating all aspects into a cohesive design tool.…”

Section: Introductionmentioning

confidence: 99%

“…More than 30 years after the beginning of systematic sonification research, we saw a considerable number of theoretical contributions to the field [Kra94,KWB*99,VH06,dC07,NW08,HHN11,GH12, Sup12, Nee19, Neu19, Wor19b, Len21]. Explicit work integrating sonification and visualization theory is rare, but has been called for [RW10].…”

Section: Introductionmentioning

confidence: 99%

Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and Visualization

Enge,

Elmquist,

Caiola

et al. 2024

Computer Graphics Forum

View full text Add to dashboard Cite

The research communities studying visualization and sonification for data display and analysis share exceptionally similar goals, essentially making data of any kind interpretable to humans. One community does so by using visual representations of data, and the other community employs auditory (non‐speech) representations of data. While the two communities have a lot in common, they developed mostly in parallel over the course of the last few decades. With this STAR, we discuss a collection of work that bridges the borders of the two communities, hence a collection of work that aims to integrate the two techniques into one form of audiovisual display, which we argue to be “more than the sum of the two.” We introduce and motivate a classification system applicable to such audiovisual displays and categorize a corpus of 57 academic publications that appeared between 2011 and 2023 in categories such as reading level, dataset type, or evaluation system, to mention a few. The corpus also enables a meta‐analysis of the field, including regularly occurring design patterns such as type of visualization and sonification techniques, or the use of visual and auditory channels, showing an overall diverse field with different designs. An analysis of a co‐author network of the field shows individual teams without many interconnections. The body of work covered in this STAR also relates to three adjacent topics: audiovisual monitoring, accessibility, and audiovisual data art. These three topics are discussed individually in addition to the systematically conducted part of this research. The findings of this report may be used by researchers from both fields to understand the potentials and challenges of such integrated designs while hopefully inspiring them to collaborate with experts from the respective other field.

show abstract

Intelligible Sonifications

Cited by 3 publications

References 43 publications

Untitled

Untitled

Towards a unified terminology for sonification and visualization

Open Your Ears and Take a Look: A State‐of‐the‐Art Report on the Integration of Sonification and Visualization

Contact Info

Product

Resources

About