Tiltification - An Accessible App to Popularize Sonification

Asendorf, Malte; Kienzle, Moritz; Ringe, Rachel; Ahmadi, Fida; Bhowmik, Debaditya; Chen, Jiumeng; Huynh, Kelly; Kleinert, Steffen; Kruesilp, Jatawan; Lee, Ying Ying; Wang, Xin; Luo, W.; Jadid, Navid Mirzayousef; Awadin, Ahmed; Raval, Varun; Schade, Eve Emily Sophie; Jaman, Hasanur; Sharma, K.K.; Weber, C; Winkler, Helena; Ziemer, Tim

doi:10.21785/icad2021.025

Cited by 6 publications

(3 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The sonification is implemented in Pure Data. The source files can be found in the Sonic Tilt repository [27], the open-source version of Tiltification [28], our spirit-level sonification app.…”

Section: Three-dimensional Sonificationmentioning

confidence: 99%

Three-Dimensional Sonification for Image-Guided Surgery

Ziemer

2023

Proceedings of the 28th International Conference on Auditory Display (ICAD2023)

View full text Add to dashboard Cite

In neuronavigation and image-guided surgery, the clinician’s surgical instrument is tracked in relation to the patient’s anatomy. This way, they can be guided towards pre-planned target locations, like positions for burr holes, incision points for biopsy needles, or the center of a tumor for thermal ablation. In this paper, I present the initial results of an experiment that simulates a surgical scenario using a skull phantom. After 50 minutes of explanation and training, 24 participants were guided towards target locations by auditory, visual, and audiovisual clues. So far, the results show that all methods successfully guide the participants to the targets. The trajectory lengths, the needed time to find the targets as well as the precision seem to lie in a similar order of magnitude. When guided by sonification, trajectories tend to be longest and axis-by- axis-motions can be observed. Visual guidance seems to suffer from the missing depth of pseudo-3D graphics on a 2D screen. Audiovisual guidance leads to more micro-motions near the targets, compared to purely visual guidance. Further analysis will quantify the effectiveness of sonification as a three-dimensional guidance tool for surgery.

show abstract

Section: Three-dimensional Sonificationmentioning

confidence: 99%

Three-Dimensional Sonification for Image-Guided Surgery

Ziemer

2023

Proceedings of the 28th International Conference on Auditory Display (ICAD2023)

View full text Add to dashboard Cite

show abstract

“…2f] and agree that "Sonification will gain significant momentum once several specific applications become widely used." [17, p. 24] With Tiltification [18] we aimed at contributing to the breakthrough of sonification. Tiltification is a smartphone app in which the two tilt angles of the smartphone are communicated through our two-dimensional psychoacoustic sonification [19].…”

Section: Introductionmentioning

confidence: 99%

Recommendations to Develop, Distribute and Market Sonification Apps

Ziemer¹,

Jadid²

2022

Proceedings of the 27th International Conference on Auditory Display (ICAD 2022)

Self Cite

View full text Add to dashboard Cite

After decades of research, sonification is still rarely adopted in consumer electronics, software and user interfaces. Outside the science and arts scenes the term sonification seems not well known to the public. As a means of science communication, and in order to make software developers, producers of consumer electronics and end users aware of sonification, we developed, distributed, and promoted Tiltification. This smartphone app utilizes sonification to inform users about the tilt angle of their phone, so that they can use it as a torpedo level. In this paper we report on our app development, distribution and promotion strategies and reflect on their success in making the app in particular, and sonification in general, better known to the public. Finally, we give recommendations on how to develop, distribute and market sonification apps. This article is dedicated to research institutions without commercial interests.

show abstract

“…Sometimes sonified data is multidimensional. Examples include an abstract phase space Hermann (2018), real spatial locations Lokki and Gröhn (2005); Ziemer and Schultheis (2019a); and angles Asendorf et al (2021); Greindl et al (2020). Sometimes, data is multivariate.…”

Section: Introductionmentioning

confidence: 99%

PAMPAS: A PsychoAcoustical Method for the Perceptual Analysis of Multidimensional Sonification

Ziemer¹,

Schultheis²

2022

Preprint

View full text Add to dashboard Cite

The sonification of data to communicate information to a user is a relatively new approach that established itself around the 1990s. To date many researchers design their individual sonification from scratch. There are no standards in sonification design and evaluation. But researchers and practitioners have formulated several requirements and established several methods. There is wide consensus that psychoaocustics could play an important role in the sonification design and evaluation phase. But this requires an adaption of psychoacoustic methods to the signal types and the requirements of sonification. In this method paper we present PAMPAS, a PsychoAcoustical Method for the Perceptual Analysis of multidimensional Sonification. A well-defined and well-established, efficient, reliable and replicable Just Noticeable Difference experiment using the Maximum Likelihood Procedure serves as the basis to achieve linearity of parameter mapping during the sonification design stage and to identify and quantify perceptual effects during the sonification evaluation stage, namely the perceptual resolution, hysteresis effects and perceptual interferences. The experiment results are universal scores from a standardized data space and a standardized procedure. These scores can serve to compare multiple sonification designs of a single researcher, or even between different research groups. The method can supplement other sonification design and evaluation methods from a perceptual viewpoint.

show abstract

Tiltification - An Accessible App to Popularize Sonification

Cited by 6 publications

References 0 publications

Three-Dimensional Sonification for Image-Guided Surgery

Three-Dimensional Sonification for Image-Guided Surgery

Recommendations to Develop, Distribute and Market Sonification Apps

PAMPAS: A PsychoAcoustical Method for the Perceptual Analysis of Multidimensional Sonification

Contact Info

Product

Resources

About