Characterising Soundscape Research in Human-Computer Interaction

Johansen, Stine Schmieg; Berkel, Niels van; Fritsch, Jonas

doi:10.1145/3532106.3533458

Cited by 9 publications

(2 citation statements)

References 218 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The soundscape design for our prototype followed a hybrid approach (see [67]), integrating recorded ambient environmental sounds with designed and produced vehicle sound effects. This combines the conceptualisations of soundscapes as "perceptual constructs that emerge when a listener hears sounds from a physical environment" and as "a collection of sounds that are organised in an intentional way and played to listeners" [67]. In other words, sounds are concurrently both sensory and socio-cultural experiences.…”

Section: Virtual Av Sound Designmentioning

confidence: 99%

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Dongas,

Grace,

Gillespie

et al. 2023

MTI

View full text Add to dashboard Cite

In this study, we propose the use of virtual urban field studies (VUFS) through context-based interface prototypes for evaluating the interaction design of auditory interfaces. Virtual field tests use mixed-reality technologies to combine the fidelity of real-world testing with the affordability and speed of testing in the lab. In this paper, we apply this concept to rapidly test sound designs for autonomous vehicle (AV)–pedestrian interaction with a high degree of realism and fidelity. We also propose the use of psychometrically validated measures of presence in validating the verisimilitude of VUFS. Using mixed qualitative and quantitative methods, we analysed users’ perceptions of presence in our VUFS prototype and the relationship to our prototype’s effectiveness. We also examined the use of higher-order ambisonic spatialised audio and its impact on presence. Our results provide insights into how VUFS can be designed to facilitate presence as well as design guidelines for how this can be leveraged.

show abstract

Section: Virtual Av Sound Designmentioning

confidence: 99%

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Dongas,

Grace,

Gillespie

et al. 2023

MTI

View full text Add to dashboard Cite

show abstract

“…Current HCI research on soundscapes does not address these needs. A recent review of 235 HCI soundscape articles had a gap in how PBEs need to engage with soundscape design in a manner that helps them adequately address the auditory experience [23]. Given that most PBEs do not currently engage in soundscape work, one cannot simply ask them what they need, as is a central tenet of user-centered design.…”

Section: Introductionmentioning

confidence: 99%

City Ditty: An Immersive Soundscape Sketchpad for Professionals of the Built Environment

2023

View full text Add to dashboard Cite

Soundscape planning remains a challenge to many urban practitioners due in part to a scarcity of soundscape design tools. While many sound planning tools exist, they are generally geared towards acousticians rather than professionals of the built environment (e.g., urban designers, planners, or landscape architects). This paper walks through the user-centered design process for the development and evaluation of a new soundscape design tool, City Ditty. A User-Centered Design approach was utilized to identify and develop functionalities that would benefit urban practitioners that do not currently specialize in sound. This began with a literature review of existing soundscape tools, followed by a user needs assessment with professionals of the built environment, consisting of a workshop including focus groups, tech demos, and a collaborative soundscape design exercise. These results funneled into the development of City Ditty: an immersive soundscape sketchpad that facilitates rapid audio-visual prototyping of urban soundscapes. To make City Ditty accessible to users with no expertise in sound, we developed a sound awareness session that walks the user through 36 tasks. These hands-on tasks illustrate soundscape design principles while serving as instructions on how to use the many functions of City Ditty, e.g., listen to the city soundscape at different times of the day, pedestrianize the city centre, modify permissible construction times, and add birdfeeders to attract sounds of nature. A usability study was conducted with six participants to evaluate the tool using Desktop Virtual Reality, determine new functionalities, and determine how to best facilitate user engagement in order to encourage adoption by practitioners. The direction of future soundscape tools is discussed.

show abstract

An interdisciplinary journey towards an aesthetics of sonification experience

Seiça,

Roque,

Martins

et al. 2023

J Multimodal User Interfaces

View full text Add to dashboard Cite

The aesthetic dimension has been proposed as a potential expansion of sonification design, creating listening pieces that reach the goal of effective data communication. However, current views of aesthetics still aim at optimising mapping criteria to convey the ‘right meaning’, maintaining a mostly functional view on what is considered a successful sonification. This paper proposes an interdisciplinary approach to the aesthetics of sonification experience, grounded on theoretical foundations from phenomenology of interaction, post-phenomenology, cross-cultural studies, acoustic ecology and deep listening. From this journey, we present the following design insights: (1) the design of sonifications becomes a design for experience, (2) co-designed during the interaction with each participant; (3) the sonification artefact gains a mediating role that guides the participant’s intentions in the sonification space; (4) the aesthetics of a sonification experience generates a multistable phenomenon, offering new opportunities to experience multiple perspectives over data; (5) the interaction between human participants and the sonic emanations compose a dialogic space. A call for action to reframe the sonification field into novel design spaces is now open, with aesthetics gaining a transformational role in sonification design and interaction.

show abstract

Characterising Soundscape Research in Human-Computer Interaction

Cited by 9 publications

References 218 publications

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

Virtual Urban Field Studies: Evaluating Urban Interaction Design Using Context-Based Interface Prototypes

City Ditty: An Immersive Soundscape Sketchpad for Professionals of the Built Environment

An interdisciplinary journey towards an aesthetics of sonification experience

Contact Info

Product

Resources

About