Active Listening and Expressive Communication for Children with Hearing Loss Using Getatable Environments for Creativity

Hansen, Kjetil Falkenberg; Dravins, Christina; Bresin, Roberto

doi:10.1080/09298215.2012.739626

Cited by 3 publications

(2 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This decision was based on previous studies indicating that sounds with rich spectral content have been found to be more appealing to children with disabilities than other sounds (Hansen et al, 2012) and that the sound of speed and acceleration can be ecologically represented using simplified sound models reminding of the sound of wind, as for example in the sonification of rowing actions (Dubus and Bresin, 2015). Three sound models based on filtered white noise were defined: one producing smooth, wind-like sounds (S1); one model producing somewhat less smooth sounds characterized by more abruptly interrupted amplitude envelopes (S2); and one producing very choppy and clicking sounds due to a high-level of interruptions in the amplitude envelope (S3).…”

Section: Study 1: Motion Capture Experimentsmentioning

confidence: 99%

Interactive Sonification of Spontaneous Movement of Children—Cross-Modal Mapping and the Perception of Body Movement Qualities through Sound

et al. 2016

Self Cite

View full text Add to dashboard Cite

In this paper we present three studies focusing on the effect of different sound models in interactive sonification of bodily movement. We hypothesized that a sound model characterized by continuous smooth sounds would be associated with other movement characteristics than a model characterized by abrupt variation in amplitude and that these associations could be reflected in spontaneous movement characteristics. Three subsequent studies were conducted to investigate the relationship between properties of bodily movement and sound: (1) a motion capture experiment involving interactive sonification of a group of children spontaneously moving in a room, (2) an experiment involving perceptual ratings of sonified movement data and (3) an experiment involving matching between sonified movements and their visualizations in the form of abstract drawings. In (1) we used a system constituting of 17 IR cameras tracking passive reflective markers. The head positions in the horizontal plane of 3–4 children were simultaneously tracked and sonified, producing 3–4 sound sources spatially displayed through an 8-channel loudspeaker system. We analyzed children's spontaneous movement in terms of energy-, smoothness- and directness-index. Despite large inter-participant variability and group-specific effects caused by interaction among children when engaging in the spontaneous movement task, we found a small but significant effect of sound model. Results from (2) indicate that different sound models can be rated differently on a set of motion-related perceptual scales (e.g., expressivity and fluidity). Also, results imply that audio-only stimuli can evoke stronger perceived properties of movement (e.g., energetic, impulsive) than stimuli involving both audio and video representations. Findings in (3) suggest that sounds portraying bodily movement can be represented using abstract drawings in a meaningful way. We argue that the results from these studies support the existence of a cross-modal mapping of body motion qualities from bodily movement to sounds. Sound can be translated and understood from bodily motion, conveyed through sound visualizations in the shape of drawings and translated back from sound visualizations to audio. The work underlines the potential of using interactive sonification to communicate high-level features of human movement data.

show abstract

Section: Study 1: Motion Capture Experimentsmentioning

confidence: 99%

Interactive Sonification of Spontaneous Movement of Children—Cross-Modal Mapping and the Perception of Body Movement Qualities through Sound

et al. 2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…This specific application shows how collective creative behaviours may emerge from social interaction. Hansen, Dravins and Bresin (2012), winners of the SMC2011 Best Paper Award, present an interactive sound toy system designed for children at an early stage of cognitive development, with combined disabilities in sensor, motor and cognitive domains. The goal is to alleviate limitations of activity due to functional disability, and to encourage children to train their listening skills, both perceptually and cognitively.…”

mentioning

confidence: 99%

Preface: Special Issue on Creativity Rethinks Science

Avanzini

Poli

Rocchesso³

2012

Journal of New Music Research

View full text Add to dashboard Cite

This art icle m ay be used for research, t eaching, and privat e st udy purposes. Any subst ant ial or syst em at ic reproduct ion, redist ribut ion, reselling, loan, sub-licensing, syst em at ic supply, or dist ribut ion in any form t o anyone is expressly forbidden.The publisher does not give any warrant y express or im plied or m ake any represent at ion t hat t he cont ent s will be com plet e or accurat e or up t o dat e. The accuracy of any inst ruct ions, form ulae, and drug doses should be independent ly verified wit h prim ary sources. The publisher shall not be liable for any loss, act ions, claim s, proceedings, dem and, or cost s or dam ages what soever or howsoever caused arising direct ly or indirect ly in connect ion wit h or arising out of t he use of t his m at erial.A reflection on this theme was provided by the SMC2011 Keynote Speaker, Roberto Casati, in his address 'Time is of the essence: creativity, symmetry, and counterintuitive solutions'. See http://smc2011.smcnetwork.org/programme.htm#keynote. 2This contribution was edited by Federico Avanzini and Davide Rocchesso.

show abstract

Sound preferences of persons with hearing loss playing an audio-based computer game

Hiraga

Hansen

2013

Proceedings of the 3rd ACM International Workshop on Interactive Multimedia on Mobile &Amp; Portable Devices

View full text Add to dashboard Cite

We performed an experiment to investigate differences between persons with and without hearing losses when playing a novel audio-based game on a tablet computer, and how persons with hearing losses appreciated the game when they played it with three different types of sound materialspeech, music, or mixed speech and music. We analyzed game log files and participants' self-assessments and obtained results showing that there were significant differences between the two participant groups in terms of whether they completed the game. Moreover, the hearing loss group showed a preference for music among the three types of sounds and for the game itself. The two groups listened to music in different ways: hearing participants worked with the music material differently compared with other two types of material, implying that music is the most difficult among the three types. The hearing loss group showed preference for the music only-condition, which is consistent with the results from preliminary experiments we have done. We suggest that this novel game has the potential to improve the listening ability of persons with a hearing loss.

show abstract

Active Listening and Expressive Communication for Children with Hearing Loss Using Getatable Environments for Creativity

Cited by 3 publications

References 31 publications

Interactive Sonification of Spontaneous Movement of Children—Cross-Modal Mapping and the Perception of Body Movement Qualities through Sound

Interactive Sonification of Spontaneous Movement of Children—Cross-Modal Mapping and the Perception of Body Movement Qualities through Sound

Preface: Special Issue on Creativity Rethinks Science

Sound preferences of persons with hearing loss playing an audio-based computer game

Contact Info

Product

Resources

About