The Augmented Floor - Assessing Auditory Augmentation

Groß-Vogt, Katharina; Svoronos-Kanavas, Iason; Weger, Marian; Amon, C

doi:10.1145/3561212.3561219

Cited by 3 publications

(4 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It was also found that by modifying the transfer function of the parameter mapping, it was possible to significantly improve listeners' perceptions of realism of the simulated wading sounds by applying several stages of nonlinear and time-variant processing to the angular velocity signals. This coupled with similar experiences in past studies [53,91] and feedback design recommendations from literature [68,211] generally highlights the significant role of the transfer function in ensuring that a movement sonification design delivers a natural real-time experience and is faithful to its underlying conceptual metaphor(s) in terms of how the temporal evolution of the sound seems to match the movement precipitating it. Based on current experience, a toolkit comprising nonlinear transforms, envelope followers, frequency bandlimiters, step quantization, and mapping gain (refer Paper B) is a powerful starting point in the specific case of movement sonification design.…”

Section: The Transfer Function Perceived Naturalness Aesthetics and U...supporting

confidence: 52%

“…The range of possible transfer function types (exponential, sigmoid and logit) along with the ways in which the shape adjustment slider modifies them is by far the most extensive among GUI-based platforms such as [35,136,197,239,244,252]. Envelope shape adjustment prior to mapping has only been mentioned by one prior work [91], but played a crucial role in improving the quality of the wading simulation E3 over E1. Finally, the fact that every single aspect of a mapping could be adjusted in real time made it easy to rapidly individualize the biofeedback to suit individual patients by adjusting the normalization bounds to suit their movement ranges in Paper F.…”

Section: Data Processing and Mapping Flexibilitymentioning

confidence: 99%

See 1 more Smart Citation

Orchestrating Motion: Real-Time Sonification Tools and Methods to Support Movement Rehabilitation

Kantan

View full text Add to dashboard Cite

I received my BE (Bachelor of Engineering) in Electronics and Telecommunications Engineering at Mumbai University, India. I subsequently spent 5 years working at an IT firm, a digital audio research lab, and an audio startup. In 2018, I moved to Denmark to pursue the Sound and Music Computing master degree at Aalborg University, Copenhagen. Upon graduating in 2020, I started work as a research assistant at CREATE -Copenhagen, and was hired as a PhD fellow from January 2021. My research interests encompass the use of digital audio technology in the motor rehabilitation sector, for example as a tool for real-time biomechanical biofeedback or auditory guidance. I am also interested in music perception and cognition research. During the PhD project, I have served as co-teacher and teaching assistant on several courses including Music Perception and Cognition, Embodied Interaction (master level), and Design and Analysis of Experiments (bachelor level). In addition, I have supervised several semester projects at the bachelor and master level while being affiliated with the Augmented Cognition lab (CREATE -Copenhagen) and the Neurorehabilitation Systems group (De-

show abstract

Section: The Transfer Function Perceived Naturalness Aesthetics and U...supporting

confidence: 52%

Section: Data Processing and Mapping Flexibilitymentioning

confidence: 99%

Orchestrating Motion: Real-Time Sonification Tools and Methods to Support Movement Rehabilitation

Kantan

View full text Add to dashboard Cite

show abstract

“…At the same time, flexible devices can be conformably applied to the targeted surfaces by gluing or lamination, thus avoiding bulky mechanical constructions. Previously, we integrated P(VDF:TrFE)-based sensors in floor tiles in an augmented floor [ 27 ], whereby the sensors were reacting on the users’ stepping or jumping. The respective response signals were processed by the AI to produce an auditory augmentation of the motion.…”

Section: Introductionmentioning

confidence: 99%

Study of Pressure Distribution in Floor Tiles with Printed P(VDF:TrFE) Sensors for Smart Surface Applications

Rueda

Schäffner

Petritz

et al. 2023

Sensors

View full text Add to dashboard Cite

Pressure sensors integrated in surfaces, such as the floor, can enable movement, event, and object detection with relatively little effort and without raising privacy concerns, such as video surveillance. Usually, this requires a distributed array of sensor pixels, whose design must be optimized according to the expected use case to reduce implementation costs while providing sufficient sensitivity. In this work, we present an unobtrusive smart floor concept based on floor tiles equipped with a printed piezoelectric sensor matrix. The sensor element adds less than 130 µm in thickness to the floor tile and offers a pressure sensitivity of 36 pC/N for a 1 cm2 pixel size. A floor model was established to simulate how the localized pressure excitation acting on the floor spreads into the sensor layer, where the error is only 1.5%. The model is valuable for optimizing the pixel density and arrangement for event and object detection while considering the smart floor implementation in buildings. Finally, a demonstration, including wireless connection to the computer, is presented, showing the viability of the tile to detect finger touch or movement of a metallic rod.

show abstract

“…Envelope following: This operation was applied so as to make the falling edge of the amplitude envelope of the wading sounds more gradual and natural-sounding, while keeping the rising edge intact to ensure immediate responsiveness. We credit this approach to [62], and implemented the envelope follower as described in [58] (Chapter 12). The time constants used for the thigh and shank were different (370 ms and 670 ms, respectively).…”

mentioning

confidence: 99%

Designing Ecological Auditory Feedback on Lower Limb Kinematics for Hemiparetic Gait Training

Kantan

Dahl

Jørgensen

et al. 2023

Sensors

View full text Add to dashboard Cite

Auditory feedback has earlier been explored as a tool to enhance patient awareness of gait kinematics during rehabilitation. In this study, we devised and tested a novel set of concurrent feedback paradigms on swing phase kinematics in hemiparetic gait training. We adopted a user-centered design approach, where kinematic data recorded from 15 hemiparetic patients was used to design three feedback algorithms (wading sounds, abstract, musical) based on filtered gyroscopic data from four inexpensive wireless inertial units. The algorithms were tested (hands-on) by a focus group of five physiotherapists. They recommended that the abstract and musical algorithms be discarded due to sound quality and informational ambiguity. After modifying the wading algorithm (as per their feedback), we conducted a feasibility test involving nine hemiparetic patients and seven physiotherapists, where variants of the algorithm were applied to a conventional overground training session. Most patients found the feedback meaningful, enjoyable to use, natural-sounding, and tolerable for the typical training duration. Three patients exhibited immediate improvements in gait quality when the feedback was applied. However, minor gait asymmetries were found to be difficult to perceive in the feedback, and there was variability in receptiveness and motor change among the patients. We believe that our findings can advance current research in inertial sensor-based auditory feedback for motor learning enhancement during neurorehabilitation.

show abstract

The Augmented Floor - Assessing Auditory Augmentation

Cited by 3 publications

References 11 publications

Orchestrating Motion: Real-Time Sonification Tools and Methods to Support Movement Rehabilitation

Orchestrating Motion: Real-Time Sonification Tools and Methods to Support Movement Rehabilitation

Study of Pressure Distribution in Floor Tiles with Printed P(VDF:TrFE) Sensors for Smart Surface Applications

Designing Ecological Auditory Feedback on Lower Limb Kinematics for Hemiparetic Gait Training

Contact Info

Product

Resources

About