SurfaceVibe

Abstract

Touch surfaces are intuitive interfaces for computing devices. Most of the traditional touch interfaces (vision, IR, capacitive, etc.) have mounting requirements, resulting in specialized touch surfaces limited by their size, cost, and mobility. More recent work has shown that vibration-based touch sensing techniques can localize taps/knocks, which provides a low-cost flexible alternative. These surfaces are envisioned as intuitive inputs for applications such as interactive meeting tables, smart kitchen appliance control, etc. However, due to dispersive and reflective properties of various vibrating mediums, it is difficult to localize taps accurately on ubiquitous surfaces. Furthermore, no work has been done on tracking continuous swipe interactions through vibration sensing. In this paper, we present SurfaceVibe, a vibration-based interaction tracking system for multiple surface types. The system accounts for physics properties of different waves to allow two major interaction types: tap and swipe. For tap induced impulse-like surface waves, we design an algorithm that takes wave dispersion and reflection into account to achieve accurate localization on ubiquitous surfaces. For swipe induced body waves, SurfaceVibe segments signals into 'slip pulses' to localize, and then tracks the trajectory. We validate SurfaceVibe through experiments on different materials and varying surface/sensing area sizes in this paper. Our methods achieve up to 6X decrease in localization error for taps and 3X reduction in length estimation error for swipes compared to existing algorithms that do not take wave properties into account. CCS CONCEPTS •Human-centered computing →Ubiquitous and mobile computing systems and tools;

Affect Display Recognition Through Tactile and Visual Stimuli in a Social Robot

“…Because of the mix of circulating and propagating waves, there is no fixed relationship between distance and sound pressure in the near field, and measuring with a single microphone can be difficult and unreliable. Two elements of a sound source position can be computed as part of a SSL task, depending on the propagation model [182]: If the source is in the far field, there is a direction-of-arrival estimation [183], and if it is in the near field, there is a distance estimation [43,45,184].…”

Fine-Grained Activity of Daily Living (ADL) Recognition Through Heterogeneous Sensing Systems With Complementary Spatiotemporal Characteristics

“…Various human actions cause different parts of the structural surface to vibrate. Most of the human interaction with an ambient surface is impulsive, meaning the interaction excites the surface and induces vibrations dominated by the Rayleigh-Lamb waves (Pan et al, 2017a). For varying excitations occurring on the same surface, they will generate different responses in the natural frequencies of the surface structure (Fagert et al, 2017).…”