Tactile Feedback for Above-Device Gesture Interfaces

Abstract

Above-device gesture interfaces let people interact in the space above mobile devices using hand and finger movements. For example, users could gesture over a mobile phone or wearable without having to use the touchscreen. We look at how above-device interfaces can also give feedback in the space over the device. Recent haptic and wearable technologies give new ways to provide tactile feedback while gesturing, letting touchless gesture interfaces give touch feedback. In this paper we take a first detailed look at how tactile feedback can be given during above-device interaction. We compare approaches for giving feedback (ultrasound haptics, wearables and direct feedback) and also look at feedback design. Our findings show that tactile feedback can enhance above-device gesture interfaces.

Point-and-Shake

“…We chose dwell instead of these because of its simplicity: users just need to point to select, and the system can give simple feedback about the object being targeted. We chose a 1000ms dwell as a starting point, as other pointing gestures used this period successfully [4], citing a balance between giving users enough time whilst not rushing them. Our system (described later) levitates small spherical objects ( 1-2mm).…”

Combining Wearable Finger Haptics and Augmented Reality: User Evaluation Using an External Camera and the Microsoft HoloLens

“…A tiny blue LED light is placed on the side of the device's case, to visually show when the vibrotactile motor is active (see the supplementary video). Although other vibrating rings have been presented in [19], [20], this is the first time a similar device is used in an immersive scenario.…”

Textured surfaces for ultrasound haptic displays

“…Early research prototypes allowed a single point of haptic stimulus above the ultrasound array [4]. Although limited, this had practical applications in HCI: a single point of feedback could be presented to a nger during mid-air pointing interactions [2,8]. A single point could also be repositioned to create richer tactile sensations: for example, creating the illusion of continuous motion on the hand [9].…”