Midair Click of Dual-Layer Haptic Button

Ito, Meguru; Kokumai, Yuji; Shinoda, Hiroyuki

doi:10.1109/whc.2019.8816101

Cited by 10 publications

(7 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Cornelio-Martinez et al [2] also investigated this style of activation feedback, finding that it improves the sense of agency over button activation (i.e., made users feel more in control of the user interface). Hwang et al [14] and Ito et al [95] used two layers of feedback, with stronger feedback in the lower layer, to mimic the experience of pressing a physical button and experiencing an increase in mechanical resistance.…”

Section: A Mid-air User Interface Componentsmentioning

confidence: 99%

A Survey of Mid-Air Ultrasound Haptics and Its Applications

Rakkolainen

Freeman

Sand

et al. 2021

IEEE Trans. Haptics

120

View full text Add to dashboard Cite

Ultrasound haptics is a contactless haptic technology that enables novel mid-air interactions with rich multisensory feedback. This paper surveys recent advances in ultrasound haptic technology. We discuss the fundamentals of this haptic technology, how a variety of perceptible sensations are rendered, and how it is currently being used to enable novel interaction techniques. We summarize its strengths, weaknesses, and potential applications across various domains. We conclude with our perspective on key directions for this promising haptic technology.

show abstract

Section: A Mid-air User Interface Componentsmentioning

confidence: 99%

A Survey of Mid-Air Ultrasound Haptics and Its Applications

Rakkolainen

Freeman

Sand

et al. 2021

IEEE Trans. Haptics

120

View full text Add to dashboard Cite

show abstract

“…4.2 [31,61]), to use pre-defined complex stimulus patterns that are triggered by events in the VR interaction (e.g. button-press feedback in [37] or the sensations corresponding to supernatural phenomena in [51]), or to extract frame-rate-independent characteristic values from the tracking input from which UMH feedback can be procedurally generated at whichever frequency is best suited to the UMH device. Such features could e.g.…”

Section: Integrating With Feedback Devicesmentioning

confidence: 99%

“…[15,6]), others are designed to be evocative of underlying virtual mechanism (e.g. mid air buttons [37]). Dzidek et al [15] design and evaluate a set of abstract UMH stimuli to support a wide range of interactions in an AR demonstrator.…”

Section: Umh Renderingmentioning

confidence: 99%

Ultrasound Mid-Air Tactile Feedback for Immersive Virtual Reality Interaction

Howard

Marchal

Pacchierotti

2022

Human–Computer Interaction Series

View full text Add to dashboard Cite

Ultrasound mid-air haptic (UMH) devices are promising for tactile feedback in virtual reality (VR), as they do not require users to be tethered to, hold, or wear any device. This approach is less cumbersome, easy to set up, can simplify tracking, and leaves the hands free for concurrent interactions. This chapter explores work conducted at CNRS-IRISA dealing with the challenges arising from the integration of UMH interfaces in immersive VR through three main axes. These are discussed in the wider context of the state-of-the-art on UMH for augmented and virtual reality, and illustrated through several VR use-cases. A first axis deals with device integration into the VR ecosystem. Interaction in immersive VR is based on the synergy between complex input devices allowing real-time tracking of the user and multimodal feedback devices delivering a coherent visual, auditory and haptic picture of a simulated virtual environment (VE). Using UMH in immersive VR therefore hinges on integrating UMH devices such that their operation does not interfere with other input and feedback devices. It is also critical to ensure that UMH feedback is adequately synchronised and co-located with respect to other stimuli, and delivered within a workspace that is compatible with that of VR interaction. Regarding this final point, we propose PUMAH, a robotic solution for increasing the usable workspace of UMH devices. The second and third axes, respectively, focus on stimulus perception and rendering of VE properties. Virtual object properties can be rendered in a variety of ways, through e.g. amplitude modulation (AM) or spatio-temporal modulation (STM), with many parameters (modulation frequency, spatial sampling, etc.) coming into play, raising questions about the limits of the design space. To tackle this challenge, we begin by conducting psychophysical experimentation to understand the usable ranges for stimulus parameters and understand the perceptual implications of stimulus design choices. We propose an open-source software framework intended to facilitate UMH stimulus design and perceptual evaluation. These results in turn serve as the basis for the design and evaluation of rendering schemes for VR. Using amplitude variations along a focal point path in STM, we investigate the possibility of rendering geometric details and in a second step, sensations of stiffness in VR.

show abstract

“…(C) Validating novel approaches to rendering and interaction. UMH interfaces have spawned a multitude of novel tactile rendering and interaction techniques, for tactile user interfaces [Ito et al 2019;Rümelin et al 2017], mid-air tactile icons [Rocchesso et al 2019;Yoshimoto et al 2019] as well as virtual and augmented reality. The effectiveness of these techniques needed to be evaluated through perceptual experiments.…”

Section: Related Workmentioning

confidence: 99%

DOLPHIN: A Framework for the Design and Perceptual Evaluation of Ultrasound Mid-Air Haptic Stimuli

Mulot

Gicquel

Zanini

et al. 2021

ACM Symposium on Applied Perception 2021

View full text Add to dashboard Cite

Ultrasound mid-air haptic interfaces can display highly reconfigurable vibrotactile shapes in mid-air for human-computer interaction (HCI) applications. The choice of stimulus shape, spatial, temporal and modulation parameters yields a complex design space, yet relatively little is known about the impact of these design choices on perceived stimulus properties. We define the combination of a spatial discretization of an abstract shape and a set of rules for the temporal display order and intensity modulation of the resulting points as a sampling strategy. We developed DOLPHIN, an open-source framework to aid in designing mid-air stimuli. DOL-PHIN allows the study of the impact of rendering parameters on perceived stimulus properties. This platform-agnostic framework standardizes stimulus descriptions as a step toward more replicability and easier communication in the field. It enables reproduction of stimuli between perceptual experiments and ensures stimuli used in applications correspond to those evaluated in prior perceptual studies. We validated DOLPHIN's usability by conducting a user study assessing the impact of sampling strategy design on curvature discrimination for dynamic mid-air haptic stimuli. The Weber fractions for just-noticeable differences (JNDs) in curvature were found to range between 1 and 1.4, yet no significant effect of the number of spatial sampling points on curvature discrimination was found. This result shows a practical use-case for DOLPHIN and provides insight into rendering mid-air haptic curvature.

show abstract

Midair Click of Dual-Layer Haptic Button

Cited by 10 publications

References 7 publications

A Survey of Mid-Air Ultrasound Haptics and Its Applications

A Survey of Mid-Air Ultrasound Haptics and Its Applications

Ultrasound Mid-Air Tactile Feedback for Immersive Virtual Reality Interaction

DOLPHIN: A Framework for the Design and Perceptual Evaluation of Ultrasound Mid-Air Haptic Stimuli

Contact Info

Product

Resources

About