User-Defined Mid-Air Haptic Sensations for Interacting with an AR Menu Environment

Bogaert, Lawrence Van den; Geerts, David

doi:10.1007/978-3-030-58147-3_3

Cited by 6 publications

(6 citation statements)

References 12 publications

(14 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We examined associative descriptions, using a think-aloud method based on a set of easily recognizable and distinguishable forms whose selection process we described in detail. A more top-down approach has been followed by Van den Bogaert and Geerts ( 2020 ) as well as Wobbrock et al ( 2009 ). They used a so-called “end-user elicitation study” to examine affordances of gesture-specific mid-air-haptic feedback and gestures for surface computing.…”

Section: Discussionmentioning

confidence: 99%

Function Follows Form: Using the Aesthetic Association Principle to Enhance Haptic Interface Design

Breitschaft

Carbon

2021

Front. Psychol.

View full text Add to dashboard Cite

Novel tangible user interface technologies facilitate current trends toward seamless user interfaces. They enable the design of yet unseen interfaces and thus the creation of a new kind of haptic language. In order to use the benefits of a touch-and-feel design for a positive user experience, carefully designed haptic feedback plays an important role by providing aesthetically pleasing and sustainable product features. Haptic feedback may exceed mere acquiring of buttons and input-confirmation but enable orientation and even identification of functionality governed by the haptic impression. We employed the aesthetic association principle as a deeply grounded psychological mechanism that assists effective linkage between haptic form factors and associated functional attributes. In order to illustrate this powerful principle, we analyzed the specific associations between certain main haptic surface qualities and associated functional aspects. In a series of three subsequent studies (Pre-Study 1: perception, Pre-Study 2: similarity, and Main Study: association), we explored paradigmatic associations of that kind to develop guidelines which forms are distinct to be used in interfaces. We show how forms are implicitly categorized into functional qualities (on/off, more-less, selection), using a multidimensional scaling procedure and explore explicit form-functionality associations, using a think-aloud method in the context of an automotive interface. For a series of forms, we revealed clear associative relations to specific functions. We will discuss the general value and opportunities of an association-based approach to user experience in order to create intuitive user interfaces. We will also develop ideas for specific areas of applications.

show abstract

Section: Discussionmentioning

confidence: 99%

Function Follows Form: Using the Aesthetic Association Principle to Enhance Haptic Interface Design

Breitschaft

Carbon

2021

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Some of these cues are purely abstract (e.g. [15,6]), others are designed to be evocative of underlying virtual mechanism (e.g. mid air buttons [37]).…”

Section: Umh Renderingmentioning

confidence: 99%

“…Dzidek et al [15] design and evaluate a set of abstract UMH stimuli to support a wide range of interactions in an AR demonstrator. Van den Bogaert et al [6] present a study on the selection of abstract UMH patterns intended for providing users with feedback when interacting with menus in mid-air in AR. Their study demonstrate a notable preference for relatively simple stimulus design when the aim is to support interaction, with a strong focus on the use of stimulus intensity and temporal parameters (continuous vs. discrete) as rendering parameters.…”

Section: Umh Renderingmentioning

confidence: 99%

Ultrasound Mid-Air Tactile Feedback for Immersive Virtual Reality Interaction

Howard

Marchal

Pacchierotti

2022

Human–Computer Interaction Series

View full text Add to dashboard Cite

Ultrasound mid-air haptic (UMH) devices are promising for tactile feedback in virtual reality (VR), as they do not require users to be tethered to, hold, or wear any device. This approach is less cumbersome, easy to set up, can simplify tracking, and leaves the hands free for concurrent interactions. This chapter explores work conducted at CNRS-IRISA dealing with the challenges arising from the integration of UMH interfaces in immersive VR through three main axes. These are discussed in the wider context of the state-of-the-art on UMH for augmented and virtual reality, and illustrated through several VR use-cases. A first axis deals with device integration into the VR ecosystem. Interaction in immersive VR is based on the synergy between complex input devices allowing real-time tracking of the user and multimodal feedback devices delivering a coherent visual, auditory and haptic picture of a simulated virtual environment (VE). Using UMH in immersive VR therefore hinges on integrating UMH devices such that their operation does not interfere with other input and feedback devices. It is also critical to ensure that UMH feedback is adequately synchronised and co-located with respect to other stimuli, and delivered within a workspace that is compatible with that of VR interaction. Regarding this final point, we propose PUMAH, a robotic solution for increasing the usable workspace of UMH devices. The second and third axes, respectively, focus on stimulus perception and rendering of VE properties. Virtual object properties can be rendered in a variety of ways, through e.g. amplitude modulation (AM) or spatio-temporal modulation (STM), with many parameters (modulation frequency, spatial sampling, etc.) coming into play, raising questions about the limits of the design space. To tackle this challenge, we begin by conducting psychophysical experimentation to understand the usable ranges for stimulus parameters and understand the perceptual implications of stimulus design choices. We propose an open-source software framework intended to facilitate UMH stimulus design and perceptual evaluation. These results in turn serve as the basis for the design and evaluation of rendering schemes for VR. Using amplitude variations along a focal point path in STM, we investigate the possibility of rendering geometric details and in a second step, sensations of stiffness in VR.

show abstract

“…e fourth most popular interaction technique was pinch, used for both scrolling [3,7] and drag and drop [27] tasks, which are key interactions for more advanced applications. Farhadi-Niaki et al [27] showed that the pinch gesture demonstrated better performance than hand circling for a drag and drop task in a WIMP interface.…”

Section: Interaction Techniques Suitable For Translation Taskmentioning

confidence: 99%

“…Midair gestural interaction applications have been gaining popularity for large public displays [1,2] and augmented reality [3] and in smart spaces [4]. One of the most frequently used actions in midair interaction with large screens is the one that translates (drags or moves) objects (or cursor) to an indicated target position while retaining their object's size and rotation [5,6].…”

Section: Introductionmentioning

confidence: 99%

Midair Gestural Techniques for Translation Tasks in Large-Display Interaction

Remizova

Gizatdinova

Surakka

2022

Advances in Human-Computer Interaction

View full text Add to dashboard Cite

Midair gestural interaction has gained a lot of attention over the past decades, with numerous attempts to apply midair gestural interfaces with large displays (and TVs), interactive walls, and smart meeting rooms. These attempts, reviewed in numerous studies, utilized differing gestural techniques for the same action making them inherently incomparable, which further makes it difficult to summarize recommendations for the development of midair gestural interaction applications. Therefore, the aim was to take a closer look at one common action, translation, that is defined as dragging (or moving) an entity to a predefined target position while retaining the entity’s size and rotation. We compared performance and subjective experiences (participants = 30) of four midair gestural techniques (i.e., by fist, palm, pinch, and sideways) in the repetitive translation of 2D objects to short and long distances with a large display. The results showed statistically significant differences in movement time and error rate favoring translation by palm over pinch and sideways at both distances. Further, fist and sideways gestural techniques showed good performances, especially at short and long distances correspondingly. We summarize the implications of the results for the design of midair gestural interfaces, which would be useful for interaction designers and gesture recognition researchers.

show abstract

User-Defined Mid-Air Haptic Sensations for Interacting with an AR Menu Environment

Cited by 6 publications

References 12 publications

Function Follows Form: Using the Aesthetic Association Principle to Enhance Haptic Interface Design

Function Follows Form: Using the Aesthetic Association Principle to Enhance Haptic Interface Design

Ultrasound Mid-Air Tactile Feedback for Immersive Virtual Reality Interaction

Midair Gestural Techniques for Translation Tasks in Large-Display Interaction

Contact Info

Product

Resources

About