Tactile hand motion and pose guidance for 3D interaction

Marquardt, Alexander; Maiero, Jens; Kruijff, Ernst; Trepkowski, Christina; Schwandt, Andrea; Hinkenjann, André; Schöning, Johannes; Stuerzlinger, Wolfgang

doi:10.1145/3281505.3281526

Cited by 11 publications

(7 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the field of robotics, many studies have been introduced on sensory design for grasp control and manipulation of real objects with human-hand-like motions [15]. In a few more recent results, researchers have introduced haptic devices and rendering.…”

Section: Hapticsmentioning

confidence: 99%

Exploring the Effect of Virtual Environments on Passive Haptic Perception

Kim

2022

Applied Sciences

View full text Add to dashboard Cite

Recent advances in virtual reality (VR) technologies such as immersive head-mounted display (HMD), sensing devices, and 3D printing-based props have become much more feasible for providing improved experiences for users in virtual environments. In particular, research on haptic feedback is being actively conducted to enhance the effect of controlling virtual objects. Studies have begun to use real objects that resemble virtual objects, i.e., passive haptic, instead of using haptic equipment with motor control, as an effective method that allows natural interaction. However, technical difficulties must be resolved to match transformations (e.g., position, orientation, and scale) between virtual and real objects to maximize the user’s immersion. In this paper, we compare and explore the effect of passive haptic parameters on the user’s perception by using different transformation conditions in immersive virtual environments. Our experimental study shows that the participants felt the same within a certain range, which seems to support the “minimum cue” theory in giving sufficient sensory stimulation. Thus, considering the benefits of the model using our approach, haptic interaction in VR content can be developed in a more economical way.

show abstract

Section: Hapticsmentioning

confidence: 99%

Exploring the Effect of Virtual Environments on Passive Haptic Perception

Kim

2022

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Based on previous work, we use both continuous and pulsed modes. The different modes have been used for tactile instructions for motion instructions Spelmezan et al (2009) and pose guidance Marquardt et al (2018b), and represent commonly used encoding schemes in vibration feedback. For example, object distance can be encoded as increasing frequency or strength (continuous) or as increasing frequency of pulses.…”

Section: Apparatusmentioning

confidence: 99%

“…For example, navigation and selection/manipulation tasks could be supported by proximity and collision cues. Cues could for example be provided to the lower body (navigation) and the hands (selection/manipulation) (Marquardt et al, 2018b). Future work is needed to investigate how well users will be able to perceive objects presented to both hands and lower body as the same object.…”

Section: Lower-body Perceptionmentioning

confidence: 99%

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

Kruijff

Riecke²,

Trepkowski³

et al. 2022

Front. Virtual Real.

View full text Add to dashboard Cite

The visual and auditory quality of computer-mediated stimuli for virtual and extended reality (VR/XR) is rapidly improving. Still, it remains challenging to provide a fully embodied sensation and awareness of objects surrounding, approaching, or touching us in a 3D environment, though it can greatly aid task performance in a 3D user interface. For example, feedback can provide warning signals for potential collisions (e.g., bumping into an obstacle while navigating) or pinpointing areas where one’s attention should be directed to (e.g., points of interest or danger). These events inform our motor behaviour and are often associated with perception mechanisms associated with our so-called peripersonal and extrapersonal space models that relate our body to object distance, direction, and contact point/impact. We will discuss these references spaces to explain the role of different cues in our motor action responses that underlie 3D interaction tasks. However, providing proximity and collision cues can be challenging. Various full-body vibration systems have been developed that stimulate body parts other than the hands, but can have limitations in their applicability and feasibility due to their cost and effort to operate, as well as hygienic considerations associated with e.g., Covid-19. Informed by results of a prior study using low-frequencies for collision feedback, in this paper we look at an unobtrusive way to provide spatial, proximal and collision cues. Specifically, we assess the potential of foot sole stimulation to provide cues about object direction and relative distance, as well as collision direction and force of impact. Results indicate that in particular vibration-based stimuli could be useful within the frame of peripersonal and extrapersonal space perception that support 3DUI tasks. Current results favor the feedback combination of continuous vibrotactor cues for proximity, and bass-shaker cues for body collision. Results show that users could rather easily judge the different cues at a reasonably high granularity. This granularity may be sufficient to support common navigation tasks in a 3DUI.

show abstract

“…Furthermore, an increase in vibration feedback has been shown to increase perceived softness [79]. Finally, adding audio cues to tactile or haptic feedback has been studied, by looking at which modality works best for widgets [30] or shapes [9], or to guide users, e.g., in 3D environments [55,56]. Other studies looked into the interplay of audio and haptic cues for touch screen interaction [77].…”

Section: Related Workmentioning

confidence: 99%

Multilayer Haptic Feedback for Pen-Based Tablet Interaction

Kruijff

Biswas

Trepkowski

et al. 2019

Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems

Self Cite

View full text Add to dashboard Cite

We present a novel, haptic multilayer interaction approach that enables state transitions between spatially abovescreen and 2D on-screen feedback layers. This approach supports the exploration of haptic features that are hard to simulate using rigid 2D screens. We accomplish this by adding a haptic layer above the screen that can be actuated and interacted with (pressed on) while the user interacts with on-screen content using pen input. The haptic layer provides variable firmness and contour feedback, while its membrane functionality affords additional tactile cues like texture feedback. Through two user studies, we look at how users can use the layer in haptic exploration tasks, showing that users can discriminate well between different firmness levels, and can perceive object contour characteristics. Demonstrated also through an art application, the results show the potential of multilayer feedback to extend onscreen content with additional widget, tool and surface properties, as well as for user guidance.

show abstract

Tactile hand motion and pose guidance for 3D interaction

Cited by 11 publications

References 45 publications

Exploring the Effect of Virtual Environments on Passive Haptic Perception

Exploring the Effect of Virtual Environments on Passive Haptic Perception

First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces

Multilayer Haptic Feedback for Pen-Based Tablet Interaction

Contact Info

Product

Resources

About