Visual Feedback for Grasping in Virtual Reality Environments for an Interface to Instruct Digital Human Models

Geiger, Andreas; Bewersdorf, Imke; Brandenburg, Elisabeth; Stark, Rainer

doi:10.1007/978-3-319-60492-3_22

Cited by 17 publications

(24 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Notably, in the present study, when a collision detection algorithm detected that both 3D spheres (denoting the 3D position of the fingertips in hf-VE) had come into contact with the virtual object, the object's color changed from blue to red to provide [terminal] visual feedback that the object had been grasped. This visual feedback could presumably substitute for the haptic feedback available upon grasping a physical object, and thus the reach-to-grasp movements were coordinated similarly in both PE and hf-VE (Prachyabrued and Borst 2014;Geiger et al 2018). Our future work will investigate how bio-inspired collision detection algorithms can help thinning the remaining gap between prehensile actions performed in PE and immersive hf-VE.…”

Section: Discussionmentioning

confidence: 99%

Control of aperture closure during reach-to-grasp movements in immersive haptic-free virtual reality

Mangalam

Yarossi

Furmanek

et al. 2020

Preprint

View full text Add to dashboard Cite

Virtual reality (VR) has garnered much interest as a training environment for motor skill acquisition, including for neurological rehabilitation of upper extremities. While the focus has been on gross upper limb motion, VR applications that involve reaching for, and interacting with, virtual objects are growing. The absence of true haptics in VR when it comes to hand-object interactions raises a fundamentally important question: can haptic-free immersive virtual environments (hf-VEs) support naturalistic coordination of reach-to-grasp movements? This issue has been grossly understudied, and yet is of significant importance in the development and application of VR across a number of sectors. In a previous study (Furmanek et al. 2019), we reported that reach-to-grasp movements are similarly coordinated in both the physical environment (PE) and hf-VE. The most noteworthy difference was that the closure phase, which begins at maximum aperture and lasts through the end of the movement, was longer in hf-VE than in PE, suggesting that different control laws might govern the initiation of closure between the two environments. To do so, we reanalyzed data from Furmanek et al. (2019), in which the participants reached to grasp three differently sized physical objects, and matching 3D virtual object renderings, placed at three different locations. Our analysis revealed two key findings pertaining to the initiation of closure in PE and hf-VE. First, the respective control laws governing the initiation of aperture closure in PE and hf-VE both included state estimates of transport velocity and acceleration, supporting a general unified control scheme for implementing reach-to-grasp across physical and virtual environments. Second, aperture was less informative to the control law in hf-VE. We suggest that the latter was likely because transport velocity at closure onset and aperture at closure onset were less independent in hf-VE than in PE, ultimately resulting in aperture at closure onset having a weaker influence on the initiation of closure. In this way, the excess time and muscular effort needed to actively bring the fingers to a stop at the interface of a virtual object was factored into the control law governing the initiation of closure in hf-VE. Crucially, this control law remained applicable, albeit with different weights in hf-VE, despite the absence of terminal haptic feedback and potential perceptual differences.

show abstract

Section: Discussionmentioning

confidence: 99%

Control of aperture closure during reach-to-grasp movements in immersive haptic-free virtual reality

Mangalam

Yarossi

Furmanek

et al. 2020

Preprint

View full text Add to dashboard Cite

show abstract

“…Recent research in interdisciplinary fields linked with to design, ergonomics [31][32][33], computer science [34,35] and media and communication [36,37], among other areas, is relevant today for demonstrating cutting-edge technology and the projections for virtual reality and other similar technologies, comprising immersive environments and interactive devices. These new approaches have a necessary relationship and lead us to issues related with new phases in research in these fields.…”

Section: Methodsmentioning

confidence: 99%

Immersive Environments and Virtual Reality: Systematic Review and Advances in Communication, Interaction and Simulation

Tamayo

Gértrudix

García

2017

MTI

131

View full text Add to dashboard Cite

Today, virtual reality and immersive environments are lines of research which can be applied to numerous scientific and educational domains. Immersive digital media needs new approaches regarding its interactive and immersive features, which means the design of new narratives and relationships with users. Additionally, ICT (information and communication theory) evolves through more immersive and interactive scenarios, it being necessary to design and conceive new forms of representing information and improving users' interaction with immersive environments. Virtual reality and technologies associated with the virtuality continuum, such as immersive and digital environments, are emerging media. As a medium, this approach may help to build and represent ideas and concepts, as well as developing new languages. This review analyses the cutting-edge expressive, interactive and representative potential of immersive digital technologies. It also considers future possibilities regarding the evolution of these immersive technologies, such as virtual reality, in coming years, in order to apply them to diverse scientific, artistic or informational and educational domains. We conclude that virtual reality is an ensemble of technological innovations, but also a concept, and propose models to link it with the latest in other domains such as UX (user experience), interaction design. This concept can help researchers and developers to design new experiences and conceive new expressive models that can be applied to a wide range of scientific lines of research and educational dynamics.

show abstract

“…This feedback is provided if the distance between the finger and the surface object is more than 1.5 cm (yellow) or less than 1.5 cm (green) [28]. The virtual representation of the fingers changes color, depending on their distance to the object.…”

Section: User-system-interaction Modulementioning

confidence: 99%

Natural Virtual Reality User Interface to Define Assembly Sequences for Digital Human Models

Geiger

Brandenburg

Stark

2020

ASI

Self Cite

View full text Add to dashboard Cite

Digital human models (DHMs) are virtual representations of human beings. They are used to conduct, among other things, ergonomic assessments in factory layout planning. DHM software tools are challenging in their use and thus require a high amount of training for engineers. In this paper, we present a virtual reality (VR) application that enables engineers to work with DHMs easily. Since VR systems with head-mounted displays (HMDs) are less expensive than CAVE systems, HMDs can be integrated more extensively into the product development process. Our application provides a reality-based interface and allows users to conduct an assembly task in VR and thus to manipulate the virtual scene with their real hands. These manipulations are used as input for the DHM to simulate, on that basis, human ergonomics. Therefore, we introduce a software and hardware architecture, the VATS (virtual action tracking system). This paper furthermore presents the results of a user study in which the VATS was compared to the existing WIMP (Windows, Icons, Menus and Pointer) interface. The results show that the VATS system enables users to conduct tasks in a significantly faster way.

show abstract

Visual Feedback for Grasping in Virtual Reality Environments for an Interface to Instruct Digital Human Models

Cited by 17 publications

References 7 publications

Control of aperture closure during reach-to-grasp movements in immersive haptic-free virtual reality

Control of aperture closure during reach-to-grasp movements in immersive haptic-free virtual reality

Immersive Environments and Virtual Reality: Systematic Review and Advances in Communication, Interaction and Simulation

Natural Virtual Reality User Interface to Define Assembly Sequences for Digital Human Models

Contact Info

Product

Resources

About