GPU-Based Realtime Hand Gesture Interaction and Rendering for Volume Datasets Using Leap Motion

Shen, Junchen; Luo, Yanlin; Wang, Xingce; Wu, Zhang; Zhou, Mingquan

doi:10.1109/cw.2014.20

Cited by 12 publications

(6 citation statements)

References 19 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…VR-based publications [ 69 , 105 , 118 , 121 , 123 , 127 , 139 , 170 , 171 , 172 , 173 , 174 ] mainly use motion tracking capabilities of the LMC to map the user’s hand to a virtual hand. There also exists a wide range of publications discussing the use of LMC to directly map non-VR application controls (e.g., camera translations and rotations) to hand movements (e.g., palm or fingertip movement and hand rotation) [ 53 , 55 , 56 , 93 , 120 , 124 , 126 , 128 , 133 , 137 , 168 , 175 , 176 , 177 , 178 , 179 , 180 , 181 , 182 , 183 , 184 , 185 , 186 , 187 , 188 , 189 , 190 ].…”

Section: Methodsmentioning

confidence: 99%

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Bachmann

Weichert

Rinkenauer

2018

Sensors

125

View full text Add to dashboard Cite

Modern hardware and software development has led to an evolution of user interfaces from command-line to natural user interfaces for virtual immersive environments. Gestures imitating real-world interaction tasks increasingly replace classical two-dimensional interfaces based on Windows/Icons/Menus/Pointers (WIMP) or touch metaphors. Thus, the purpose of this paper is to survey the state-of-the-art Human-Computer Interaction (HCI) techniques with a focus on the special field of three-dimensional interaction. This includes an overview of currently available interaction devices, their applications of usage and underlying methods for gesture design and recognition. Focus is on interfaces based on the Leap Motion Controller (LMC) and corresponding methods of gesture design and recognition. Further, a review of evaluation methods for the proposed natural user interfaces is given.

show abstract

Section: Methodsmentioning

confidence: 99%

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Bachmann

Weichert

Rinkenauer

2018

Sensors

125

View full text Add to dashboard Cite

show abstract

“…With the detecting and tracking hands, Leap Motion can used to American Sign Language recognition [12]. An interaction tools [13] was designed for exploring volume dataset by interaction gestures vis Leap Motion to perform some tasks. Furthermore, the integration of gaming applications was explored into the medical field [8] such as a game for hand rehabilitation [14].…”

Section: ) Gesture Interactionsmentioning

confidence: 99%

Interactive Diffusion Tensor Imaging Fiber Data Visualization Via Leap Motion

Fang

Xiao

et al. 2020

IEEE Access

View full text Add to dashboard Cite

Diffusion Tensor Imaging (DTI) reveals subtle abnormalities associated with stroke, multiple sclerosis, schizophrenia and dyslexia, which has a broad application prospect in the medical field. The densely sampled 3-D DTI fiber tracts in biological specimens have high geometric, spatial and anatomical complexity. To provide users with more immersive and convenient interactions in exploring DTI fibers, we design specific interactions based on the APIs of Leap Motion. Leap Motion is a somatosensory interaction device focusing on hand tracking. We design four different interaction modes for users to analyze the data in different interaction stages and scenarios, in order to better explore the DTI fibers which users are interested in by Leap Motion gestures. They are Normal Mode, Box Basic Interaction Mode, Box Logic Operation Mode, and Cluster Exploration Mode. Users can conduct tradition manipulations over the whole DTI fiber data in Normal Mode. Boxes are employed to filter out uninteresting tracts in Box Basic Interaction Mode, and expression-based queries are further designed to get logic set operations based on multiple boxes in Box Logic Operation Mode, e.g., the intersection, union and complement of boxes. Complex logic combination queries are allowed to perform to reduce visual clutter and help users explore DTI fibers more precisely. In Cluster Exploration Mode, DTI fibers can be classified by clustering them into spatially and anatomically related tracts and then different clusters can be explored individually by designed gestures. Compared with the explorations through traditional input devices, the evaluation tests show that the proposed approach is more intuitive and efficient in 3-D explorations and provides an immersive experience for users to explore the DTI fiber data. INDEX TERMS Data visualization, data analysis, graphical user interfaces, human computer interaction.

show abstract

“…A variety of studies involving Leap Motion Controller have been performed including studies with 3D gestures [ 17 , 18 , 19 ] and pointing tasks [ 20 , 21 ]. These approaches are based on defining a set of gestures for interaction often involving feedback to the user in the form of virtual pointers in 3D space, which are rendered inside the scene.…”

Section: Related Workmentioning

confidence: 99%

Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller

Adhikarla

Sodnik

Szolgay

et al. 2015

Sensors

View full text Add to dashboard Cite

This paper reports on the design and evaluation of direct 3D gesture interaction with a full horizontal parallax light field display. A light field display defines a visual scene using directional light beams emitted from multiple light sources as if they are emitted from scene points. Each scene point is rendered individually resulting in more realistic and accurate 3D visualization compared to other 3D displaying technologies. We propose an interaction setup combining the visualization of objects within the Field Of View (FOV) of a light field display and their selection through freehand gesture tracked by the Leap Motion Controller. The accuracy and usefulness of the proposed interaction setup was also evaluated in a user study with test subjects. The results of the study revealed high user preference for free hand interaction with light field display as well as relatively low cognitive demand of this technique. Further, our results also revealed some limitations and adjustments of the proposed setup to be addressed in future work.

show abstract

GPU-Based Realtime Hand Gesture Interaction and Rendering for Volume Datasets Using Leap Motion

Cited by 12 publications

References 19 publications

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Interactive Diffusion Tensor Imaging Fiber Data Visualization Via Leap Motion

Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller

Contact Info

Product

Resources

About