Exploring Direct 3D Interaction for Full Horizontal Parallax Light Field Displays Using Leap Motion Controller

Abstract

This paper reports on the design and evaluation of direct 3D gesture interaction with a full horizontal parallax light field display. A light field display defines a visual scene using directional light beams emitted from multiple light sources as if they are emitted from scene points. Each scene point is rendered individually resulting in more realistic and accurate 3D visualization compared to other 3D displaying technologies. We propose an interaction setup combining the visualization of objects within the Field Of View (FOV) of a light field display and their selection through freehand gesture tracked by the Leap Motion Controller. The accuracy and usefulness of the proposed interaction setup was also evaluated in a user study with test subjects. The results of the study revealed high user preference for free hand interaction with light field display as well as relatively low cognitive demand of this technique. Further, our results also revealed some limitations and adjustments of the proposed setup to be addressed in future work.

Models for Rested Touchless Gestural Interaction

“…While this may seem trivially true, current literature has in some cases failed to identify learning in these gestural interfaces [6,34,1]. We believe this difference is due to our experimental design, which used a longitudinal study and random-order practice.…”

“…This type of interaction technique has been studied for over 3 decades since Richard Bolt's first implementation in "Put-That-There" [5]. Gestural interaction implementations are typically divided into two different types: (1) those that require the user to wear gloves, devices or specific markers and (2) touchless gestural interaction. The latter leverages the "Come As You Are" design principle [39], which states that users should not be required to wear devices or specific markers to interact with a system [40].…”

“…We aim to identify whether differences in performance exist between gestural interactions by using 3 different strategies: (1) a completely unmodeled approach, (2) the simple model introduced by Jude et al [20] which models palm positions onto a hyperplane, and (3) a more complex model introduced here, which models the interaction space with no loss of information, using the angles of the forearm as input. We also aim to identify whether learning is present in these gestural interfaces through the use of a longitudinal design, as current works that use only one session have not found learning [6,34,1].…”

Evaluation of the Concept of Dynamic Adaptive Streaming of Light Field Video

“…The work of Adhikarla et al [48] details their experiment on the subjective evaluation of 3D interaction on a small projection-based light field display. The test participants had to use free-hand gestures to interact with the display -namely to touch given surfaces visualized within the FOV -and the movements were tracked by a Leap Motion Controller.…”

Correlation Plenoptic Imaging: An Overview

“…The ability to reconstruct light paths can be used, in post-processing, to refocus out-of-focus objects, change the point of view on the scene and extend the DOF. PI is also one of the simplest and fastest methods to obtain three-dimensional images with the current technology [4][5][6][7][8][9][10]; in particular, it is among the imaging methods able to achieve 3D imaging in a single shot [11][12][13][14][15]. PI does not require either multiple sensors for multiperspective acquisition, or scanning or interferometric methods; single-shot 3D imaging is instead accomplished by a simple modification of ordinary imaging devices (such as cameras and microscopes) that does not involve using multiple excitation beams [13], multifocus gratings combined with aberration corrections [14] or spatial light modulators [15].…”