General-purpose telepresence with head-worn optical see-through displays and projector-based lighting

Maimone, Andrew; Yang, Xubo; Dierk, Nate; State, Andrei; Dou, Mingsong; Fuchs, Henry

doi:10.1109/vr.2013.6549352

Cited by 62 publications

(27 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Avatars in shared environments. Another related trend is the use of teleported 3D avatars, further allowing users to visit, explore, and interact in remote places more intimately . 3D avatar‐based tele‐conference requires techniques to reproduce and control as realistic and life‐sized representation of the participant as possible.…”

Section: Related Workmentioning

confidence: 99%

SpaceTime: adaptive control of the teleported avatar for improved AR tele‐conference experience

Kim

2015

Computer Animation & Virtual

View full text Add to dashboard Cite

With the continued technology innovation in object sensing and human motion tracking, the traditional two-dimensional video-based tele-conference systems are projected to evolve into the three-dimensional immersive and augmented reality (AR) based on which one can communicate with the teleported remote other as if present, moving and interacting naturally in the same location. One technical hurdle to this vision is the need to resolve the environmental differences and the resulting teleported avatar motion anomaly between the remote and local sites. This paper presents a novel method to first establish a spatial and object-level match between the remote and local sites and adapts the position and motion of the teleported avatar into the local AR space according to the matched information. This results in a natural looking and spatially correct rendering of the remote user in the local augmented space and a significantly improved tele-conference experience and communication performance.

show abstract

Section: Related Workmentioning

confidence: 99%

SpaceTime: adaptive control of the teleported avatar for improved AR tele‐conference experience

Kim

2015

Computer Animation & Virtual

View full text Add to dashboard Cite

show abstract

“…Research on remote collaboration and telepresence is multifaceted; for example, several systems focus on creating fully immersive, three-dimensional telepresence experiences with increasingly lower instrumentation barriers (e.g., [28,37]). …”

Section: Related Workmentioning

confidence: 99%

World-stabilized annotations and virtual scene navigation for remote collaboration

Gauglitz

Nuernberger

Turk

et al. 2014

Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology

162

View full text Add to dashboard Cite

Figure 1. Live AR-based remote collaboration with our prototype. Left: the local user in front of a car engine, identifying a particular element which the remote user has marked with the yellow dot. Right: the remote user's view onto the scene, which (at this moment) shows more context than the local user's current view. The latter is shown as an inset on the bottom left as well as being projected onto the model. The remote user can browse this environment independently of the local user's camera and can set annotations, which are immediately visible to the local user in AR. ABSTRACTWe present a system that supports an augmented shared visual space for live mobile remote collaboration on physical tasks. The remote user can explore the scene independently of the local user's current camera position and can communicate via spatial annotations that are immediately visible to the local user in augmented reality. Our system operates on off-the-shelf hardware and uses real-time visual tracking and modeling, thus not requiring any preparation or instrumentation of the environment. It creates a synergy between video conferencing and remote scene exploration under a unique coherent interface. To evaluate the collaboration with our system, we conducted an extensive outdoor user study with 60 participants comparing our system with two baseline interfaces. Our results indicate an overwhelming user preference (80%) for our system, a high level of usability, as well as performance benefits compared with one of the two baselines.

show abstract

“…As aforementioned, some researchers proposed human-involved calibration techniques but most involved having the user perform 2D positional calibration twice, independently for each eye (e.g., [2,4,11,17]). Other works studied camera-based 2D positional calibration, i.e., placing a camera at eye position to perform alignment tasks [10,16,21,23], but for accurate AR, the positional difference between the camera and human eye would still need to be calibrated, and perceptual issues would need to be addressed.…”

Section: Ost-ned Overlay Calibration Ar Applicationsmentioning

confidence: 99%

“…Most existing binocular overlay calibration approaches decompose the problem into two monocular overlay calibration sub-problems, involving two independent and identical procedures of 2D-3D correspondence point matching (also called 2D positional calibration), one for each eye (e.g., [2,4,11,16,17]). Such approach, while useful, has the following limitations: (1) it is based on the simplified assumption that the human eye can be modeled as a pinhole camera; (2) the model has 2Nmono unknown parameters (where Nmono is the number of unknown parameters in the 3D-2D point correspondence matching problem).…”

Section: Introductionmentioning

confidence: 99%

Depth-disparity calibration for augmented reality on binocular optical see-through displays

Tošić

Berkner

et al. 2015

Proceedings of the 6th ACM Multimedia Systems Conference

View full text Add to dashboard Cite

We present a study of depth-disparity calibration for augmented reality applications using binocular optical see-through displays. Two techniques were proposed and compared. The "paired-eyes" technique leverages the Panum's fusional area to help viewer find alignment between the virtual and physical objects. The "separate-eyes" technique eliminates the need of binocular fusion and involves using both eyes sequentially to check the virtual-physical object alignment on retinal images. We conducted a user study to measure the calibration results and assess the subjective experience of users with the proposed techniques.

show abstract

General-purpose telepresence with head-worn optical see-through displays and projector-based lighting

Cited by 62 publications

References 9 publications

SpaceTime: adaptive control of the teleported avatar for improved AR tele‐conference experience

SpaceTime: adaptive control of the teleported avatar for improved AR tele‐conference experience

World-stabilized annotations and virtual scene navigation for remote collaboration

Depth-disparity calibration for augmented reality on binocular optical see-through displays

Contact Info

Product

Resources

About