Enabling Customizable Workflows for Industrial AR Applications

Lehrbaum, Valeriya; MacWilliams, Asa; Newman, Joseph P.; Sudharsan, Nischita; Bien, Seongjin; Karas, Konstantin; Eghtebas, Chloe; Weber, Sandro; Klinker, Gudrun

doi:10.1109/ismar55827.2022.00079

Cited by 3 publications

(1 citation statement)

References 37 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The proposed system uses an AR backend that provides hologram poses with respect to the anchor points initially defined for indoor localization (Lehrbaum et al, 2022). Any client device can add or modify the AR components, consisting of images, text information, web-content, or the live sensory data of an industrial environment.…”

Section: Introductionmentioning

confidence: 99%

Ar in Vr: Omnistereoscopic Telepresence With Holograms for Remote Maintenance and Collaboration

2022

IJWI

View full text Add to dashboard Cite

With the development of mixed reality technologies, remote maintenance and collaboration applications receive increasing interest in the industry. The combination of 360-degree telepresence and augmented reality (AR) cues have been shown to be an effective way of remote collaboration. However, most existing methods do not provide depth perception, which can improve the remote inspection. Also, many methods that use holograms for live collaboration are limited with only pointing functionality. In this paper, we present a 360-degree telepresence system interacting with an AR backend to create an immersive mixed reality interface for remote collaboration. The proposed camera system does not need to be carried by any on-site person, but can be controlled by the remote operator intuitively. We deploy network delay compensation methods and propose novel projection strategies for a correct and efficient rendering. A comparative analysis shows advantages of the proposed system over previous work, and that it is a promising approach for improving remote collaboration and maintenance. Our experiments indicate that our system has a glass-to-glass delay of roughly 106 ms, and a data rate to the client varying between 10-15 Mbps, which can be further optimized for specific applications. Exploratory tests with VR-experienced users showed that the motion-to-photon latency of the system is in acceptable ranges. The system can be deployed in various industrial applications for a live or asynchronous collaboration between an on-site user (with AR) and an off-site user (with AR in VR).

show abstract

Section: Introductionmentioning

confidence: 99%