Towards Outdoor Collaborative Mixed Reality: Lessons Learnt from a Prototype System

Abstract

Figure 1: Conceptual overview of our outdoor CMR system showing a detailed 3D model of a street that a local AR user can experience in collaboration with a remote VR user. The virtual coordinate space of the shared virtual environment is aligned to the real-world surroundings of the AR user (Space B) with QR code markers. Line illustrations by Suhyun Park (artist).

Reviving the Euston Arch: A Mixed Reality Approach to Cultural Heritage Tours

“…Our setup consists of a Meta Quest Pro headset and a Google Pixel 6 Android phone, with all rendering performed locally on each device, eliminating the need for desktop rendering/streaming. We also tested compatibility with desktop extensions and Microsoft HoloLens 2, aligning with the approach described in [16]. Internet access was provided to the Android phone using an iPhone as a hotspot.…”

“…In our previous work [16], we used the World Locking Toolkit (WLT) [14] to anchor the HoloLens's coordinate system with the target building. Despite being designed for indoor use, the HoloLens showed impressive performance over vast outdoor areas.…”

“…We are particularly focused on integrating photo-realistic world models into AR/VR experiences to foster seamless collaboration between AR and VR users. Building on our previous research in indoor environments [17] and standalone models of outdoor scenes [16], we explore diverse collaboration possibilities between AR and VR users within outdoor settings, using world models and accurate tracking. Moreover, we strive to enhance communication and interaction methods that could facilitate a fluid transition across the reality-virtuality continuum [15].…”

[DC] Outdoor AR Tracking Evaluation and Tracking with Prior Map

“…Adhering to the principles outlined in the relevant literature, our experiment will focus on the dynamic alignment of distant buildings in relation to prior models under varying tracking conditions [8], simulating challenging outdoor AR scenarios. Alternatively, other hardware, such as robotic arms, can be used for trajectory ground truth and repetitive testing.…”

[DC] Towards Understanding, Alleviating, and Exploiting the Effects of Asymmetry in Collaborative Mixed Reality

“…In addition to the pilot study, the described system was applied within an outdoor scenario, combined with a large-scale photorealistic model of a street in Nicosia, Cyprus. A paper describing design considerations, lessons learnt, and future work areas will be presented at the ReDigiTS workshop at IEEE VR 2023 [6].…”