ShareAR

Abstract

Augmented reality is an emerging application on mobile devices. However, there is a lack of understanding of the communication requirements and challenges of multiuser AR scenarios. In this position paper, we propose several important research issues that need to be addressed for low-latency, accurate shared AR experiences: (a) Systems tradeoffs of AR communication architectures used today in mobile AR platforms; (b) Understanding AR communication patterns and adapting the AR application layer to dynamically changing network conditions; and (c) Tools and methodologies to evaluate AR quality of experience in real time on mobile devices. We present preliminary measurements of off-the-shelf mobile AR platforms as well as results from our AR system, ShareAR, illustrating performance tradeoffs and indicating promising new research directions.

A Quest for Co-Located Mixed Reality: Aligning and Assessing SLAM Tracking for Same-Space Multi-User Experiences

“…Alternatively, there is the synchronisation of SLAM data to consider. Instead of tracking one or more features and aligning to those, instead devices can share [29], and even collaboratively map [35], the environment such that they all share the same coordinate space and absolute positioning within this environment. Perhaps the most relevant example of the synchronised SLAM approach was demonstrated by Oculus in 2018 [33].…”

“…However, they do have a number of caveats to be considered. For synchronised SLAM, [29] noted in particular issues regarding end-to-end latency in discovery and alignment, bandwidth usage (particularly at the initial synchronisation of a map), and processing requirements (particularly if offloading elements of the map processing to the cloud). Across both solutions there are common caveats in terms of:…”

Mobile Augmented Reality for Low-End Devices Based on Planar Surface Recognition and Optimized Vertex Data Rendering

“…"Changdeok Arirang at Home" is an Android AR application for remotely experiencing a complete navigation at an UNESCO World Heritage site, exploiting 5G mobile edge computing (MEC) for fast and seamless interaction with high-quality AR and Virtual Reality (VR) content [5]. Combined with adaptive data transmissions MEC technology, reduces the end-to-end latency while multiple users share AR and Mixed Reality (MR) content through the ShareAR application [6]. Such multiuser collaboration interfaces may be the response for open museums that seek a balance between interactivity and distance through AR technology [7].…”