Merging real and virtual worlds: An analysis of the state of the art and practical evaluation of Microsoft Hololens

Abstract

Faculty of Sciences Department of Computing ScienceMaster in Computer Science Merging real and virtual worlds: An analysis of the state of the art and practical evaluation of Microsoft Hololensby Adrien COPPENS Achieving a symbiotic blending between reality and virtuality is a dream that has been lying in the minds of many people for a long time. Advances in various domains constantly bring us closer to making that dream come true. Augmented reality as well as virtual reality are in fact trending terms and are expected to further progress in the years to come. This master's thesis aims to explore these areas and starts by defining necessary terms such as augmented reality (AR) or virtual reality (VR). Usual taxonomies to classify and compare the corresponding experiences are then discussed.In order to enable those applications, many technical challenges need to be tackled, such as accurate motion tracking with 6 degrees of freedom (positional and rotational), that is necessary for compelling experiences and to prevent user sickness. Additionally, augmented reality experiences typically rely on image processing to position the superimposed content. To do so, "paper" markers or features extracted from the environment are often employed. Both sets of techniques are explored and common solutions and algorithms are presented.After investigating those technical aspects, I carry out an objective comparison of the existing state-of-the-art and state-of-the-practice in those domains, and I discuss present and potential applications in these areas. As a practical validation, I present the results of an application that I have developed using Microsoft HoloLens, one of the more advanced affordable technologies for augmented reality that is available today. Based on the experience and lessons learned during this development, I discuss the limitations of current technologies and present some avenues of future research.

Remote Extended Reality with Markerless Motion Tracking for Sitting Posture Training

“…In this study, remote XR interaction occurred on a distant screen, resulting in significantly lower immersion and presence scores compared to the fully-immersive virtual reality headset used in our previous research [17]. Our findings align with the immersion trends reported in existing literature for reality technologies [45]. The low simulator sickness reported by subjects using our remote XR training system could be attributed to this low immersion level.…”

Extended Reality (XR) Training in the Construction Industry: A Content Review

“…Consider Microsoft HoloLens as an example. While wearing HoloLens, users can maintain a clear view of their surroundings while concurrently observing holographic images seamlessly integrated into the real-world environment [59].…”

Augmented-Reality-Based Visualization of Navigation Data of Mobile Robots on the Microsoft Hololens -- Possibilities and Limitations

“…Furthermore, this bears advantages such as freedom in navigation or independent operation. Previous work including the work from Liu et al [15], Coppens [16] and Vassallo et al [17] have evaluated general technical aspects of the Hololens such as the accuracy of spatial mapping or gaze gesture commands. Vassallo et al focuses on evaluation of hologram placement accuracy and spatial mapping.…”