UNBODY: A Poetry Escape Room in Augmented Reality

Abstract

The integration of augmented reality (AR) technology into personal computing is happening fast, and augmented workplaces for professionals in areas such as Industry 4.0 or digital health can reasonably be expected to form liminal zones that push the boundary of what currently possible. The application potential in the creative industries, however, is vast and can target broad audiences, so with UNBODY, we set out to push boundaries of a different kind and depart from the graphic-centric worlds of AR to explore textual and aural dimensions of an extended reality, in which words haunt and re-create our physical selves. UNBODY is an AR installation for smart glasses that embeds poetry in the user’s surroundings. The augmented experience turns reality into a medium where holographic texts and film clips spill from dayglow billboards and totems. In this paper, we develop a blueprint for an AR escape room dedicated to the spoken and written word, with its open source code facilitating uptake by others into existing or new AR escape rooms. We outline the user-centered process of designing, building, and evaluating UNBODY. More specifically, we deployed a system usability scale (SUS) and a spatial interaction evaluation (SPINE) in order to validate its wider applicability. In this paper, we also describe the composition and concept of the experience, identifying several components (trigger posters, posters with video overlay, word dropper totem, floating object gallery, and a user trail visualization) as part of our first version before evaluation. UNBODY provides a sense of situational awareness and immersivity from inside an escape room. The recorded average mean for the SUS was 59.7, slightly under the recommended 68 average but still above ‘OK’ in the zone of low marginal acceptable. The findings for the SPINE were moderately positive, with the highest scores for output modalities and navigation support. This indicated that the proposed components and escape room concept work. Based on these results, we improved the experience, adding, among others, an interactive word composer component. We conclude that a poetry escape room is possible, outline our co-creation process, and deliver an open source technical framework as a blueprint for adding enhanced support for the spoken and written word to existing or coming AR escape room experiences. In an outlook, we discuss additional insight on timing, alignment, and the right level of personalization.

Fostering Motivation toward Chemistry through Augmented Reality Educational Escape Activities. A Self-Determination Theory Approach

“…The subsequent blending of EEAs and AR technology is logical, and education researchers are starting to investigate this integration and its influence on learning outcomes. − The comparatively low cost of implementing AR technologies into the classroom on ubiquitous devices provides an opportunity for rapid virtual presence. The vision of this project draws on the inspiration of using AR to support this pedagogy.…”

Kintsugi VR: Designing with Fractured Objects

“…The idea of implementing escape rooms in virtual reality, or augmenting them to take advantage of virtual and mixed-reality technology has been explored to some extent (e.g. [58,59]). Following on from these ideas we envisaged the design of puzzle elements that could be used to draw the viewer of a VR or MR drama through the discovery and validation of information the protagonist would do to advance the plot.…”

Augmented Reality Escape Classroom Game for Deep and Meaningful English Language Learning

“…Additionally, not all subject matters are being explored equally. For instance, there seems to be more literature on chemistry and science [12][13][14][15][16], and much less on history, social studies and language learning [17,18]. For this reason, the primary focus of this work is the design, development and evaluation of a novel ARECG for deep and meaningful English language learning, called 'LockED in ShakespeARe's Globe Theatre'.…”