A Canonical Set of Operations for Editing Dashboard Layouts in Virtual Reality

Abstract

Virtual reality (VR) is a powerful technological framework that can be considered as comprising any kind of device that allows for 3D environments to be simulated and interacted with via a digital interface. Depending on the specific technologies used, VR can allow users to experience a virtual world through their different senses, i.e., most often sight, but also through touch, hearing, and smell. In this paper, it is argued that a key impediment to the widespread adoption of VR technology today is the lack of interoperability between users’’ existing digital life (including 2D documents, videos, the Web, and even mobile applications) and the 3D spaces. Without such interoperability, 3D spaces offered by current VR platforms seem empty and lacking in functionality. In order to improve this situation, it is suggested that users could benefit from being able to create dashboard layouts (comprising 2D displays) for themselves in the 3D spaces, allowing them to arrange, view and interact with their existing 2D content alongside the 3D objects. Therefore, the objective of this research is to help users organize and arrange 2D content in 3D spaces depending on their needs. To this end, following a discussion on why this is a challenging problem—both from a scientific and from a practical perspective—a set of operations are proposed that are meant to be minimal and canonical and enable the creation of dashboard layouts in 3D. Based on a reference implementation on the MaxWhere VR platform, a set of experiments were carried out to measure how much time users needed to recreate existing layouts inside an empty version of the corresponding 3D spaces, and the precision with which they could do so. Results showed that users were able to carry out this task, on average, at a rate of less than 45 s per 2D display at an acceptably high precision.

Comparing desktop 3D virtual reality with web 2.0 interfaces: Identifying key factors behind enhanced user capabilities

“…Numerous scientific studies have explored the benefits and comparative effectiveness of desktop virtual realities over classical computing interfaces in terms of reduction of mental strain [34] , [33] , enhanced memory retrieval [6] , [32] , [48] , [23] , [18] , [74] , [86] , [46] , improvement of digital guidance in workflows [88] , [87] and improved possibilities for content management [79] , [81] , [80] . However, few if any previous works have proposed a general theory as to how such benefits can be achieved in a systematic and dependable way.…”

Cognitive Aspects of 2D Content Integration and Management in 3D Virtual Reality Spaces

“…Using the Doing-When-Seeing paradigm, in [16] we proposed a novel method that includes a set of operators categorized as selection operators, addition operators, placement operators, manipulation operators, and persistence operators for the editing of 2D display panels and 2D content layouts in 3D virtual spaces. The specific states and commands within the workflow are shown in Figure 2.…”

“…Based on our experiments, we showed that the proposed method and the operators it includes were all found to be useful by users, and at the same time were sufficient for the re-creation of existing 2D content layouts. We reported on this experiment in detail in [16].…”

Enhancing User Capabilities While Reducing Cognitive Load in VR: A Comparative Analysis of Desktop 3D Virtual Reality and 2D Environments

“…Numerous scientific studies have explored the benefits and comparative effectiveness of desktop virtual realities over classical computing interfaces in terms of reduction of mental strain [20,21], enhanced memory retrieval [22][23][24][25][26][27][28][29], improvement of digital guidance in workflows [30,31] and improved possibilities for content management [32][33][34].…”