Optimizing Performance and Satisfaction in Matching and Movement Tasks in Virtual Reality with Interventions Using the Data Visualization Literacy Framework

Abstract

Virtual reality (VR) has seen increased use for training and instruction. Designers can enable VR users to gain insights into their own performance by visualizing telemetry data from their actions in VR. Our ability to detect patterns and trends visually suggests the use of data visualization as a tool for users to identify strategies for improved performance. Typical tasks in VR training scenarios are manipulation of 3D objects (e.g., for learning how to maintain a jet engine) and navigation (e.g., to learn the geography of a building or landscape before traveling on-site). In this paper, we present the results of the RUI VR (84 subjects) and Luddy VR studies (68 subjects), where participants were divided into experiment and control cohorts. All subjects performed a series of tasks: 44 cube-matching tasks in RUI VR, and 48 navigation tasks through a virtual building in Luddy VR (all divided into two sets). All Luddy VR subjects used VR gear. RUI VR subjects were divided across three setups: 2D Desktop (with laptop and mouse), VR Tabletop (in VR, sitting at a table), and VR Standup (in VR, standing). In an intervention called “Reflective phase,” the experiment cohorts were presented with data visualizations, designed with the Data Visualization Literacy Framework (DVL-FW), of the data they generated during the first set of tasks before continuing to the second part of the study. For Luddy VR, we found that experiment users had significantly faster completion times in their second trial (p = 0.014) while scoring higher in a mid-questionnaire about the virtual building (p = 0.009). For RUI VR, we found no significant differences for completion time and accuracy between the two cohorts in the VR setups. however, 2D Desktop subjects in the experiment cohort had significantly higher rotation accuracy as well as satisfaction (protation = 0.031, psatisfaction = 0.040). We conclude with suggestions for adjustments to the Reflective phase to boost user performance before generalizing our findings to performance improvement in VR with data visualizations.

The HRA Organ Gallery Affords Immersive Superpowers for Building and Exploring the Human Reference Atlas with Virtual Reality

“…VR offers unique means to explore spatial and abstract data in a unified, immersive, and presence-enhancing environment beyond traditional WIMP interfaces, i.e., windows, icons, menu, pointer (Van Dam, 1997). While exploring 3D reference organs and tissue blocks on a 2D screen can be learned (Bueckle et al, 2021(Bueckle et al, , 2022, many users have issues interacting with 3D objects on a 2D screen. visualizations at various viewpoints (Camp et al, 1998), and to create visualizations of intricate molecular structures and biomolecular systems (Chavent et al, 2011;Gill and West, 2014;Trellet et al, 2018;Wiebrands et al, 2018).…”

“…The anatomical structures in the ASCT+B tables are linked to anatomical structures in the 3D reference organs via a crosswalk (Bruce W. Herr II, 2022). Using the Registration User Interfaces (RUI) and the EUI (Bueckle et al, 2021, 2022; Börner et al, 2022) 3D reference organs are used to register 3D tissue blocks from diverse donors into the HRA. The specimen data for each tissue block is tracked to support filter, search, and exploration by donor demographics using the CCF Ontology (Herr et al, 2022).…”

“…VR offers unique means to explore spatial and abstract data in a unified, immersive, and presence-enhancing environment beyond traditional WIMP interfaces, i.e., windows, icons, menu, pointer (Van Dam, 1997). While exploring 3D reference organs and tissue blocks on a 2D screen can be learned (Bueckle et al, 2021, 2022), many users have issues interacting with 3D objects on a 2D screen.…”

The HRA Organ Gallery affords immersive superpowers for building and exploring the Human Reference Atlas with virtual reality

“…The anatomical structures in the ASCT+B tables are linked to anatomical structures in the 3D reference organs via a crosswalk ( Quardokus et al, 2022 ). Using the Registration User Interface (RUI) and the EUI ( Bueckle et al, 2021 ; Bueckle et al, 2022 ; Börner et al, 2022 ), 3D reference organs are used to register 3D tissue blocks from diverse donors into the HRA. The specimen data for each tissue block is tracked to support filter, search, and exploration by donor demographics using the CCF Ontology ( Herr et al, 2023 ).…”

“…VR offers unique means to explore spatial and abstract data in a unified, immersive, and presence-enhancing environment beyond traditional WIMP interfaces, i.e., windows, icons, menus, pointer ( Van Dam, 1997 ). While exploring 3D reference organs and tissue blocks on a 2D screen can be learned ( Bueckle et al, 2021 ; Bueckle et al, 2022 ), many users have issues interacting with 3D objects on a 2D screen.…”