XR-OOM: MiXed Reality driving simulation with real cars for research and design

PassengXR: A Low Cost Platform for Any-Car, Multi-User, Motion-Based Passenger XR Experiences

“…Virtual Reality (VR) and Augmented Reality (AR) have been used in a range of automotive research. Most work is aimed at the driver of the vehicle (e.g., [12,13,15,21,41,49]) or, as autonomous vehicles become more prevalent, pedestrians who may need to gain information about the car (e.g., [30,39,41]. Comparatively few papers have investigated the design of passenger experiences [41].…”

“…VR-OOM [15] and XR-OOM [13,14] are open-source software platforms to help researchers design in-vehicle VR and AR interfaces for drivers, respectively. Both are PC-based systems that use an IMU to detect vehicle rotation and OBD-II for velocity, while XR-OOM also uses LIDAR and a ZED2 camera to track the vehicles position within a known external environment.…”

“…Conducting research into the design of in-vehicle eXtended Reality (XR) interfaces can have high costs (e.g., driving simulators, buying/hiring real cars, expensive sensors) and can be practically challenging: maintaining stable and accurate tracking, developing the necessary functionality, having limited access to real driving data, etc. With the rise of autonomous cars, research is increasingly looking to make use of, or counteract, the real motion and location of the vehicle for the design of in-car interfaces and experiences for passengers who can now use travel time for leisure, entertainment or productivity [13,15,17,18,52].…”

“…~6DoF Tracked Volvo [12] PC ✓ ṼR-OOM [15] PC ✓ ~XR-OOM [13] PC ✓ ✓ ✓ ~Holoride [18] Standalone ✓ ??? ~??…”

How can a robot help people draw?

“…display is more akin to a screen than to lines on a foor [1]. In another project, I contributed to building an augmented reality system inside of a car in order to simulate virtual objects inside and outside the vehicle for driving experiments [4]. My latest paper presents the study I developed to understand social discomfort based on interaction analysis of family car trip videos, which is currently in revision.…”