Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended Reality

Abstract

Meta Reality Labs Research (a) (b) (c) (d) Figure 1: Overview of the Fast-Forward Reality workflow: (a) An end-user initiates an authoring session of a context-aware policy (CAP) while being immersed in an Extended Reality (XR) authoring environment. The user includes context instances into the CAP by selecting the corresponding XR icons. (b) The system adaptively generates multiple unit test cases based on the context history of the user's everyday routines and the CAP, and highlights them with XR visualizations. (c) The user acts out the suggested test cases by in-situ actions and selections of the involved context instances to intuitively validate whether the CAP reacts as expected under each test case. (d) The user refines the CAP after noticing potential improvements and repeats the validation until the CAP is error-free under all test cases.