An open-source mobile-based system for synchronised multi-view capture and dynamic object reconstruction

Abstract

We present the first open-source mobile-based system to capture nearly-synchronous frame streams from multiple handheld Augmented Reality (AR) mobiles and a software to reconstruct a captured dynamic object. Our system includes an AR-based mobile application, a data manager server and software to post-process the frame streams. The mobile application can capture the frame stream while estimating the mobile pose. The data manager server handles the communications and the synchronisation, and collects the poses and the frames streamed by the mobiles. The post-processing software uses the captured data to produce a 3D skeleton or a volumetric reconstruction of the dynamic object.