Shape-from-Silhouettes Algorithm with Built-in Occlusion Detection and Removal

Abstract

Abstract:Occlusion and inferior foreground/background segmentation still poses a big problem to 3D reconstruction from a set of images in a multi-camera system because it has a destructive nature on the reconstruction if one or more of the cameras do not see the object properly. We propose a method to obtain a 3D reconstruction which takes into account the possibility of occlusion by combining the information of all cameras in the multicamera setup. The proposed algorithm tries to find a consensus of geometrical predicates that most cameras can agree on. The results show a performance with an average error lower than 2cm on the centroid of a person in case of perfect input silhouettes. We also show that tracking results are significantly improved in a room with a lot of occlusion.

Preaching Voxels: An Alternative Approach to Mixed Reality

“…Such methods have been extended to largevolume mapping (Dai et al, 2017) and real-time reconstruction of dynamic scenes (Dou et al, 2013(Dou et al, , 2016Newcombe et al, 2015;Innmann et al, 2016). Voxels also provide a convenient representation for silhouette-based reconstruction (Slembrouck et al, 2015) as they can explicitly represent free-space. Again, these approaches have been successfully extended to real-time reconstruction of dynamic scenes (Cheung et al, 2000;Sridhar and Sowmya, 2009).…”