Polyhedral Visual Hulls for Real-Time Rendering

Matusik, Wojciech; Buehler, Chris; McMillan, Leonard

doi:10.1007/978-3-7091-6242-2_11

Cited by 136 publications

(105 citation statements)

References 13 publications

Supporting

Mentioning

103

Contrasting

Unclassified

Order By: Relevance

“…The user provides segmented images as input, and our software provides a visual hull model of the object. Other methods [10,8] typically require specialist equipment such as turntables, calibration objects, or multi-camera setups. Fig.…”

Section: Introductionmentioning

confidence: 99%

Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera

Forbes

Nicolls

Jager

et al. 2006

Computer Vision – ECCV 2006

View full text Add to dashboard Cite

Abstract. Two planar mirrors are positioned to show five views of an object, and snapshots are captured from different viewpoints. We present closed form solutions for calculating the focal length, principal point, mirror and camera poses directly from the silhouette outlines of the object and its reflections. In the noisy case, these equations are used to form initial parameter estimates that are refined using iterative minimisation. The self-calibration allows the visual cones from each silhouette to be specified in a common reference frame so that the visual hull can be constructed. The proposed setup provides a simple method for creating 3D multimedia content that does not rely on specialised equipment. Experimental results demonstrate the reconstruction of a toy horse and a locust from real images. Synthetic images are used to quantify the sensitivity of the self-calibration to quantisation noise. In terms of the silhouette calibration ratio, degradation in silhouette quality has a greater effect on silhouette set consistency than computed calibration parameters.

show abstract

Section: Introductionmentioning

confidence: 99%

Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera

Forbes

Nicolls

Jager

et al. 2006

Computer Vision – ECCV 2006

View full text Add to dashboard Cite

show abstract

“…Polyhedral geometry [20,39] has become a popular representation of hull structure. To speed up the process, Li et al [36], Duckworth and Roberts [17] developed GPU-accelerated reconstruction methods.…”

Section: Visibility Methodsmentioning

confidence: 99%

Real-time scene reconstruction and triangle mesh generation using multiple RGB-D cameras

Meerits

Nozick

Saitō

2017

J Real-Time Image Proc

View full text Add to dashboard Cite

We present a novel 3D reconstruction system that can generate a stable triangle mesh using data from multiple RGB-D sensors in real time for dynamic scenes. The first part of the system uses moving least squares (MLS) point set surfaces to smooth and filter point clouds acquired from RGB-D sensors. The second part of the system generates triangle meshes from point clouds. The whole pipeline is executed on the GPU and is tailored to scale linearly with the size of the input data. Our contributions include changes to the MLS method for improving meshing, a fast triangle mesh generation method and GPU implementations of all parts of the pipeline.

show abstract

“…Another method for constructing the visual hull models using voxels was proposed, but the processing was done off-line (Moezzi et al 1996). An algorithm constructing an exact polyhedral representation of the visual hull was presented by Matusik et al (2001), but exhibited performance unsuitable for real-time tracking of Drosophila.…”

Section: Previous Workmentioning

confidence: 99%

O fly, where art thou?

Grover

Tower

Tavaré

2008

J. R. Soc. Interface.

View full text Add to dashboard Cite

In this paper, the design of a real-time image acquisition system for tracking the movement of Drosophila in three-dimensional space is presented. The system uses three calibrated and synchronized cameras to detect multiple flies and integrates the detected fly silhouettes to construct the three-dimensional visual hull models of each fly. We used an extended Kalman filter to estimate the state of each fly, given past positions from the reconstructed fly visual hulls. The results show that our approach constructs the three-dimensional visual hull of each fly from the detected image silhouettes and robustly tracks them at real-time rates. The system is suitable for a more detailed analysis of fly behaviour.

show abstract

Polyhedral Visual Hulls for Real-Time Rendering

Cited by 136 publications

References 13 publications

Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera

Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera

Real-time scene reconstruction and triangle mesh generation using multiple RGB-D cameras

O fly, where art thou?

Contact Info

Product

Resources

About