Virtualized reality: constructing virtual worlds from real scenes

Kanade, Takeo; Rander, Peter; Narayanan, P. J.

doi:10.1109/93.580394

Cited by 531 publications

(281 citation statements)

References 17 publications

(8 reference statements)

Supporting

Mentioning

279

Contrasting

Unclassified

Order By: Relevance

“…Approaches to modelling include 3D scanning [6], reconstruction from static images [7,8], multiple view images [4,9] and reconstruction from multiple view video [1,10,11]. Kanade et al [1] and Moezzi et al [10] introduced reconstruction of sequences of people from multiple view video.…”

Section: Related Workmentioning

confidence: 99%

“…A novel multiple resolution model fitting technique is presented that combines multiple shape cues from camera images for robust coarse-to-fine model-based reconstruction with preservation of animation structure. Previous work concentrates on reconstructing dynamic shape to render the appearance of people from a novel viewpoint, termed free-viewpoint video [1,2]. These techniques have no prior scene structure to construct a consistent representation that can be instrumented for animation and synthesis of new content.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Model-based human shape reconstruction from multiple views

Starck

Hilton

2008

Computer Vision and Image Understanding

View full text Add to dashboard Cite

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Model-based human shape reconstruction from multiple views

Starck

Hilton

2008

Computer Vision and Image Understanding

View full text Add to dashboard Cite

“…The combination of stereo reconstruction with visual hull rendering leads to a more faithful reconstruction of surface concavities [25]. Stereo methods have also been applied to reconstruct and render dynamic scenes [57,20], some of them employing active illumination [49]. On the other hand, light field rendering [24] is employed in the 3D TV system [29] to enable simultaneous scene acquisition and rendering in real-time.…”

Section: Free-viewpoint Videomentioning

confidence: 99%

Video-based Capturing and Rendering of People

2008

View full text Add to dashboard Cite

Abstract. The interesting combination of Chapters in this book gives a nice overview of the importance of the analysis of human motion in three different scientific disciplines, computer vision, biomechanics, and computer graphics. In the computer vision field the main goal has been to develop robust and efficient techniques for capturing and measuring human motion. Researchers from biomechanics, on the other hand, try to capitalize on such measurement methods to analyze the characteristics of human motion. In contrast, the focus of computer graphics research has been to realistically animate and render moving humans. In this Chapter, we will outline that a joint solution to the acquisition, the reconstruction, and the rendering problem paves the trail for video-based capturing and rendering of people. We present a model-based system to create realistic 3D videos of human actors that puts this idea into practice. Our method enables us to capture human actors with multiple video cameras and to render their performances in real-time from arbitrary novel viewpoints and under arbitrary novel lighting conditions.

show abstract

“…FVVR has been applied successfully in sports TV production [4,5] and video conferencing [6] among other applications. In FVVR, video from several cameras is used to reconstruct scene geometry using Multiple-View Stereo (MVS), and appearance is reproduced by projectively texturing the scene with the original images [7].…”

Section: Introductionmentioning

confidence: 99%

Intrinsic Textures for Relightable Free-Viewpoint Video

Imber

Guillemaut

Hilton

2014

Computer Vision – ECCV 2014

View full text Add to dashboard Cite

Abstract. This paper presents an approach to estimate the intrinsic texture properties (albedo, shading, normal) of scenes from multiple view acquisition under unknown illumination conditions. We introduce the concept of intrinsic textures, which are pixel-resolution surface textures representing the intrinsic appearance parameters of a scene. Unlike previous video relighting methods, the approach does not assume regions of uniform albedo, which makes it applicable to richly textured scenes. We show that intrinsic image methods can be used to refine an initial, low-frequency shading estimate based on a global lighting reconstruction from an original texture and coarse scene geometry in order to resolve the inherent global ambiguity in shading. The method is applied to relighting of free-viewpoint rendering from multiple view video capture. This demonstrates relighting with reproduction of fine surface detail. Quantitative evaluation on synthetic models with textured appearance shows accurate estimation of intrinsic surface reflectance properties.

show abstract

Virtualized reality: constructing virtual worlds from real scenes

Cited by 531 publications

References 17 publications

Model-based human shape reconstruction from multiple views

Model-based human shape reconstruction from multiple views

Video-based Capturing and Rendering of People

Intrinsic Textures for Relightable Free-Viewpoint Video

Contact Info

Product

Resources

About