Scalable 3D video of dynamic scenes

Waschbüsch, Michael; Würmlin, Stephan; Cotting, Daniel; Sadlo, Filip; Groß, Markus

doi:10.1007/s00371-005-0346-7

Cited by 98 publications

(61 citation statements)

References 34 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For example, the transmission of dynamic 3-D scenes, as acquired based on tools like the ones presented in [26], [27] necessitates the streaming of both the scene geometry and the texture information. Obviously, the texture information brings a large incremental benefit in quality, but is only useful if the scene geometry information is known.…”

Section: Discussionmentioning

confidence: 99%

Dependent Packet Transmission Policies in Rate-Distortion Optimized Media Scheduling

Vleeschouwer

Frossard

2007

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Abstract-This paper addresses the problem of streaming packetized media over a lossy packet network, with sender-driven (re)transmissions and receiver acknowledgments. It extends the Markovian formulation of the rate-distortion optimized (RaDiO) streaming framework by allowing the transmission schedule of a media data unit to become contingent on the acknowledgements relative to other data units. Media decoding dependencies are generally considered in state-of-the-art rate-distortion optimized scheduling algorithms. However, the set of eligible packet schedules are restricted to independent streaming policies, where the transmission strategy envisioned for a data unit at future transmission opportunities only depends on its own acknowledgment, and not on the acknowledgments received for other data units. This paper questions the validity of this assumption in the design of rate-distortion optimal streaming solutions, and provides a first attempt in the formal derivation of the benefit offered by dependent policies. One of the main contributions of our paper is to propose a methodology that limits the search space of dependent policies to relevant dependencies that are likely to bring a rate-distortion benefit, in order to solve an optimization problem that is a priori computationally intractable. Extensive simulations validate the proposed approach that focuses on relevant dependencies between streaming policies. We further show that the benefit of dependent streaming policies is actually marginal in practical scenarios where the gain in distortion per unit of rate decreases along the media decoding dependency path. It represents the first demonstration that the common assumption of independent streaming policies is valid in many common streaming scenarios. However, experimental results also demonstrate significant benefits and encourage a careful investigation of dependent policies when the content is characterized by an increase of the benefit per transmission unit brought along the data unit dependency path.

show abstract

Section: Discussionmentioning

confidence: 99%

Dependent Packet Transmission Policies in Rate-Distortion Optimized Media Scheduling

Vleeschouwer

Frossard

2007

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…Rendering virtual views of moving people from multiple cameras has since received considerable interest. Systems for multiple view reconstruction and videobased rendering have been developed [3], [4], [5], [6], [7], [8], [9]. These techniques create a 3D video, also called free-viewpoint video, at a quality that now approaches the original video images [10], [11].…”

Section: Related Work (Sidebar Refs [2]-[16])mentioning

confidence: 99%

Surface Capture for Performance-Based Animation

Starck

Hilton

2007

IEEE Comput. Grap. Appl.

410

365

View full text Add to dashboard Cite

Digital content production traditionally requires highly skilled artists and animators to first manually craft shape and appearance models and then instill the models with a believable performance. Motion capture technology is now increasingly used to record the articulated motion of a real human performance to increase the visual realism in animation. Motion capture is limited to recording only the skeletal motion of the human body and requires the use of specialist suits and markers to track articulated motion.In this paper we present surface capture, a fully automated system to capture shape and appearance as well as motion from multiple video cameras as a basis to create highly realistic animated content from an actor's performance in full wardrobe. We address wide-baseline scene reconstruction to provide 360 degree appearance from just 8 camera views and introduce an efficient scene representation for level of detail control in streaming and rendering. Finally we demonstrate interactive animation control in a computer games scenario using a captured library of human animation, achieving a frame rate of 300fps on consumer level graphics hardware. Index TermsImage-based modelling and rendering, Video-based character animation

show abstract

“…Many 3DV and FVV systems benefits from this idea [26,[81][82][83][84]92]. In [81], for example, a real-time 3D system is presented.…”

Section: Active Stereomentioning

confidence: 99%

“…3D video systems claiming high-quality rendering of point-based representations are available in literature [81][82][83]. In [82] each point of the representation is associated with its color, avoiding the use of textures.…”

Section: Point-based Representationmentioning

confidence: 99%