Real-time patch sweeping for high-quality depth estimation in 3D video conferencing applications

Waizenegger, Wolfgang; Feldmann, Ingo; Schreer, Oliver

doi:10.1117/12.872868

Cited by 14 publications

(12 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…For a calibrated stereo camera setup on top of the displays arbitrary virtual cameras can be defined in relation to this model. Details about this approach can be found in [1].…”

Section: A Concept For Eye Contact Provisionmentioning

confidence: 99%

“…First we look up the depth values for the iris region. These values are available due to the 3D analysis done by the proposed video communication system [1]. In order to obtain an initial position of the eyeball center we fit a spatial eye plane according to the depth values in the iris region by a least squares approach.…”

Section: Stereo Gaze Estimationmentioning

confidence: 99%

“…The conferee still needs to decide whether to look into the camera or directly to the screen. Recently, a solution to this problem was presented which is based on a real-time 3D modeling of the conferees [1]. In order to achieve direct eye contact the authors defined a virtual camera directly on the screen in the eyes of the remote conferee.…”

Section: Introductionmentioning

confidence: 99%

“…Recently, algorithmic concepts based on Hybrid Recursive Matching (HRM) and Patch-Sweeping [6] [1] have been proposed to account for these requirements. However, the provision of convincing eye contact not only depends on the high quality of the novel rendered view but also on the accuracy of the estimated perspective of the virtual camera.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Model based 3D gaze estimation for provision of virtual eye contact

Waizenegger

Atzpadin

Schreer

et al. 2012

2012 19th IEEE International Conference on Image Processing

View full text Add to dashboard Cite

In recent years, video communication has received a rapidly increasing interest on the market. Still unsolved is the problem of eye contact. The conferee still needs to decide whether to look into the camera or directly to the screen. Recently, a solution to this problem was presented which is based on a real-time 3D modeling of the conferees [1]. In order to achieve direct eye contact the authors defined a virtual camera directly on the screen in the eyes of the remote conferee. This paper discusses the problem of adequately positioning this virtual camera. A new approach will be presented which performs an eye and gaze tracking directly on the real-time 3D model rather than on the 2D image. Our methods not only provides robust and highly accurate results but is also able to additionally measure the distance between the conferees eye and the display with high precision.

show abstract

“…For a calibrated stereo camera setup on top of the displays arbitrary virtual cameras can be defined in relation to this model. Details about this approach can be found in [1].…”

Section: A Concept For Eye Contact Provisionmentioning

confidence: 99%

Section: Stereo Gaze Estimationmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Model based 3D gaze estimation for provision of virtual eye contact

Waizenegger

Atzpadin

Schreer

et al. 2012

2012 19th IEEE International Conference on Image Processing

View full text Add to dashboard Cite

show abstract

“…[1] [2], but the rendering quality did not gain user acceptance. An improved solution has been proposed in [3], but the focus was on realistic rendering of the face region. Rendering of upper body representations of human beings is not only relevant for video communication, but also in other fields of application.…”

Section: Introductionmentioning

confidence: 99%

Scene flow constrained multi-prior patch-sweeping for real-time upper body 3D reconstruction

Waizenegger

Feldmann

Schreer

et al. 2013

2013 IEEE International Conference on Image Processing

View full text Add to dashboard Cite

We present a high performance real-time approach for robust 3D structure estimation of human bodies. Our idea extends state of the art high precision patch-sweep techniques by exploiting temporal information. By parameterizing 3D patches in the spatio-temporal domain we gain increased quality and robustness, while the computational complexity decreases drastically. The key to these improvements is the utilization of a global scene flow like prior called spatio-temporal object (STO). The target application of our method reaches from video communication and virtual eye contact scenarios till future digital cinema 3D post-production and real-time person modelling and modification. The result of this work extends a novel 3D scene representation developed in the EC research project SCENE

show abstract

Multi‐view reconstruction of dynamic real‐world objects and their integration in augmented and virtual reality applications

et al. 2017

Self Cite

View full text Add to dashboard Cite

We present a flexible system for high-quality three-dimensional reconstruction of dynamic real-world objects based on a modular multi-camera capture setup. The proposed algorithmic pipeline aims at the acquisition and digitization of natural and realistic representations of real people that can be easily integrated into augmented and virtual reality applications. In this context, we discuss the reduction of mesh complexity as one of the key challenges for visualizing reconstructed three-dimensional content with augmented and virtual reality glasses and demonstrate different fields of application

show abstract

Real-time patch sweeping for high-quality depth estimation in 3D video conferencing applications

Cited by 14 publications

References 0 publications

Model based 3D gaze estimation for provision of virtual eye contact

Model based 3D gaze estimation for provision of virtual eye contact

Scene flow constrained multi-prior patch-sweeping for real-time upper body 3D reconstruction

Multi‐view reconstruction of dynamic real‐world objects and their integration in augmented and virtual reality applications

Contact Info

Product

Resources

About