View generation with 3D warping using depth information for FTV

Mori, Yoshihiro; Fukushima, Norishige; Yendo, Tomohiro; Fujii, Toshiaki; Tanimoto, Masayuki

doi:10.1016/j.image.2008.10.013

Cited by 254 publications

(63 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…The conventional view extrapolation result based on one primary view (PV) is denoted by PV, while the PV plus the full warping and the selective warping (SW) of one complementary view (CV) are referred to as PV+CV and PV+SW CV, respectively. Note that the conventional hole filling process based on image inpainting [14], [23] is disabled in the current setting as the objective of the experiments is to evaluate the hole size in terms of number of pixels in the holes by different approaches. Also a margin of 60 pixels to the image boundaries is not counted as the holes since the holes in this area are mainly due to the difference in the capture angle or range of each camera instead of disocclusion.…”

Section: Resultsmentioning

confidence: 99%

Hole Filling With Multiple Reference Views in DIBR View Synthesis

Zhu

Sun

2018

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

Section: Resultsmentioning

confidence: 99%

Hole Filling With Multiple Reference Views in DIBR View Synthesis

Zhu

Sun

2018

IEEE Trans. Multimedia

View full text Add to dashboard Cite

show abstract

“…26 3-D warping projects an image to another image plane. It can be decomposed into two fundamental steps.…”

Section: Proposed Object-based Depth Image-based-rendering Methods By mentioning

confidence: 99%

Object-based depth image–based rendering for a three-dimensional video system by color-correction optimization

Shao

Jiang

et al. 2011

Opt. Eng

View full text Add to dashboard Cite

Downloaded From: http://opticalengineering.spiedigitallibrary.org/ on 05/15/2015 Terms of Use: http://spiedl.org/termsAbstract. Three-dimensional (3-D) video technologies are becoming increasingly popular because they can provide high quality and immersive experience to end users. Depth image-based rendering (DIBR) is a key technology in 3-D video systems due to its low bandwidth cost as well as the arbitrary rendering viewpoint. We propose an object-based DIBR method by color-correction optimization. The proposed method first performs temporal consistent rendering to reduce the rendering complexity. Then, by segmenting the depth map into foreground and background, the object-based scalable rendering is performed to improve the rendering quality and reduce the rendering complexity. Finally, the rendered virtual view is further optimized by color-correction operation. Experimental results show that, compared to the results without the above optimization operations, the proposed method can reduce >40% computational complexity while maintaining high rendering quality. C 2011 Society of Photo-Optical Instrumentation Engineers (SPIE).

show abstract

“…To ensure a free scene navigation with no switching-delay, the client chooses to download representations that permit to reconstruct all viewpoints in the navigation window w(u). Given a set of dowloaded representations, any virtual viewpoint u can be synthesized using a pair of left and right reference view images v L and v R in the downloaded set, with v L < u < v R , via a classical DIBR techniques, e.g., [34]. We denote by v any camera view (thus any possible anchor view) while u represents any viewpoint (either virtual viewpoint or camera view) that can be displayed during the navigation.…”

Section: System Modelmentioning

confidence: 99%

Optimal Representations for Adaptive Streaming in Interactive Multiview Video Systems

Toni

Frossard

2017

IEEE Trans. Multimedia

View full text Add to dashboard Cite

Interactive multi-view video streaming (IMVS) services permit to remotely immerse within a 3D scene. This is possible by transmitting a set of reference camera views (anchor views), which are used by the clients to freely navigate in the scene and possibly synthesize additional viewpoints of interest. From a networking perspective, the big challenge in IMVS systems is to deliver to each client the best set of anchor views that maximizes the navigation quality, minimizes the view-switching delay and yet satisfies the network constraints. Integrating adaptive streaming solutions in free-viewpoint systems offers a promising solution to deploy IMVS in large and heterogeneous scenarios, as long as the multi-view video representations on the server are properly selected. We therefore propose to optimize the multi-view data at the server by minimizing the overall resource requirements, yet offering a good navigation quality to the different users. We propose a video representation set optimization for multiview adaptive streaming systems and we show that it is NP-hard. We therefore introduce the concept of multi-view navigation segment that permits to cast the video representation set selection as an integer linear programming problem with a bounded computational complexity. We then show that the proposed solution reduces the computational complexity while preserving optimality in most of the 3D scenes. We then provide simulation results for different classes of users and show the gain offered by an optimal multi-view video representation selection compared to recommended representation sets (e.g., Netflix and Apple ones) or to a baseline representation selection algorithm where the encoding parameters are decided a priori for all the views.L. Toni and P. Frossard are with Ecole Polytechnique Fédérale de Lausanne (EPFL), Signal Processing Laboratory -LTS4,

show abstract

View generation with 3D warping using depth information for FTV

Cited by 254 publications

References 9 publications

Hole Filling With Multiple Reference Views in DIBR View Synthesis

Hole Filling With Multiple Reference Views in DIBR View Synthesis

Object-based depth image–based rendering for a three-dimensional video system by color-correction optimization

Optimal Representations for Adaptive Streaming in Interactive Multiview Video Systems

Contact Info

Product

Resources

About