A Geometric Analysis of Light Field Rendering

Lin, Zhouchen; Shum, Heung-Yeung

doi:10.1023/b:visi.0000015916.91741.27

Cited by 84 publications

(40 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, inherent effects such as occlusions are concentrated in space and hence contribute to spread the band of the function. Similarly to rendering with layers [15], the individual depth variations are much smaller in each of the extracted coherent volumes and an aliasing free rendering for each region can be achieved with less cameras. In order to demonstrate the reduced aliasing, we render a viewpoint using linear interpolation.…”

Section: View Interpolationmentioning

confidence: 99%

Unsupervised extraction of coherent regions for image based rendering

Berent¹,

Dragotti

2007

Procedings of the British Machine Vision Conference 2007

View full text Add to dashboard Cite

Image based rendering using undersampled light fields suffers from aliasing effects. These effects can be drastically reduced by using some geometric information. In pop-up light field rendering [18], the scene is segmented into coherent layers, usually corresponding to approximately planar regions, that can be rendered free of aliasing. As opposed to the supervised method in the pop-up light field, we propose an unsupervised extraction of coherent regions. The problem is posed in a multidimensional variational framework using the level set method [16]. Since the segmentation is done jointly over all the images, coherence can be imposed throughout the data. However, instead of using active hypersurfaces, we derive a semi-parametric methodology that takes into account the constraints imposed by the camera setup and the occlusion ordering. The resulting framework is a global multidimensional region competition that is consistent in all the images and efficiently handles occlusions. We show the validity of the method with some captured multi-view datasets. Other special effects by coherent region manipulation are also demonstrated.

show abstract

Section: View Interpolationmentioning

confidence: 99%

Unsupervised extraction of coherent regions for image based rendering

Berent¹,

Dragotti

2007

Procedings of the British Machine Vision Conference 2007

View full text Add to dashboard Cite

show abstract

“…The first reason is that it does not require geometry information but only relies on scene images which can be easily captured by common digital cameras [22]. Second, it avoids building complex models, such as depth values or image correspondences, to extract the image values.…”

Section: Light Field Renderingmentioning

confidence: 99%

Robust Multi-Bit Watermarking for Free-View Television Using Light Field Rendering

Tian

Zhao

Wang

et al. 2013

IEICE Trans. Inf. & Syst.

View full text Add to dashboard Cite

SUMMARYWith the rapid development of multi-view video coding (MVC) and light field rendering (LFR), Free-View Television (FTV) has emerged as new entrainment equipment, which can bring more immersive and realistic feelings for TV viewers. In FTV broadcasting system, the TV-viewer can freely watch a realistic arbitrary view of a scene generated from a number of original views. In such a scenario, the ownership of the multi-view video should be verified not only on the original views, but also on any virtual view. However, capacities of existing watermarking schemes as copyright protection methods for LFR-based FTV are only one bit, i.e., presence or absence of the watermark, which seriously impacts its usage in practical scenarios. In this paper, we propose a robust multi-bit watermarking scheme for LFR-based free-view video. The direct-sequence code division multiple access (DS-CDMA) watermark is constructed according to the multi-bit message and embedded into DCT domain of each view frame. The message can be extracted bit-by-bit from a virtual frame generated at an arbitrary view-point with a correlation detector. Furthermore, we mathematically prove that the watermark can be detected from any virtual view. Experimental results also show that the watermark in FTV can be successfully detected from a virtual view. Moreover, the proposed watermark method is robust against common signal processing attacks, such as Gaussian filtering, salt & peppers noising, JPEG compression, and center cropping.

show abstract

“…As the difference in disparities increases or the search window shrinks, a higher sampling rate, and thus, a greater number of virtual images, is required to avoid aliasing in the mosaic result. Although beyond the scope of this paper, a more detailed explanation of this topic is provided elsewhere [5] [12].…”

Section: Synthesis Of Virtual Imagesmentioning

confidence: 99%

Overcoming Parallax and Sampling Density Issues in Image Mosaicing of Non-Planar Scenes

Cooperstock

2007

Procedings of the British Machine Vision Conference 2007

View full text Add to dashboard Cite

Image mosaicing constructs a wide field-of-view result from multiple source frames. In order to ensure a perceptually correct result, mosaicing typically requires either a planar or near-planar scene, parallax-free camera motion between source frames, or a dense sampling of the scene. When these conditions are not satisfied, various artifacts may result. A novel mosaicing approach is introduced that overcomes these limitations, building on the techniques of image-based rendering and manifold mosaicing, while permitting the synthesis of an effective mosaic of a non-planar scene from a sparse set of translated cameras. Our method first generates a series of intermediate virtual frames to reduce the disparities between neighboring images. Next, a series of vertical slices are chosen from the array of both real and virtual frames and connected according to a cost function that maximizes the similarity between adjacent slices. Experimental results indicate significant improvements over competing methods.

show abstract

A Geometric Analysis of Light Field Rendering

Cited by 84 publications

References 23 publications

Unsupervised extraction of coherent regions for image based rendering

Unsupervised extraction of coherent regions for image based rendering

Robust Multi-Bit Watermarking for Free-View Television Using Light Field Rendering

Overcoming Parallax and Sampling Density Issues in Image Mosaicing of Non-Planar Scenes

Contact Info

Product

Resources

About