From Focal Stack to Tensor Light-Field Display

Takahashi, Keita; Kobayashi, Yasuhiro; Fujii, Toshiaki

doi:10.1109/tip.2018.2839263

Cited by 52 publications

(40 citation statements)

References 27 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2, April 2019 using a focal stack. The focal stack is composed of only a few images each of which have different focus distance, and can be used for calculating layer patterns [20]. The focal stack can be obtained by shift-and-add operations on a light field or by an ordinary camera.…”

Section: Discussionmentioning

confidence: 99%

“…To verify the coding efficiency of two frameworks described above, simulative experiments were conducted using two light field still-image datasets and a light field video dataset. We utilized published software for calculating layer patterns published by [20]. In experiments, a light field and layer patterns are encoded, and then reproduction of light field with the compressive display is simulated using decoded materials.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Light Field Compression for Compressive 3D Display

Isechi¹

2019

IJMLC

View full text Add to dashboard Cite

Section: Discussionmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Light Field Compression for Compressive 3D Display

Isechi¹

2019

IJMLC

View full text Add to dashboard Cite

“…Thanks to the distance separating the LCD panels in the display, the image perceived depends on the observer's position and is proportional to the product of the layers. This layer representation has similarities with the one presented in this paper, and it can be constructed either from the Light Field views [25], [26] or from a focal stack [27]. The main difference however, is that, because of the physics of the light attenuating LCD layers, the sub-aperture images of the Light Field are reconstructed as a product of the layers' pixels instead of a sum.…”

Section: Related Workmentioning

confidence: 99%

A Fourier Disparity Layer Representation for Light Fields

Pendu

Guillemot

Smolić

2019

IEEE Trans. on Image Process.

106

View full text Add to dashboard Cite

In this paper, we present a new Light Field representation for efficient Light Field processing and rendering called Fourier Disparity Layers (FDL). The proposed FDL representation samples the Light Field in the depth (or equivalently the disparity) dimension by decomposing the scene as a discrete sum of layers. The layers can be constructed from various types of Light Field inputs including a set of sub-aperture images, a focal stack, or even a combination of both. From our derivations in the Fourier domain, the layers are simply obtained by a regularized least square regression performed independently at each spatial frequency, which is efficiently parallelized in a GPU implementation. Our model is also used to derive a gradient descent based calibration step that estimates the input view positions and an optimal set of disparity values required for the layer construction. Once the layers are known, they can be simply shifted and filtered to produce different viewpoints of the scene while controlling the focus and simulating a camera aperture of arbitrary shape and size. Our implementation in the Fourier domain allows real time Light Field rendering. Finally, direct applications such as view interpolation or extrapolation and denoising are presented and evaluated.

show abstract

“…The layer patterns to be displayed in each light-attenuating layers can be obtained from the multi-view light field data through Non-negative Tensor Factorization (NTF) [20]. Recently, a new method has been proposed to generate the layer patterns from a stack of focused images (focal stack), which greatly reduces the number of images that are needed as input for the tensor displays [16]. The method was tested on a prototype 3D display to prove its efficacy [9].…”

Section: Introductionmentioning

confidence: 99%

A comprehensive framework for visual quality assessment of light field tensor displays

Viola¹,

Takahashi²,

Fujii³

et al. 2019

Self Cite

View full text Add to dashboard Cite

In recent years, light field technology has attracted the interest of academia and industry, thanks to the possibility of rendering 3D scenes in a more realistic and immersive way. In particular, light field displays have been consistently investigated for their ability to offer a glass-free 3D viewing experience. Among others, tensor displays represent a promising way to render light field contents. However, only a few prototypes of such type of displays have been implemented and are available to the scientific community. As a direct consequence, the visual quality of such displays has not been rigorously investigated. In this paper, we propose a new framework to assess the visual quality of light field tensor displays on conventional 2D screens. The multilayer components of the tensor displays are virtually rendered on a typical 2D monitor through the use of a GUI, and different viewing angles can be accessed by simple mouse interactions. Both single and double stimulus methodologies for subjective quality assessment of light field contents are supported in this framework, while the total time of interaction is recorded for every stimulus. Results obtained in two different laboratory settings demonstrate that the framework can be successfully used to perform subjective quality assessment of different compression solutions for light field tensor displays.

show abstract

From Focal Stack to Tensor Light-Field Display

Cited by 52 publications

References 27 publications

Light Field Compression for Compressive 3D Display

Light Field Compression for Compressive 3D Display

A Fourier Disparity Layer Representation for Light Fields

A comprehensive framework for visual quality assessment of light field tensor displays

Contact Info

Product

Resources

About