A theory of plenoptic multiplexing

Ihrke, Ivo; Wetzstein, Gordon; Heidrich, Wolfgang

doi:10.1109/cvpr.2010.5540174

Cited by 18 publications

(37 citation statements)

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Modulators that optically encode light properties in different spatial frequency bands have been proposed for the acquisition of light fields [26,25] and occluder information [12]. The corresponding reconstruction has usually been performed in the Fourier domain, although a recent analysis [11] shows that a spatial reconstruction is possible. Compared to standard spatial multiplexing techniques, Fourier multiplexing methods allow for a superior light transmission and potentially increased signal-to-noise ratio (SNR) of the demultiplexed signal.…”

Section: Introduction and Related Workmentioning

confidence: 99%

Sensor saturation in Fourier multiplexed imaging

Wetzstein

Ihrke

Heidrich

2010

2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Self Cite

View full text Add to dashboard Cite

Optically multiplexed image acquisition techniques have become increasingly popular for encoding different exposures, color channels, light fields, and other properties of light onto two-dimensional image sensors. Recently, Fourier-based multiplexing and reconstruction approaches have been introduced in order to achieve a superior light transmission of the employed modulators and better signalto-noise characteristics of the reconstructed data.We show in this paper that Fourier-based reconstruction approaches suffer from severe artifacts in the case of sensor saturation, i.e. when the dynamic range of the scene exceeds the capabilities of the image sensor. We analyze the problem, and propose a novel combined optical light modulation and computational reconstruction method that not only suppresses such artifacts, but also allows us to recover a wider dynamic range than existing image-space multiplexing approaches.

show abstract

Section: Introduction and Related Workmentioning

confidence: 99%

Sensor saturation in Fourier multiplexed imaging

Wetzstein

Ihrke

Heidrich

2010

2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition

Self Cite

View full text Add to dashboard Cite

show abstract

“…Other researchers performed demosaicing [74] or computed 3D occluders and cast shadows [75] in the frequency domain. Despite the large differences between the analyses in the two domains, Ihrke et al [76] proved that the spatial techniques in computational photography can find a corresponding explanation in the frequency domain, and vice versa.…”

Section: Computational Reconstructionmentioning

confidence: 99%

“…In signal processing, multiplexing is a technique of projecting high dimensional data onto a lower dimension, with a typical example being the widely-used Bayer pattern [160]. Ihrke et al's paper [76] puts much previous work in computational photography into this framework. In light field capture, multiplexing is also used to project multiple slices of the plenoptic function onto a 2D image.…”

Section: Light Field Capture-plenoptic Camerasmentioning

confidence: 99%

An overview of computational photography

Suo

Dai

2012

Sci. China Inf. Sci.

View full text Add to dashboard Cite

Computational photography is an emerging multidisciplinary field. Over the last two decades, it has integrated studies across computer vision, computer graphics, signal processing, applied optics and related disciplines. Researchers are exploring new ways to break through the limitations of traditional digital imaging for the benefit of photographers, vision and graphics researchers, and image processing programmers. Thanks to much effort in various associated fields, the large variety of issues related to these new methods of photography are described and discussed extensively in this paper. To give the reader the full picture of the voluminous literature related to computational photography, this paper briefly reviews the wide range of topics in this new field, covering a number of different aspects, including: (i) the various elements of computational imaging systems and new sampling and reconstruction mechanisms; (ii) the different image properties which benefit from computational photography, e.g. depth of field, dynamic range; and (iii) the sampling subspaces of visual scenes in the real world. Based on this systematic review of the previous and ongoing work in this field, we also discuss some open issues and potential new directions in computational photography. This paper aims to help the reader get to know this new field, including its history, ultimate goals, hot topics, research methodologies, and future directions, and thus build a foundation for further research and related developments.

show abstract

“…Its most familiar application is color imaging via a color filter array. The concept has, however, been extended, to cover all plenoptic dimensions and even devices that do not exploit physical per-pixel filters such as lenslet and mask-based light-field cameras can be interpreted this way [Ihrke et al 2010]. The major drawback of this solution are custom sensor designs or the permanent modification of standard sensors.…”

Section: Introductionmentioning

confidence: 99%

A reconfigurable camera add-on for high dynamic range, multispectral, polarization, and light-field imaging

Manakov

Tamayo

Klehm³

et al. 2013

ACM Trans. Graph.

Self Cite

View full text Add to dashboard Cite

We propose a non-permanent add-on that enables plenoptic imaging with standard cameras. Our design is based on a physical copying mechanism that multiplies a sensor image into a number of identical copies that still carry the plenoptic information of interest. Via different optical filters, we can then recover the desired information. A minor modification of the design also allows for aperture subsampling and, hence, light-field imaging. As the filters in our design are exchangeable, a reconfiguration for different imaging purposes is possible. We show in a prototype setup that high dynamic range, multispectral, polarization, and light-field imaging can be achieved with our design.

show abstract

A theory of plenoptic multiplexing

Abstract: Multiplexing is a common

Cited by 18 publications

References 46 publications

Sensor saturation in Fourier multiplexed imaging

Sensor saturation in Fourier multiplexed imaging

An overview of computational photography

A reconfigurable camera add-on for high dynamic range, multispectral, polarization, and light-field imaging

Contact Info

Product

Resources

About