A reconfigurable camera add-on for high dynamic range, multispectral, polarization, and light-field imaging

Manakov, Alkhazur; Tamayo, John Fernando Restrepo; Klehm, Oliver; Hegedüs, Ramón; Eisemann, Elmar; Seidel, Hans‐Peter; Ihrke, Ivo

doi:10.1145/2461912.2461937

Cited by 97 publications

(82 citation statements)

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The different exposures can be achieved by using varying neutral density (ND) filters in front of the sensors [1,8,16,19] or by clever setups of semi-transparent beam splitter arrangements [31]. These systems offer a major advantage over exposure time fusion methods in that they robustly handle motion of the camera and objects in the scene by using the same exposure time for each sensor.…”

Section: Hdr Capturementioning

confidence: 99%

Adaptive dualISO HDR reconstruction

Hajisharif

Kronander

Unger

2015

J Image Video Proc.

View full text Add to dashboard Cite

With the development of modern image sensors enabling flexible image acquisition, single shot high dynamic range (HDR) imaging is becoming increasingly popular. In this work, we capture single shot HDR images using an imaging sensor with spatially varying gain/ISO. This allows all incoming photons to be used in the imaging. Previous methods on single shot HDR capture use spatially varying neutral density (ND) filters which lead to wasting incoming light. The main technical contribution in this work is an extension of previous HDR reconstruction approaches for single shot HDR imaging based on local polynomial approximations (Kronander et al., Unified HDR reconstruction from raw CFA data, 2013; Hajisharif et al., HDR reconstruction for alternating gain (ISO) sensor readout, 2014). Using a sensor noise model, these works deploy a statistically informed filtering operation to reconstruct HDR pixel values. However, instead of using a fixed filter size, we introduce two novel algorithms for adaptive filter kernel selection. Unlike a previous work, using adaptive filter kernels (Signal Process Image Commun 29(2):203-215, 2014), our algorithms are based on analyzing the model fit and the expected statistical deviation of the estimate based on the sensor noise model. Using an iterative procedure, we can then adapt the filter kernel according to the image structure and the statistical image noise. Experimental results show that the proposed filter de-noises the noisy image carefully while well preserving the important image features such as edges and corners, outperforming previous methods. To demonstrate the robustness of our approach, we have exploited input images from raw sensor data using a commercial off-the-shelf camera. To further analyze our algorithm, we have also implemented a camera simulator to evaluate different gain patterns and noise properties of the sensor.

show abstract

Section: Hdr Capturementioning

confidence: 99%

Adaptive dualISO HDR reconstruction

Hajisharif

Kronander

Unger

2015

J Image Video Proc.

View full text Add to dashboard Cite

show abstract

“…A modern elaboration of this approach where the sensor and a micro-lens array are combined to form an incamera light-field imaging system is the Hand-Held Plenoptic Camera [17]. Alternatively, sensor masks [22,21] or a light pipe [15] can be arranged such that in-camera lightfields can be recorded. Other methods use external arrays of mirrors instead of lenses [7], or external lens arrays [4].…”

Section: Related Workmentioning

confidence: 99%

Light-Field Microscopy with a Consumer Light-Field Camera

Mignard-Debise

Ihrke

2015

2015 International Conference on 3D Vision

Self Cite

View full text Add to dashboard Cite

We explore the use of inexpensive consumer lightfield camera technology for the purpose of light-field microscopy. Our experiments are based on the Lytro (first generation) camera. Unfortunately, the optical systems of the Lytro and those of microscopes are not compatible, leading to a loss of light-field information due to angular and spatial vignetting when directly recording microscopic pictures. We therefore consider an adaptation of the Lytro optical system.We demonstrate that using the Lytro directly as an ocular replacement, leads to unacceptable spatial vignetting. However, we also found a setting that allows the use of the Lytro camera in a virtual imaging mode which prevents the information loss to a large extent. We analyze the new virtual imaging mode and use it in two different setups for implementing light-field microscopy using a Lytro camera. As a practical result, we show that the camera can be used for low magnification work, as e.g. common in quality control, surface characterization, etc. We achieve a maximum spatial resolution of about 6.25µm, albeit at a limited SNR for the side views.

show abstract

“…To enable HDR-capture using off-the-shelf cameras Manakov et al [142] recently proposed to insert a small optical element between the lens and body of a standard commercial DSLR camera. This element splits the incident light into four identical images, optically filters each image with a separate ND-Filter, and finally projects each image to a quarter of the same sensor.…”

Section: Multi-sensor Systemsmentioning

confidence: 99%

“…In future work it would be interesting to consider combinations of multi-sensor systems and sensors with spatially varying gain. For example, combining the approach of Manakov et al [142] for multi-exposure imaging using optical splitting with a dual-ISO configured sensor [3]. Such a setup could also enable fewer sensors to be used in traditional multi-sensor system, thereby making them less bulky, while still maintaining a large dynamic range with low noise.…”

Section: Summary and Future Workmentioning

confidence: 99%

Physically Based Rendering of Synthetic Objects in Real Environments

Kronander¹

2015

View full text Add to dashboard Cite

Description of the cover imageRendering of virtual furniture illuminated with spatially varying real world illumination captured in a physical environment at IKEA Communications AB.The virtual scene was modeled by Sören and Per Larsson. Physically based rendering of synthetic objects in real environmentsCopyright © 2015 Joel Kronander (unless otherwise noted) Division of Media and Information TechnologyDepartment of Science and Technology Campus Norrköping, Printed in Sweden by LiU-Tryck, Linköping, 2015 AbstractThis thesis presents methods for photorealistic rendering of virtual objects so that they can be seamlessly composited into images of the real world. To generate predictable and consistent results, we study physically based methods, which simulate how light propagates in a mathematical model of the augmented scene. This computationally challenging problem demands both efficient and accurate simulation of the light transport in the scene, as well as detailed modeling of the geometries, illumination conditions, and material properties. In this thesis, we discuss and formulate the challenges inherent in these steps and present several methods to make the process more efficient.In particular, the material contained in this thesis addresses four closely related areas: HDR imaging, IBL, reflectance modeling, and efficient rendering. The thesis presents a new, statistically motivated algorithm for HDR reconstruction from raw camera data combining demosaicing, denoising, and HDR fusion in a single processing operation. The thesis also presents practical and robust methods for rendering with spatially and temporally varying illumination conditions captured using omnidirectional HDR video. Furthermore, two new parametric BRDF models are proposed for surfaces exhibiting wide angle gloss. Finally, the thesis also presents a physically based light transport algorithm based on Markov Chain Monte Carlo methods that allows approximations to be used in place of exact quantities, while still converging to the exact result. As illustrated in the thesis, the proposed algorithm enables efficient rendering of scenes with glossy transfer and heterogenous participating media.v Populärvetenskaplig SammanfattningEn av de största utmaningarna inom datorgrafik är att syntetisera, eller rendera, fotorealistiska bilder. Fotorealistisk rendering används idag inom många tillämpningsområden såsom specialeffekter i film, datorspel, produktvisualisering och virtuell verklighet. I många praktiska tillämpningar av fotorealistisk rendering är det viktigt att kunna placera in virtuella objekt i fotografier, så att de virtuella objekten ser verkliga ut. IKEA-katalogen, till exempel, produceras i många olika versioner för att passa olika länder och regioner. Grunden till de flesta bilderna i katalogen är oftast densamma, men symboler och standardmått på möbler varierar ofta för olika versioner av katalogen. Istället för att fotografera varje version separat kan man använda ett grundfotografi och lägga in olika virtuella objekt såsom möbler...

show abstract

A reconfigurable camera add-on for high dynamic range, multispectral, polarization, and light-field imaging

Cited by 97 publications

References 47 publications

Adaptive dualISO HDR reconstruction

Adaptive dualISO HDR reconstruction

Light-Field Microscopy with a Consumer Light-Field Camera

Physically Based Rendering of Synthetic Objects in Real Environments

Contact Info

Product

Resources

About