Single shot three-dimensional imaging using an engineered point spread function

Berlich, R.; Bräuer, Andreas; Stallinga, Sjoerd

doi:10.1364/oe.24.005946

Cited by 23 publications

(36 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Initially, the influence is investigated by numerical simulations for the two design examples given in section 2 as well as a tetra-helix example with design parameters [N, L, ] = [4, 8, 0.8]. Note that no single peak design (N = 1) is considered, since it cannot be applied for 3D measurement using the approaches presented in [14,15]. Finally, an analytic rotation assessment is provided for general, multi-helix CGH designs in order to obtain a theoretical understanding on which aberrations cause rotation.…”

Section: Influence Of Aberrations On Psf Rotationmentioning

confidence: 99%

“…A demonstration setup based on a hybrid optical imaging system is realized according to the system concept proposed in [15]. The three phase element designs studied in section 3 (double-, tripleand tetra-helix) are implemented using state-of-the-art micro-optics manufacturing processes on wafer-scale.…”

Section: Optical Setupmentioning

confidence: 99%

“…A thin photoresist layer is initially spun on a borosilicate glass substrate and subsequently structured using the LED writing lithography approach presented by Eckstein et al in [27]. The next steps provide a significant advancement in the manufacturing of phase elements for monocular depth estimation compared to previous elements [9,15]. The surface profile of the photoresist layer is directly transferred onto the borosilicate glass substrate by applying reactive-ion-etching to generate a highly accurate and robust imprinting tool.…”

Section: Optical Setupmentioning

confidence: 99%

“…The cepstrum approach previously introduced by us [15] is used in order to extract the lateral rotation angle distribution α(x, y) of the engineered PSFs from the acquired images. This method is based on calculating the image cepstrum in a local environment around (x, y) and searching for peaks in the cepstrum domain.…”

Section: Cepstrum Distributionmentioning

confidence: 99%

“…So far, this method has mainly been applied for three-dimensional particle localization and tracking [7][8][9][10][11][12][13]. Further studies have demonstrated that the entire depth map of an extended, three-dimensional scene can be obtained for a broadband illumination [14,15].…”

Section: Introductionmentioning

confidence: 99%

See 4 more Smart Citations

High-order-helix point spread functions for monocular three-dimensional imaging with superior aberration robustness

Berlich¹,

Stallinga²

2018

Opt. Express

Self Cite

View full text Add to dashboard Cite

An approach for designing purely refractive optical elements that generate engineered, multi-order-helix point spread functions (PSFs) with large peak separation for passive, optical depth measurement is presented. The influence of aberrations on the PSF's rotation angle, which limits the depth retrieval accuracy, is studied numerically and analytically. It appears that only Zernike modes with an azimuthal index that is an integer multiple of the number of PSF peaks introduce PSF rotation, and hence depth estimation errors. This implies that high-order-helix designs have superior robustness with respect to aberrations. This is experimentally demonstrated by imaging an extended scene in the presence of severe system aberrations using novel, cost-efficient phase elements based on UV-replication on the wafer-scale.

show abstract

Section: Influence Of Aberrations On Psf Rotationmentioning

confidence: 99%

Section: Optical Setupmentioning

confidence: 99%

Section: Optical Setupmentioning

confidence: 99%

Section: Cepstrum Distributionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

High-order-helix point spread functions for monocular three-dimensional imaging with superior aberration robustness

Berlich¹,

Stallinga²

2018

Opt. Express

Self Cite

View full text Add to dashboard Cite

show abstract

End-to-end learning for joint depth and image reconstruction from diffracted rotation

Mel,

Siddiqui,

Zanuttigh

2023

Vis Comput

View full text Add to dashboard Cite

Monocular depth estimation is an open challenge due to the ill-posed nature of the problem at hand. Deep learning techniques proved capable of producing acceptable depth estimation accuracy but the lack of robust depth cues within RGB images severally limits their performance. Coded aperture-based methods using phase and amplitude masks encode strong depth cues within 2D images by means of depth-dependent Point Spread Functions (PSFs) at the price of a reduced image quality. In this paper, we propose a novel end-to-end learning approach for depth from diffracted rotation. A phase mask that produces a Rotating Point Spread Function (RPSF) as a function of defocus is jointly optimized with the weights of a depth estimation neural network. To this aim, we introduce a differentiable physical model of the aperture mask and exploit an accurate simulation of the camera imaging pipeline. Our approach requires a significantly less complex model and less training data, yet it outperforms existing methods for monocular depth estimation on indoor benchmarks. In addition, we address the image degradation problem by incorporating a non-blind and nonuniform image deblurring module to recover the sharp all-in-focus image from its blurred counterpart.

show abstract

Metasurface Generation of Paired Accelerating and Rotating Optical Beams for Passive Ranging and Scene Reconstruction

Colburn

Majumdar

2020

ACS Photonics

View full text Add to dashboard Cite

Depth measurements are vital for many emerging technologies with applications in augmented reality, robotics, gesture detection, and facial recognition. These applications, however, demand compact and low-power systems beyond the capabilities of many state-of-the-art depth cameras. While active illumination techniques can enable precise scene reconstruction, they increase power consumption, and systems that employ stereo require extended form factors to separate viewpoints. Here, we exploit a single, spatially multiplexed aperture of nanoscatterers to demonstrate a solution that replicates the functionality of a highperformance depth camera typically comprising a spatial light modulator, polarizer, and multiple lenses. Using cylindrical nanoscatterers that can arbitrarily modify the phase of an incident wavefront, we passively encode two complementary optical responses to depth information in a scene. The designed optical metasurfaces simultaneously generate a focused accelerating beam and a focused rotating beam that exploit wavefront propagation-invariance to produce paired, adjacent images with a single camera snapshot. Compared to conventional depth from defocus methods, this technique enhances both the depth precision and depth of field at the same time. By decoding the captured data in software, our system produces a fully reconstructed image and transverse depth map, providing an optically passive ranging solution. In our reconstruction algorithm, we account for the field curvature of our metasurface by calculating the change in Gouy phase over the field of view, enabling a fractional ranging error of 1.7%. We demonstrate a precise, visible wavelength, and polarization-insensitive metasurface depth camera with a compact 2 mm 2 aperture.

show abstract

Single shot three-dimensional imaging using an engineered point spread function

Cited by 23 publications

References 20 publications

High-order-helix point spread functions for monocular three-dimensional imaging with superior aberration robustness

High-order-helix point spread functions for monocular three-dimensional imaging with superior aberration robustness

End-to-end learning for joint depth and image reconstruction from diffracted rotation

Metasurface Generation of Paired Accelerating and Rotating Optical Beams for Passive Ranging and Scene Reconstruction

Contact Info

Product

Resources

About