Partially-Coherent Neural Holography with Fast Spatial Light Modulators

Abstract

We introduce a flexible computer-generated holography (CGH) framework with fast, MEMS-based, heavily-quantized SLMs. Our framework supports various types of content, from 2D images to 4D light-fields. We demonstrate state-of-the-art results with each content type.

Ergonomic‐Centric Holography: Optimizing Realism, Immersion, and Comfort for Holographic Display

“…EC-H Ergonomic-centric Holography HOGD High-order Gradient Descent [ 13] Pupil-HOGD Pupil High-order Gradient Descent [ 14] TM-NH Time-multiplexed Neural Holography [ 10] PA-H Pupil-Aware Holography [ 12] where 𝜆 is the wavelength,  c is the frequency-domain bandlimited coherent propagation kernel, and M h i is an optional binary mask for space-domainfiltering (e.g., conforming the kernel to produce a circular-shaped out-of-focus response, or forcing a deep depth of field). To efficiently and completely model a 3D scene, LDI was used, an advanced multi-layer RGB-depth image representation, to record both foreground and background points (see Appendix A for details).…”

“…Figure 4 compares experimentally captured holograms using EC-H, time-multiplexed neural holography (TM-NH), [10] and HOGD [13,14] in the unfiltered mode. We use our LDI-computed focal stacks to supervise the optimization of TM-NH, as the code to generate their focal stack is not yet publicly available.…”

“…The number also dictates the quality of incoherent defocus reproduction since the image formation for every subframe is yet governed by the coherent imaging model, and the model mismatch has to be bridged by the incoherent accumulation across subframes. Note that we use eight-bit phase SLM compared to the four-bit phase SLM used in Choi et al, [10] potentially reducing the number of subframes needed to achieve the same noise level and increasing the contrast of the experimental results due to better reproduction of dark pixels.…”

“…These aspects are intricately interconnected, and neglecting any one of them can compromise the overall user experience and hinder the realization of CGH's full potential for prolonged use in virtual and augmented reality devices. DOI: 10.1002/lpor.202300651 et al [10] and Lee et al [11] used temporal time-multiplexing to achieve a natural defocus response. Chakravarthula et al [12] incorporated a dynamic pupil to improve image quality at eccentric pupils in the eye box.…”