Coded aperture compressive temporal imaging

Llull, Patrick; Liao, Xiaozhong; Yuan, Xin; Yang, Jianbo; Kittle, David S.; Carin, Lawrence; Sapiro, Guillermo; Brady, David J.

doi:10.1364/oe.21.010526

Cited by 378 publications

(291 citation statements)

References 13 publications

(3 reference statements)

Supporting

Mentioning

288

Contrasting

Order By: Relevance

“…This can result in long reconstruction times measured in minutes or hours. Recent developments make progress toward compressive video reconstruction [12][13][14][15][16][17][18], with emphasis on developing methods to reduce computational time [19,20]; however, in this paper we concentrate on compressive techniques that do not require computationally expensive reconstruction and are therefore able to provide near video frame rates.…”

Section: Introductionmentioning

confidence: 99%

Single-pixel infrared and visible microscope

Radwell¹,

Mitchell²,

Gibson³

et al. 2014

Optica

341

179

View full text Add to dashboard Cite

Microscopy is an essential tool in a huge range of research areas. Until now, microscopy has been largely restricted to imaging in the visible region of the electromagnetic spectrum. Here we present a microscope system that uses single-pixel imaging techniques to produce images simultaneously in the visible and shortwave infrared. We apply our microscope to the inspection of various objects, including a silicon CMOS sensor, highlighting the complementarity of the visible and shortwave infrared wavebands. The system is capable of producing images with resolutions between 32 × 32 and 128 × 128 pixels at corresponding frame rates between 10 and 0.6 Hz. We introduce a compressive technique that does not require postprocessing, resulting in a predicted frame rate increase by a factor 8 from a compressive ratio of 12.5% with only 28% relative error.

show abstract

Section: Introductionmentioning

confidence: 99%

Single-pixel infrared and visible microscope

Radwell¹,

Mitchell²,

Gibson³

et al. 2014

Optica

341

179

View full text Add to dashboard Cite

show abstract

“…A similar strategy may be applied to the interleaved frames from a camera array [10]. Alternatively, the incident light may be coded into a spatio-temporal pattern, either using a spatial light modulator [11,12], global shutter [13] or translating mask [14]. Subsequently, an inversion algorithm, typically operating within a compressive sensing framework that assumes scene sparsity, can recover a high-resolution and high-speed video [15].…”

Section: Introductionmentioning

confidence: 99%

Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video

Ryu

Wang

et al. 2017

Biomed. Opt. Express

View full text Add to dashboard Cite

On-chip holographic video is a convenient way to monitor biological samples simultaneously at high spatial resolution and over a wide field-of-view. However, due to the limited readout rate of digital detector arrays, one often faces a tradeoff between the per-frame pixel count and frame rate of the captured video. In this report, we propose a subsampled phase retrieval (SPR) algorithm to overcome the spatial-temporal trade-off in holographic video. Compared to traditional phase retrieval approaches, our SPR algorithm uses over an order of magnitude less pixel measurements while maintaining suitable reconstruction quality. We use an on-chip holographic video setup with pixel sub-sampling to experimentally demonstrate a factor of 5.5 increase in sensor frame rate while monitoring the in vivo movement of Peranema microorganisms.

show abstract

“…Among those concepts, tiling of images on a detector using fast electrostatic deflectors has demonstrated the opportunity to acquire small video series at nanosecond resolution [1,2]. In this work we investigate an alternative approach of acquiring high frame-rate video using a coded aperture acquisition and compressive sensing (CS) reconstruction [3]. In this presentation, we will discuss the development of coded aperture imaging system and present initial results.…”

mentioning

confidence: 99%

“…In this work we investigate an alternative approach of acquiring high frame-rate video using a coded aperture acquisition and compressive sensing (CS) reconstruction [3]. In this presentation, we will discuss the development of coded aperture imaging system and present initial results.The coded aperture video acquisition can be understood as a process of integrating multiple spatially coded frames into a single camera frame [3,4]. The individual frames can be recovered from the integrated frame with the use of compressive sensing (CS) reconstruction algorithm.…”

mentioning

confidence: 99%

Design and Development of Coded Aperture Compressive Sensing Acquisition for High Frame Rate TEM Imaging

et al. 2017

View full text Add to dashboard Cite

Transmission Electron Microscopy (TEM) enables to probe the dynamics of materials with spatial and temporal resolution that can vary over several orders of magnitude. In several research fields, it is critical to capture the materials behavior at high temporal resolution but due to a limited detector readout rates, the temporal resolution is currently limited mostly to milliseconds. To overcome these limitations, novel concepts of recording high frame video in TEM have been recently explored. Among those concepts, tiling of images on a detector using fast electrostatic deflectors has demonstrated the opportunity to acquire small video series at nanosecond resolution [1,2]. In this work we investigate an alternative approach of acquiring high frame-rate video using a coded aperture acquisition and compressive sensing (CS) reconstruction [3]. In this presentation, we will discuss the development of coded aperture imaging system and present initial results.The coded aperture video acquisition can be understood as a process of integrating multiple spatially coded frames into a single camera frame [3,4]. The individual frames can be recovered from the integrated frame with the use of compressive sensing (CS) reconstruction algorithm. The principle of coded aperture CS video acquisition is shown in Figure.1a. The coded aperture, which is the most critical component of CS acquisition system, has to meet several unique constraints for electron optics applications. Namely, it has to maintain self-supporting nature, which imposes constrains on the modulation function, and it also has to provide modulation at the pixel level, which is associated with manufacturing difficulties. Both design considerations will be discussed in the context of our current design. The depiction of coded aperture, and its modulation function, is shown in Figure1(b,c).In our acquisition setup, the coded aperture is controlled by piezoelectric driven stage, which was implemented in a custom designed acquisition module based on Direct Electron DE20 camera. The newly built acquisition system was tested on aberration corrected FEI Titan 80-300, and the experiments were performed with a standard Au grating replica sample under various degree of translation of Au grating sample. In the current implementation, successful reconstructions can be achieved only under limited conditions. An example of video compressive sensing acquisition under a negligible translation of the sample is shown Fig.2(b,c,d). Not coded image of Au grating sample used for CS video acquisition is shown in Fig. 2(a). As a part of this presentation we will discuss how larger translation of the Au grating sample presently affects the resolution of the reconstructions. Factors that limit the applicability CS video reconstruction will be discussed, together with the future outlook for implementation of this technique for high frame rate acquisition [5].

show abstract

Coded aperture compressive temporal imaging

Abstract: We use mechanical translation of a coded aperture for code division multiple access compression of video. We present experimental results for reconstruction at 148 frames per coded snapshot.

Cited by 378 publications

References 13 publications

Single-pixel infrared and visible microscope

Single-pixel infrared and visible microscope

Subsampled phase retrieval for temporal resolution enhancement in lensless on-chip holographic video

Design and Development of Coded Aperture Compressive Sensing Acquisition for High Frame Rate TEM Imaging

Contact Info

Product

Resources

About