5.5 Dual-Tap Pipelined-Code-Memory Coded-Exposure-Pixel CMOS Image Sensor for Multi-Exposure Single-Frame Computational Imaging

Sarhangnejad, Navid; Katic, Nikola; Xia, Zhengfan; Wei, Max; Gusev, Nikita; Dutta, Gairik; Gulve, Rahul; Haim, Harel; García, Manuel Francisco Martínez; Stoppa, David; Kutulakos, Kiriakos N.; Genov, Roman

doi:10.1109/isscc.2019.8662326

Cited by 15 publications

(11 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A number of image sensors with pixel-wise exposure configurability have been demonstrated, including our previous work [9] [10] [11]. We first proposed a pixel-wise configurable exposure image sensor architecture [9].…”

Section: A Image Sensor With Pixel-wise Exposure Configurabilitymentioning

confidence: 99%

A Closed-Loop, All-Electronic Pixel-Wise Adaptive Imaging System for High Dynamic Range Videography

Zhang

Newman

Wang

et al. 2020

IEEE Trans. Circuits Syst. I

View full text Add to dashboard Cite

We demonstrated a CMOS imaging system that adapts each pixels exposure and sampling rate to capture high dynamic range (HDR) videos. The system consist of a custom designed image sensor with pixel-wise exposure configurability and a real-time pixel exposure controller. These parts operate in a closed-loop to sample, detect and optimize each pixels exposure and sampling rate to minimize local regions underexposure, overexposure and motion blurring. Exposure control is implemented using all-integrated electronics without external optical modulation. This reduces overall system size and power consumption.The image sensor is implemented using a standard 130nm CMOS process while the exposure controller is implemented on a computer. We performed experiments under complex lighting and motion condition to test performance of the system, and demonstrate the benefit of pixel-wise adaptive imaging on the performance of computer vision tasks such as segmentation, motion estimation and object recognition.

show abstract

Section: A Image Sensor With Pixel-wise Exposure Configurabilitymentioning

confidence: 99%

A Closed-Loop, All-Electronic Pixel-Wise Adaptive Imaging System for High Dynamic Range Videography

Zhang

Newman

Wang

et al. 2020

IEEE Trans. Circuits Syst. I

View full text Add to dashboard Cite

show abstract

“…In coded exposure techniques, a pre-determined code is used to multiplex the temporal dimension of the video signal into compressed measurements. Recently, a novel prototype sensor based on multi-bucket pixels named Coded-2-Bucket sensor [31,37] was introduced. While allowing for per-pixel control of the "shutter", this sensor also can acquire two compressed measurements per exposure using the 2 light-collecting buckets per pixel.…”

Section: Introductionmentioning

confidence: 99%

“…While allowing for per-pixel control of the "shutter", this sensor also can acquire two compressed measurements per exposure using the 2 light-collecting buckets per pixel. Based on the number of measurements acquired per exposure, we can classify these sensing techniques into two categories: a) single compressed measurement (such as flutter shutter and pixelwise coding) [8,28,17,29,16,10,40,11,18,15] and b) two compressed measurements per exposure [31]. It is expected that two measurements should lead to better video reconstruction quality compared to a single measurement.…”

Section: Introductionmentioning

confidence: 99%

“…With this objective, we propose a unified learning-based framework with which we wish to make an extensive evaluation. This learning based framework should be usable for recovering videos from various single and two measurement techniques, particularly, Flutter-Shutter [28], pixelwise coded exposure [34,6] and C2B [31]. Most of the previously proposed algorithms for compressive video recovery use fully connected networks, and, ideally, we can use any of those networks for our framework.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

A Unified Framework for Compressive Video Recovery from Coded Exposure Techniques

Shedligeri¹,

Anupama²,

Mitra³

2020

Preprint

View full text Add to dashboard Cite

Several coded exposure techniques have been proposed for acquiring high frame rate videos at low bandwidth. Most recently, a Coded-2-Bucket camera has been proposed that can acquire two compressed measurements in a single exposure, unlike previously proposed coded exposure techniques, which can acquire only a single measurement. Although two measurements are better than one for an effective video recovery, we are yet unaware of the clear advantage of two measurements, either quantitatively or qualitatively. Here, we propose a unified learning-based framework to make such a qualitative and quantitative comparison between those which capture only a single coded image (Flutter Shutter, Pixel-wise coded exposure) and those that capture two measurements per exposure (C2B). Our learning-based framework consists of a shift-variant convolutional layer followed by a fully convolutional deep neural network. Our proposed unified framework achieves the state of the art reconstructions in all three sensing techniques. Further analysis shows that when most scene points are static, the C2B sensor has a significant advantage over acquiring a single pixel-wise coded measurement. However, when most scene points undergo motion, the C2B sensor has only a marginal benefit over the single pixel-wise coded exposure measurement.

show abstract

“…This has strong implications, as an example, in those research areas where the total radiation exposure has to be limited not to damage the sample. The implementation of this idea resulted in the development of the Single Pixel Camera, and was later extended to a wide-variety of applications [19,20]. The basic idea is to replace the parallel detector with a spatial modulator, e.g.…”

mentioning

confidence: 99%

Novel time-resolved camera based on compressed sensing

et al. 2019

View full text Add to dashboard Cite

Time-resolved cameras with high temporal resolution (down to ps) enable a huge set of novel applications ranging from biomedicine and environmental science to material and device characterization. In this work, we propose, and experimentally validate, a novel detection scheme for time-resolved imaging based on a compressed sampling approach. The proposed scheme unifies into a single element all the required operations, i.e. space modulation, space integration and time-resolved detection, paving the way to dramatic cost reduction, performance improvement and ease of use.

show abstract

5.5 Dual-Tap Pipelined-Code-Memory Coded-Exposure-Pixel CMOS Image Sensor for Multi-Exposure Single-Frame Computational Imaging

Cited by 15 publications

References 4 publications

A Closed-Loop, All-Electronic Pixel-Wise Adaptive Imaging System for High Dynamic Range Videography

A Closed-Loop, All-Electronic Pixel-Wise Adaptive Imaging System for High Dynamic Range Videography

A Unified Framework for Compressive Video Recovery from Coded Exposure Techniques

Novel time-resolved camera based on compressed sensing

Contact Info

Product

Resources

About