A 151 dB High Dynamic Range CMOS Image Sensor Chip Architecture With Tone Mapping Compression Embedded In-Pixel

Abstract

This paper presents a high dynamic range CMOS image sensor that implements an in-pixel content-aware adaptive global tone mapping algorithm during image capture operation. The histogram of the previous frame of an auxiliary image, which contains time stamp information, is employed as an estimation of the probability of illuminations impinging pixels at the present frame. The compression function of illuminations, namely tone mapping curve, is calculated using this histogram. A QCIF resolution proof-of-concept prototype has been fabricated using a 0.35 µm opto-flavored standard technology. The sensor is capable of mapping scenes with a maximum intra-frame dynamic range of 151 dB (25 bits/pixel in linear representation) by compressing them to only 7 bits/pixel, while keeping visual quality in details and contrast. The in-pixel on-the-fly fully parallel tone mapping achieves high-frame rate allowing real-time high dynamic range video (120 dB at 30 frames/s).Index Terms-CMOS image sensor, high dynamic range, tone mapping, pulse width modulation, real-time HDR video.

An onboard UAS visual privacy guard system

“…Other algorithmic approached described in the literature are based on the Haar classifier, statistical pattern recognition, and wavelet transform [10][11][12][13].…”

Photographic Noise Performance Measures Based on RAW Files Analysis of Consumer Cameras

“…The dynamic range of a signal is defined as the ratio between its maximum and minimum values. This is the one factor that is usually included in the title of many papers when a new sensor is introduced (see, e.g., [14]). In a camera, this definition can be tricky from a photographic perspective.…”

Ascertain privacy conservation and data security protection onboard small UAS

“…The UAS-VPG system aims at detecting sensitive objects in the video frames taken by the imagery equipment mounted onboard sUAS. The system includes a privacy guard mechanism that is based on algorithmic approaches for image processing, such as Viola-Jones algorithm [12][13], Haar classifiers [14][15][16][17], and Matlab's Computer Vision System Toolbox™ [18], with camera resolution to be selected at the time of system development. The reported results for positive object detection, while encouraging in terms of capabilities of the proposed algorithm, show a clear dependence on the rotation angle of the camera [5].…”