Frame-transfer CMOS active pixel sensor with pixel binning

Zhou, Zhimin; Pain, Bedabrata; Fossum, Eric R.

doi:10.1109/16.628834

Cited by 54 publications

(4 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Figure 2a illustrates the readout of a CCD image sensor with an electronic global shutter in the time-domain. The use of such memory buffer weighs on production cost and chip size [51,57], which lead to CCD image sensors being most common in industrial and professional use [12]. In comparison, in CMOS sensors, the individual pixels are connected via metallic wires that cannot store the signal charge [22].…”

Section: Scanning Elementmentioning

confidence: 99%

They See Me Rollin’: Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

Köhler

Lovisotto

Birnbach

et al. 2021

Annual Computer Security Applications Conference

View full text Add to dashboard Cite

In this paper, we describe how the electronic rolling shutter in CMOS image sensors can be exploited using a bright, modulated light source (e.g., an inexpensive, off-the-shelf laser), to inject finegrained image disruptions. We demonstrate the attack on seven different CMOS cameras, ranging from cheap IoT to semi-professional surveillance cameras, to highlight the wide applicability of the rolling shutter attack. We model the fundamental factors affecting a rolling shutter attack in an uncontrolled setting. We then perform an exhaustive evaluation of the attack's effect on the task of object detection, investigating the effect of attack parameters. We validate our model against empirical data collected on two separate cameras, showing that by simply using information from the camera's datasheet the adversary can accurately predict the injected distortion size and optimize their attack accordingly. We find that an adversary can hide up to 75% of objects perceived by state-of-the-art detectors by selecting appropriate attack parameters. We also investigate the stealthiness of the attack in comparison to a naïve camera blinding attack, showing that common image distortion metrics can not detect the attack presence. Therefore, we present a new, accurate and lightweight enhancement to the backbone network of an object detector to recognize rolling shutter attacks. Overall, our results indicate that rolling shutter attacks can substantially reduce the performance and reliability of vision-based intelligent systems.

show abstract

Section: Scanning Elementmentioning

confidence: 99%

They See Me Rollin’: Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

Köhler

Lovisotto

Birnbach

et al. 2021

Annual Computer Security Applications Conference

View full text Add to dashboard Cite

show abstract

“…A memory array with the same number of pixels as the sensor is located below the imager array. Typically, the image memory is an analogue frame memory that requires less complexity of design and processing time [10]. However, this structure consumes a large area, large power and high fabrication cost.…”

Section: Review Of Integrated Operators On Smart Sensorsmentioning

confidence: 99%

Time comparison in image processing: APS sensors versus an artificial retina based vision system

Elouardi

Bouaziz²,

Dupret³

et al. 2007

Meas. Sci. Technol.

View full text Add to dashboard Cite

To resolve the computational complexity of computer vision algorithms, one of the solutions is to perform some low-level image processing on the sensor focal plane. It becomes a smart sensor device called a retina. This concept makes vision systems more compact. It increases performance thanks to the reduction of the data flow exchanges with external circuits. This paper presents a comparison between two different vision system architectures. The first one involves a smart sensor including analogue processors allowing on-chip image processing. An external microprocessor is used to control the on-chip dataflow and integrated operators. The second system implements a logarithmic CMOS/APS sensor interfaced to the same microprocessor, in which all computations are carried out. We have designed two vision systems as proof of concept. The comparison is related to image processing time.

show abstract

“…Foveated imaging can be achieved at the software level, by applying foveation algorithms to full-resolution digital video frames from a conventional imaging system, [1][2][3] or it can be achieved at the hardware level, by combining images from several sensors 4,5 or by using sensor arrays with variable resolution. [6][7][8] Reducing the size and complexity of the optical system is another important task in foveated imaging applications requiring fast ͑low F/#͒ and lightweight wide-angle optics. Such lenses are often used in surveillance, navigation of unmanned vehicles, tracking, threat detection, and other applications where a large FOV has to be covered constantly, in different lighting conditions.…”

Section: Introductionmentioning

confidence: 99%

Analysis and design of wide-angle foveated optical systems based on transmissive liquid crystal spatial light modulators

Harvey

2009

Opt. Eng

View full text Add to dashboard Cite

Optical foveated imaging using liquid crystal ͑LC͒ spatial light modulators ͑SLMs͒ has received considerable attention in recent years as a potential approach to reducing size and complexity in fast wideangle lenses. We cover a theoretical study quantifying the diffraction efficiency and image quality of foveated optical systems ͑FOSs͒ based on transmissive LC SLMs. A practical design example of a fast wideangle FOS based on the current transmissive LC SLM technology is proposed.

show abstract

Frame-transfer CMOS active pixel sensor with pixel binning

Abstract: Abstract-

Cited by 54 publications

References 8 publications

They See Me Rollin’: Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

They See Me Rollin’: Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

Time comparison in image processing: APS sensors versus an artificial retina based vision system

Analysis and design of wide-angle foveated optical systems based on transmissive liquid crystal spatial light modulators

Contact Info

Product

Resources

About