CMOS Image Sensor with On-Chip Image Compression: A Review and Performance Analysis

Abstract

Demand for high-resolution, low-power sensing devices with integrated image processing capabilities, especially compression capability, is increasing. CMOS technology enables the integration of image sensing and image processing, making it possible to improve the overall system performance. This paper reviews the current state of the art in CMOS image sensors featuring on-chip image compression. Firstly, typical sensing systems consisting of separate image-capturing unit and image-compression processing unit are reviewed, followed by systems that integrate focal-plane compression. The paper also provides a thorough review of a new design paradigm, in which image compression is performed during the image-capture phase prior to storage, referred to as compressive acquisition. High-performance sensor systems reported in recent years are also introduced. Performance analysis and comparison of the reported designs using different design paradigm are presented at the end.

A Grassroots Remote Sensing Toolkit Using Live Coding, Smartphones, Kites and Lightweight Drones

“…In subsequent flights, with this ‘ping’ modification running, we found that this change in functionality had no noticeable effect on image quality ( Fig 6(B) to 6(D) ), indicating that the vibration of the platform was a more significant issue. We suggest that these image distortions were due to the interlaced sampling of the camera sensor imaging array (in both cases, these were Complementary Metal Oxide Semiconductor (CMOS) sensors [ 32 ]). Furthermore these distortions could also have been an artefact of the CMOS image stabilization algorithm not being capable of overcoming high levels of vibration from powered drones.…”

“…On motorised platforms the main data quality issue was caused by systematic distortions in the images caused by interference between the imaging sensor and the vibrations of the motor. Both of the mobile phone models tested used the popular CMOS image sensor due to their lightweight, small size and low power consumption [ 32 , 36 ]. One drawback of CMOS sensors is their use of a rolling shutter, whereby a line scanning approach is used to capture an image, meaning that every pixel is not imaged at exactly the same time, increasing the chances of blur due to motion [ 37 ].…”

Polarization image sensors: Learning from biology to make the invisible visible

“…While the image resolution and frame rate of imagers keep increasing, image-processing capabilities are becoming more and more important considerations for both still image and video devices [2,3,6,7]. Integration of image processing/light filtering at the focal plane, within each pixel, provides a new approach to improve the performance of the overall system [35].…”

“…Nowadays, various biologically inspired techniques are already widely used in the modern world. Examples include the "Velcro" that was inspired by the prickly heads or seeds of the burdock plant in the Alps [1], vision sensors that extract features for pattern recognition [2,3], new nano-structure materials that mimic the color and texture of butterfly wings [4], and heat-seeking missiles inspired by rattlesnakes hunting warm-blooded prey using infrared sensory organs to track the heat. With a deeper understanding of the biological system, engineers are able to leverage advanced technologies to build bio-inspired intelligent sensors, computational systems, adaptable circuits and architectures, and heterogeneous networks [5].…”

Image Quality Assessment of a CMOS/Gd2O2S:Pr,Ce,F X-Ray Sensor

“…The initial CMOS pixel structure was in the form of passive pixel sensors (PPSs) and was followed by the active pixel sensors (APS), which have been developed with the goal of improving the image quality [10]. APS CMOS sensors provide high resolution even at high framing rates and, in association with scintillating screens, have been increasingly investigated for medical imaging applications [11].…”