A Gate Multiplexing Architecture‐Based Artificial Visual Sensor and Memory System

Abstract

The human visual system plays the most important role in information perception. Inspired by its structure and processing mechanism, novel optoelectronic memristor‐based artificial visual systems have emerged, thanks to the advantages of time latency and energy efficiency. However, the established systems lack a complete hardware supporting system to demonstrate the potential of large‐scale integration. Herein for the first time, a gate multiplexing architecture for optical signal sensor and memory integration is proposed, which can achieve multivalue storage of 3‐bit optical signal in the analog domain. Based on this novel structure, an artificial visual sensor and memory system (AVSMS) is implemented with a 5 × 6 photodiode array, an I/V conversion circuit, and a 32 × 32 1T1R memristor array for image sensor and memory integration. Furthermore, a parallel pipeline storage strategy is proposed to enable AVSMS to store 32 images with a size of 5 × 6 pixels and 3‐bit grayscale without erasing operation and achieve an ideal frame rate of more than 60 000 frames per second for high‐speed storage. Experimental results demonstrate that AVSMS can directly eliminate repeated background information in sequential images through peripheral hardware circuitry. The AVSMS provides a promising hardware solution for large‐scale image sensor and memory integration in artificial visual systems.

All‐Optically Controlled Retinomorphic Memristor for Image Processing and Stabilization

“…[12][13][14][15][16][17] This approach would lead to more advanced artificial visual systems with improved recognition rate and image stabilization accuracy, as well as reduced energy expenditure and latency. [18][19][20] By integrating these functions, retinomorphic devices could perform image stabilization more efficiently and better highlight the important image characteristics, thereby enabling more sophisticated and accurate image analysis in real time. [21,22] Therefore, the development of novel retinomorphic devices is crucial for the advancement of artificial visual systems.…”

“…However, one of the challenges in developing artificial optical synapses is the requirement that optical and electrical signals must be coupled to reversibly tune the conductance, which significantly increases the complexity of the system. [13,18] As a result, researchers have actively investigated alloptical synaptic devices based on oxides, 2D materials, and organics. [33][34][35][36][37] These devices enable the reversible modulation of conductance through different wavelengths of light, making them suitable for vision sensor applications.…”