Integrated In-Sensor Computing Optoelectronic Device for Environment-Adaptable Artificial Retina Perception Application

Abstract

With the development and application of artificial intelligence, there is an appeal to the exploitation of various sensors and memories. As the most important perception of human beings, vision occupies more than 80% of all the received information. Inspired by biological eyes, an artificial retina based on 2D Janus MoSSe was fabricated, which could simulate functions of visual perception with electronic/ion and optical comodulation. Furthermore, inspired by human brain, sensing, memory, and neuromorphic computing functions were integrated on one device for multifunctional intelligent electronics, which was beneficial for scalability and high efficiency. Through the formation of faradic electric double layer (EDL) at the metal-oxide/electrolyte interfaces could realize synaptic weight changes. On the basis of the optoelectronic performances, light adaptation of biological eyes, preprocessing, and recognition of handwritten digits were implemented successfully. This work may provide a strategy for the future integrated sensing-memory-processing device for optoelectronic artificial retina perception application.

A Multifunctional and Efficient Artificial Visual Perception Nervous System with Sb2Se3/CdS‐Core/Shell (SC) Nanorod Arrays Optoelectronic Memristor

“…Two light pulses were used to create a pair of postsynaptic currents, with the first and second spikes of currents being designated as A 1 and A 2 , respectively. The PPF index, is defined as follows: [ 10 ] $$\[ \begin{array}{*{20}{c}}{{\rm{PPF}} = {A_2}{\rm{/}}{A_1} \times 100\\end{array} \]$$was fitted as the function of interval time between two light pulses, as shown in Figure 3e. After applying a light pulse to the device, learning–forgetting curves were replicated in the optoelectronic synapse, an important behavior in the human brain.…”

“…Two light pulses were used to create a pair of postsynaptic currents, with the first and second spikes of currents being designated as A 1 and A 2 , respectively. The PPF index, is defined as follows: [10] = × PPF / 100%…”

“…However, the small photoresponse current hinders the application of the optoelectronic memristor in the artificial visual nervous system. [ 10 ] The high device optoelectronic performance for the memristor in this artificial vision system is enabled by sufficient photon absorption, a long bulk lifetime, exceptional carrier collection efficiency, and an efficient junction interface. Due to its proper optical bandgap and strong light absorption coefficient, antimony selenide (Sb 2 Se 3 ) appears to be a potential alternative light‐absorber material for high‐efficiency optoelectronic devices.…”

Intrinsically stretchable photonic synaptic transistors for retina-like visual image systems

“…6–10 Recently, with the general trends of visual prosthetics and artificial intelligence, diverse types of artificial visual systems inspired by the retina have been developed for potential applications. 11–15 Nevertheless, it remains a considerable challenge to achieve an elastic artificial visual system due to difficulties in preparing intrinsically stretchable photodetectors with neuromorphic image sensing functions.…”

Bio‐Inspired In‐Sensor Compression and Computing Based on Phototransistors

“…In this work, we develop an optoelectronic in‐sensor compression and computing system to mimic human vision system that enables a high efficiency from image‐capturing‐compression to transmission‐recognition, because vision is the most important sense in the human body and more than 80% of the acquired information is obtained by the visual system. [ 39 ] As a proof of concept, indium‐gallium‐zinc‐oxide (IGZO) phototransistor is used to achieve in‐sensor compression and computing in this study. This is due to the fact that IGZO has been commercialized due to its excellent photoresponse, relatively high mobility, and high uniformity for large‐scale fabrication [ 40 ] Specifically, based on the optoelectronic switching and light‐tunable synaptic characteristics of IGZO TFTs, in‐sensor compression and RC network are implemented and verified, respectively.…”