Artificial Perception Built on Memristive System: Visual, Auditory, and Tactile Sensations

Abstract

The widespread implementation and rapid development of autonomous systems pose stringent performance requirements on emerging sensory systems. In addition to the basic sensing requirements, leading sensory systems are required to process data and extract featured information from highly redundant data in real time. With the added edge‐computational capabilities, data shuttling is avoided, leading to significant reduction of computational burden and bandwidth pressure in the cloud. Among the different computing architectures, the neuromorphic sensory system stands out due to its high power efficiency, low latency, and excellent processing capability. Mimicking the biological neural network, the colocation of sensory, processor, and memory components of neuromorphic sensory systems enables the requirements for frequent data shuttles to be circumvented. In particular, artificial intelligent perceptions built on memristive neuromorphic systems exhibit outstanding characteristics of small footprint, low power consumption, 3D stacking ability, and high density. Herein, the two essential parts of the memristive artificial perceptron system are presented: 1) memristive systems for neuromorphic computing and 2) high‐performance sensors. Next, the current state of the art established on artificial perceptron systems covering visual, auditory, and tactile sensations is highlighted. To conclude, the current challenges and future direction in the area of advanced intelligent perceptions are presented.

Advances in materials and devices for mimicking sensory adaptation

“…Driven by the rapid development of artificial intelligence, smart devices that can mimic and even exceed the perception capabilities of human beings have attracted increasing attention. [1][2][3] So far, there are two kinds of artificial perception-related devices being widely studied. The first category is used to detect target biological substances or physiological signals, which serve as electronic sensors for signal transduction.…”

Ion‐Gated Transistor: An Enabler for Sensing and Computing Integration

“…More intriguingly, IGTs have been widely used in the field of sensors due to their high signal amplification capability and simple device structure. [14,18,19] Therefore, it provides a platform to achieve intelligent sensors, where sensing and computing are performed simultaneously in the same device.…”

Tunable Synaptic Plasticity in Crystallized Conjugated Polymer Nanowire Artificial Synapses

“…

The artificial synapse is an important neuromorphic device, that has not only been used in brain-inspired computing but also in artificial sensory systems. [1][2][3] Unlike the "0/1"-based binary memory system, artificial neural networks can emulate both the structural and functional brain systems during decision-making and learning processes to develop next-generation neuromorphic computing. [4][5][6] Artificial synapses receive, process, and transmit signals from tactile, [7][8][9] visual, [10,11] and auditory [12] senses in the human perception system, that could be possibly applied to humanoid robots and intelligent prosthesis.Recently, great efforts have been made to modulate intrinsic synaptic plasticity in a fixed material and device structure to meet different application requirements.

…”