Multimodal Artificial Neurological Sensory–Memory System Based on Flexible Carbon Nanotube Synaptic Transistor

Abstract

As the initial stage in the formation of human intelligence, the sensory–memory system plays a critical role for human being to perceive, interact, and evolve with the environment. Electronic implementation of such biological sensory–memory system empowers the development of environment-interactive artificial intelligence (AI) that can learn and evolve with diversified external information, which could potentially broaden the application of the AI technology in the field of human–computer interaction. Here, we report a multimodal artificial sensory–memory system consisting of sensors for generating biomimetic visual, auditory, tactile inputs, and flexible carbon nanotube synaptic transistor that possesses synapse-like signal processing and memorizing behaviors. The transduction of physical signals into information-containing, presynaptic action potentials and the synaptic plasticity of the transistor in response to single and long-term action potential excitations have been systematically characterized. The bioreceptor-like sensing and synapse-like memorizing behaviors have also been demonstrated. On the basis of the memory and learning characteristics of the sensory–memory system, the well-known psychological model describing human memory, the “multistore memory” model, and the classical conditioning experiment that demonstrates the associative learning of brain, “Pavlov’s dog’s experiment”, have both been implemented electronically using actual physical input signals as the sources of the stimuli. The biomimetic intelligence demonstrated in this neurological sensory–memory system shows its potential in promoting the advancement in multimodal, user-environment interactive AI.

Recent advances in neuromorphic transistors for artificial perception applications

“…Thanks to the bipolarity, the p-i-n JST can also simulate distinct responses of gustatory receptor neurons to different concentrations of salt. Wan et al [ 46 ] also proposed an artificial multimodal sensory-memory system with similar biological sensory memory ability. It is composed of sensors and flexible carbon nanotube synaptic transistors.…”

“…Our senses, including vision, touch, auditory sense, olfactory sense and gustatory sense, provide rich information for our brain. Thus, it can interact with the real world vividly and complexly [ 46 , 47 ]. Figure 1 schematically illustrates the human perception systems.…”

Intrinsically stretchable photonic synaptic transistors for retina-like visual image systems

“…PPF plays a significant part in the processing of images in the nervous system. 48,49 In our device, the PPF behavior has been successfully mimicked. Fig.…”

The Progress of Research into Flexible Sensors in the Field of Smart Wearables

“…Wan et al [ 186 ] posited a multimodal artificial sensory memory system consisting of sensors to generate bionic visual, auditory, and tactile inputs, and flexible carbon nanotube synaptic transistors with synaptic-like signal processing and memorization behavior. Zhao et al [ 187 ] developed pressure sensors based on fabricated flexible organic friction transistors with a high sensitivity, fast response time, and excellent stability.…”