A Bio-inspired and Low-power 2D Machine Vision with Adaptive Machine Learning and Forgetting

Abstract

Natural intelligence has many dimensions, and in animals, learning about the environment and making behavioral changes are some of its manifestations. In primates vision plays a critical role in learning. The underlying biological neural networks contain specialized neurons and synapses which not only sense and process the visual stimuli but also learns and adapts, with remarkable energy efficiency. Forgetting also plays an active role in learning. Mimicking the adaptive neurobiological mechanisms for seeing, learning, and forgetting can, therefore, accelerate the development of artificial intelligence (AI) and bridge the massive energy gap that exists between AI and biological intelligence. Here we demonstrate a bio-inspired machine vision based on large area grown monolayer 2D phototransistor array integrated with analog, non-volatile, and programmable memory gate-stack that not only enables direct learning, and unsupervised relearning from the visual stimuli but also offers learning adaptability under photopic (bright-light), scotopic (low-light), as well as noisy illumination conditions at miniscule energy expenditure. In short, our “all-in-one” hardware vision platform combines “sensing”, “computing” and “storage” not only to overcome the von Neumann bottleneck of conventional complementary metal oxide semiconductor (CMOS) technology but also to eliminate the need for peripheral circuits and sensors.

Multiwavelength Optoelectronic Synapse with 2D Materials for Mixed-Color Pattern Recognition

“…The schematic of the MoS 2 field effect transistor-based multiwavelength optoelectronic synapse is illustrated in Figure a. Here, monolayer MoS 2 is the active channel and acts as an UV–visible sensitive material during the optical synapse operation, − ,− Al 2 O 3 is the back gate dielectric while p-Si/PtTe 2 is used as the gate electrode. The p-Si/PtTe 2 junction is sensitive to infrared (IR) wavelengths and is therefore chosen as the back-gate electrode to yield a multiwavelength optoelectronic synapse operation. − Both the PtTe 2 and MoS 2 films are grown by chemical vapor deposition (CVD).…”