Hierarchies in Visual Pathway: Functions and Inspired Artificial Vision

Abstract

The development of artificial intelligence has posed a challenge to machine vision based on conventional complementary metal‐oxide semiconductor (CMOS) circuits owing to its high latency and inefficient power consumption originating from the data shuffling between memory and computation units. Gaining more insight into the function of every part of the visual pathway for visual perception could bring the capabilities of machine vision in terms of robustness and generality. Hardware acceleration of more energy efficient and biorealistic artificial vision highly necessitates neuromorphic devices and circuits which are able to mimic the function of each part of visual pathway. In this paper, we review the structure and function of the entire class of visual neurons from retina to the primate visual cortex within reach (chapter 2). Based on the extraction of biological principles, the recent hardware implemented visual neurons located in different parts of the visual pathway are detailed discussed (chapter 3 and chapter 4). Furthermore, we attempt to provide valuable applications of inspired artificial vision in different scenarios (chapter 5). The functional description of the visual pathway and its inspired neuromorphic devices/circuits are expected to provide valuable insights for the design of next‐generation artificial visual perception systems.This article is protected by copyright. All rights reserved

Emerging role of extracellular vesicles in diabetic retinopathy

“…Both the inner and outer BRB act as barriers between the systemic circulation and the retina 25 . More than a network of blood vessels, retina with multilayer structure is composed of neurons (photoreceptors, horizontal cells, bipolar cells, amacrine and ganglion cells) and glial cells (astrocytes, microglia, and Müller cells) 26 , accounting for approximately 95% of the tissue 27 . Essential for the BRB formation, glial cells dysregulate after microvascular damage, including Müller cells or astrocyte gliosis and microglia activation.…”

PBDB-T/Pentacene-Based Organic Optoelectronic Synaptic Transistor with Adjustable Critical Flicker Fusion Frequency for Dynamic Vision

“…In the era of big data, processing and storage of massive visual information pose heightened demands on real-time image processing and storage devices. − The human visual system possesses the capability for rapid, efficient, and energy-efficient visual information processing in complex environments. , Inspired by this, neuromorphic vision systems integrate photosensors, information processing units, and data storage units to achieve complex image processing. − Within this context, light-gated organic synaptic devices (organic optoelectronic synapses) have been developed to enhance the light-sensing capability to traditional electronic synapses. , This additional capability opens up opportunities for analog image preprocessing and recognition. ,− Moreover, it is imperative to recognize that beyond the realm of static image recognition and processing, the identification and detection of moving objects have become equally significant areas of research. Several studies have proposed novel optoelectronic transistor arrays to implement dynamic visual systems. , The challenge in device recognition of moving objects lies in determining object velocity or the photosensitivity frequency of the device itself.…”

Organic Synaptic Transistors with Environmentally Friendly Core/Shell Quantum Dots for Wavelength-Selective Memory and Neuromorphic Functions

“…As illustrated in Figure a, the biological nervous system controls information transmission, processing, and memory through synapses between neighboring neurons . When external stimuli act on the presynaptic neuron, excitatory neurotransmitters can be released from the vesicles at the presynaptic terminal and bind to the corresponding receptors on the postsynaptic membrane, which will trigger a variation in the action potential and then generate an excitatory postsynaptic current (EPSC). − In parallel to the biological nervous system, artificial photonic synaptic transistors with neuromorphic functions are proposed, which possess a heterogeneous architecture composed of environmentally friendly ZnSe/ZnS QDs and organic semiconductor pentacene (Figure S1). The photoresponsive charge trapping medium formed by ZnSe/ZnS QDs and poly­(methyl methacrylate) (PMMA) is capable of generating and trapping/releasing photogenerated charges, and the pentacene channel layer enables the efficient transport of photogenerated carriers.…”