Bioinspired in-sensor visual adaptation for accurate perception

Liao, Fuyou; Zhou, Zheng; Kim, Beom Jin; Chen, Jiewei; Wang, Jingli; Wan, Tianqing; Zhou, Yue; Hoang, Anh Tuan; Wang, Cong; Kang, Jinfeng; Ahn, Jong Hyun; Chai, Yang

doi:10.1038/s41928-022-00713-1

Cited by 288 publications

(309 citation statements)

References 37 publications

Supporting

Mentioning

275

Contrasting

Order By: Relevance

“…By tuning the combination of V w and I bias , we can realize a dynamic sensing range over 90 dB. With the adaptation process, the dynamic range of MoS 2 phototransistors can be further increased ( 48 ).…”

Section: Resultsmentioning

confidence: 99%

A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors

Chen

et al. 2022

Sci. Adv.

Self Cite

View full text Add to dashboard Cite

The rapid development of machine vision applications demands hardware that can sense and process visual information in a single monolithic unit to avoid redundant data transfer. Here, we design and demonstrate a monolithic vision enhancement chip with light-sensing, memory, digital-to-analog conversion, and processing functions by implementing a 619-pixel with 8582 transistors and physical dimensions of 10 mm by 10 mm based on a wafer-scale two-dimensional (2D) monolayer molybdenum disulfide (MoS 2 ). The light-sensing function with analog MoS 2 transistor circuits offers low noise and high photosensitivity. Furthermore, we adopt a MoS 2 analog processing circuit to dynamically adjust the photocurrent of individual imaging sensor, which yields a high dynamic light-sensing range greater than 90 decibels. The vision chip allows the applications for contrast enhancement and noise reduction of image processing. This large-scale monolithic chip based on 2D semiconductors shows multiple functions with light sensing, memory, and processing for artificial machine vision applications, exhibiting the potentials of 2D semiconductors for future electronics.

show abstract

Section: Resultsmentioning

confidence: 99%

A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors

Chen

et al. 2022

Sci. Adv.

Self Cite

View full text Add to dashboard Cite

show abstract

“…4 Previously, the bilateral inhibitory functions of horizontal cells in retina were emulated via a diffusive resistive network together with an operation amplifier in the first generation of silicon retina, 19 whereas these resistance or transistor networks lack tunable inhibitory weight compared to the biological counterpart, which is important for the adaptive processing of sensory information. 20 Here, we report the design of a bidirectional rectifying nonlinear synapse based on the threshold tailoring of a twodimensional float gate transistor made of a MoS 2 /h-BN/graphene vdW heterostructure. Using ZnPc molecules as surface acceptors, we tuned the transistor for subthreshold operation, which then rendered bidirectional negative-pass rectification behavior that could be continuously adjusted by charge trapping in the float gate.…”

Section: Materials Horizonsmentioning

confidence: 99%

A non-linear two-dimensional float gate transistor as a lateral inhibitory synapse for retinal early visual processing

Chen

et al. 2022

Mater. Horiz.

View full text Add to dashboard Cite

show abstract

“…Nevertheless, the robust and general solutions to the major issues such as motion detection, object recognition, vision-based navigation and activity recognition are still beyond reach of present computer vision system 2 . Biologically visual system is hierarchical organization including retina, optic nerve, lateral geniculate nucleus (LGN) and striate cortex 3 – 5 . It is evident that the different level of visual system process different types of visual information with receptive fields covering different region of visual field 6 .…”

Section: Introductionmentioning

confidence: 99%

Synaptic plasticity in self-powered artificial striate cortex for binocular orientation selectivity

Ren

Wang

et al. 2022

Nat Commun

View full text Add to dashboard Cite

Get in-depth understanding of each part of visual pathway yields insights to conquer the challenges that classic computer vision is facing. Here, we first report the bioinspired striate cortex with binocular and orientation selective receptive field based on the crossbar array of self-powered memristors which is solution-processed monolithic all-perovskite system with each cross-point containing one CsFAPbI3 solar cell directly stacking on the CsPbBr2I memristor. The plasticity of self-powered memristor can be modulated by optical stimuli following triplet-STDP rules. Furthermore, plasticity of 3 × 3 flexible crossbar array of self-powered memristors has been successfully modulated based on generalized BCM learning rule for optical-encoded pattern recognition. Finally, we implemented artificial striate cortex with binocularity and orientation selectivity based on two simulated 9 × 9 self-powered memristors networks. The emulation of striate cortex with binocular and orientation selectivity will facilitate the brisk edge and corner detection for machine vision in the future applications.

show abstract

Bioinspired in-sensor visual adaptation for accurate perception

Cited by 288 publications

References 37 publications

A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors

A 619-pixel machine vision enhancement chip based on two-dimensional semiconductors

A non-linear two-dimensional float gate transistor as a lateral inhibitory synapse for retinal early visual processing

Synaptic plasticity in self-powered artificial striate cortex for binocular orientation selectivity

Contact Info

Product

Resources

About