A High-Speed Low-Cost VLSI System Capable of On-Chip Online Learning for Dynamic Vision Sensor Data Classification

Abstract

This paper proposes a high-speed low-cost VLSI system capable of on-chip online learning for classifying address-event representation (AER) streams from dynamic vision sensor (DVS) retina chips. The proposed system executes a lightweight statistic algorithm based on simple binary features extracted from AER streams and a Random Ferns classifier to classify these features. The proposed system’s characteristics of multi-level pipelines and parallel processing circuits achieves a high throughput up to 1 spike event per clock cycle for AER data processing. Thanks to the nature of the lightweight algorithm, our hardware system is realized in a low-cost memory-centric paradigm. In addition, the system is capable of on-chip online learning to flexibly adapt to different in-situ application scenarios. The extra overheads for on-chip learning in terms of time and resource consumption are quite low, as the training procedure of the Random Ferns is quite simple, requiring few auxiliary learning circuits. An FPGA prototype of the proposed VLSI system was implemented with 9.5~96.7% memory consumption and <11% computational and logic resources on a Xilinx Zynq-7045 chip platform. It was running at a clock frequency of 100 MHz and achieved a peak processing throughput up to 100 Meps (Mega events per second), with an estimated power consumption of 690 mW leading to a high energy efficiency of 145 Meps/W or 145 event/μJ. We tested the prototype system on MNIST-DVS, Poker-DVS, and Posture-DVS datasets, and obtained classification accuracies of 77.9%, 99.4% and 99.3%, respectively. Compared to prior works, our VLSI system achieves higher processing speeds, higher computing efficiency, comparable accuracy, and lower resource costs.

Cloud Computing Storage Data Access Control Method Based on Dynamic Re-Encryption

“…When introducing feature weighting to calculate the information gain of the current attributes of cloud computing storage data, the relevance of this feature to the classification result can be included [20,21]. e setting of feature weights for each dimension in the system depends on the characteristics of the data stored in cloud computing.…”

An Asynchronous Real-Time Corner Extraction and Tracking Algorithm for Event Camera

“…For each circle, we search for a continuous arc with higher timestamps than all other pixels on the circle. On the inner circle (blue), the arc length l inner should be within the interval of [ 3 , 6 ], and on the outer circle (yellow), the arc length l outer should be within the interval of [ 4 , 8 ] (see Figure 5 a). Alternatively, the arc length on the inner and outer circle should be within the interval of [ 10 , 13 ] and [ 12 , 16 ], respectively (see Figure 5 b).…”

“…Since there are numerous advantages, several recent works [ 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 ] focus on processing the unconventional output of event cameras and unlocking their potentials. In event-based vision, the corner is one of the most fundamental features, and corner event tracking is usually used in many applications, such as target tracking [ 15 , 16 ], 3D Reconstruction [ 17 , 18 ] and motion estimation [ 19 , 20 ].…”

Reform and Practice of Public English Examination Mode in Colleges and Universities Using Big Data Analysis and Speech Recognition

“…Zhang and Goh have built an automatic scoring statistical model for Chinese students' English compositions, although the accuracy rate is higher than that of manual scoring [14], but to a certain extent, due to the neglect of the characteristics of text content and deep structure, the number of samples is too small, the source range is small, and it is not representative. [17]. Based on BD personalization and adaptation, Wójcik and Piekarczyk examined the learning process structure, learning process visualization, and learning effect demonstration, and the findings showed that data analysis of students' learning behavior and knowledge mastery could recommend reasonable learning paths and learning resources with appropriate difficulty [18].…”