Using a Vertical-Stream Variational Auto-Encoder to Generate Segment-Based Images and Its Biological Plausibility for Modelling the Visual Pathways

Abstract

Human beings have a strong capability to identify objects in different viewpoints. Unlike computer vision that requires sufficient training samples in various scales and rotations, biological visual systems can efficiently recognize objects in diverse spatial states. To achieve this objective, images are processed into a segment-based representation and then a vertical stream variational auto-encoder (VSVAE) is utilized to generate images based on the preprocessed segments in this study. The novel structure of the two vertical streams can be also considered as a computational model for the interaction between the ventral pathway and the dorsal pathway in the visual cortex. The reconstructive capability of the VSVAE is testified by using a series of geometric information sets to enhance the segment-based representation. By visualizing the learnt features in the hidden layers of VSVAE, the biological plausibility of the model is discussed. In addition, the proposed methodology is able to facilitate the classification accuracy, especially when the images are severely transformed.

Cognitive System of a Virtual Robot Based on Perception, Memory, and Hypothesis Models for Calligraphy Writing Task

“…Most cognitive computing research focuses on perception and information organization, similar to methods for pattern recognition [18][19][20][21][22]. By referring to human perceptual processing, computer vision is used to implement feature extraction process.…”

Deep Learning Techniques for Agronomy Applications

“…For instance, supervised learning techniques (e.g., neural network (NN) [9][10][11][12][13], convolutional neural network (CNN) [14][15][16][17][18], recurrent neural network (RNN) [19][20][21][22][23], and ensemble neural networks (ENN) [24][25][26][27][28]) can be used to forecast weather information and crop growth to improve crop quantities and reduce disaster damage. Furthermore, unsupervised learning techniques (e.g., auto-encoder (AE) [29][30][31][32][33], de-noise auto-encoder (DAE) [34], restricted Boltzmann machine (RBM) [35,36], deep belief network (DBN) [37,38], and deep Boltzmann machine (DBM) [39,40]) can be used to represent data and reduce dimensions for regulation and overfitting prevention. The combination of supervised learning and unsupervised learning techniques can provide the precise estimation and prediction for agronomy applications.…”