Approaching Optimal Nonlinear Dimensionality Reduction by a Spiking Neural Network

Abstract

This work deals with the presentation of a spiking neural network as a means for efficiently solving the reduction of dimensionality of data in a nonlinear manner. The underneath neural model, which can be integrated as neuromorphic hardware, becomes suitable for intelligent processing in edge computing within Internet of Things systems. In this sense, to achieve a meaningful performance with a low complexity one-layer spiking neural network, the training phase uses the metaheuristic Artificial Bee Colony algorithm with an objective function from the principals in the machine learning science, namely, the modified Stochastic Neighbor Embedding algorithm. To demonstrate this fact, complex benchmark data were used and the results were compared with those generated by a reference network with continuous-sigmoid neurons. The goal of this work is to demonstrate via numerical experiments another method for training spiking neural networks, where the used optimizer comes from metaheuristics. Therefore, the key issue is defining the objective function, which can relate optimally the information at both sides of the spiking neural network. Certainly, machine learning techniques have advanced in defining efficient loss functions that can become suitable objective function candidates in the metaheuristic training phase. The practicality of these ideas is shown in this article. We use MSE values for evaluating the relative quality of the results and also co-ranking matrices.

Short-Term to Long-Term Plasticity Transition Behavior of Memristive Devices with Low Power Consumption via Facilitating Ionic Drift of Implanted Lithium

“…Neuromorphic computing, which imitates the human brain's information processing, has been proposed as an alternative computing architecture to sequential data processing [9][10][11][12][13]. The major idea behind the proposed neuromorphic computing concept is collocating memory and processing units involving parallel data processing that separate parts of a complex task into smaller and independent parts to efficiently handle larger amounts of data.…”