A Circuit-Based Neural Network with Hybrid Learning of Backpropagation and Random Weight Change Algorithms

Abstract

A hybrid learning method of a software-based backpropagation learning and a hardware-based RWC learning is proposed for the development of circuit-based neural networks. The backpropagation is known as one of the most efficient learning algorithms. A weak point is that its hardware implementation is extremely difficult. The RWC algorithm, which is very easy to implement with respect to its hardware circuits, takes too many iterations for learning. The proposed learning algorithm is a hybrid one of these two. The main learning is performed with a software version of the BP algorithm, firstly, and then, learned weights are transplanted on a hardware version of a neural circuit. At the time of the weight transplantation, a significant amount of output error would occur due to the characteristic difference between the software and the hardware. In the proposed method, such error is reduced via a complementary learning of the RWC algorithm, which is implemented in a simple hardware. The usefulness of the proposed hybrid learning system is verified via simulations upon several classical learning problems.

Amazon Employees Resources Access Data Extraction via Clonal Selection Algorithm and Logic Mining Approach

“…ANN has several comprehensive architectures of feed-forward or feedback networks. Artificial Intelligence (AI) practitioners utilized ANN as a platform in applications such as entity classification problems [ 6 ], conducting analysis [ 7 , 8 ], pattern recognition [ 9 , 10 ], clustering problems [ 11 , 12 ] and circuits [ 13 , 14 ]. Nonetheless, another popular network of feedback ANN is the Hopfield Neural Network (HNN), which was formulated by [ 15 ] to solve optimization tasks.…”

Neural Network-Based Alzheimer’s Patient Localization for Wireless Sensor Network in an Indoor Environment

“…Neural networks are efficient computational methods that are used for knowledge representation, machine learning, and applying developed knowledge to forecast the output response of composite systems [30]. Artificial neural networks have recently been applied effectively, realizing significant achievements [31]. A biological neural network simulates the activity in the biological brain.…”

Spintronic memristor synapse and its RWC learning algorithm

“…When the output square error decreases as the weight changes, the variable quantity of weight changes according to (24) until the output square error increases. Similarly, when the error at the output increases, the weights are updated randomly again.…”