Adaptive Learning-Rate Backpropagation Neural Network Algorithm Based on the Minimization of Mean-Square Deviation for Impulsive Noises

Abstract

This paper presents a novel adaptive learning-rate backpropagation neural network (ALR-BPNN) algorithm based on the minimization of mean-square deviation (MSD) to implement a fast convergence rate and robustness to impulsive noises. The learning rates of the weights in each hidden layer are derived to minimize the upper bound of the MSD obtained by the analysis, which guarantees a fast convergence rate in a stable range. Moreover, by adopting the variance of the kind of the measurement noises in each layer through the variance of the error signals, the proposed scheme provides robustness to the impulsive noises. The performance of the proposed algorithm is evaluated on various sequential signals and industrial data including the impulsive noise and compared with conventional ALR-BPNN algorithms. Simulation results indicate that the proposed algorithm outperforms the existing algorithms. INDEX TERMS Adaptive learning rate, neural network, mean-square deviation, impulsive noises.

Network Security Evaluation Based on Improved Genetic Algorithm and Weighted Error Backpropagation Algorithm

“…The improved GA is obtained by improving the network degree correlation in the GA. The algorithm is able to manipulate data based on probabilistic optimization of cybersecurity assessment objects without the need to derive the function [16][17]. This makes it possible to search for cybersecurity assessment without the need to determine the optimization rules, but to automatically adjust the search direction to find its required object data.…”

A Novel Individual Variable Step-Size Subband Adaptive Filter Algorithm Robust to Impulsive Noises

“…A DAPTIVE filters are used in various fields of signal processing such as acoustic echo cancellation, active noise cancellation, channel equalization, and system identification [1]- [5]. They are also used in artificial intelligence and linear algebra recently [6]. Among various adaptive filter algorithms, the least-mean-square (LMS) algorithm and the normalized-least-mean-square (NLMS) algorithm are most used because of their simple structure and good performance [7]- [11].…”