Big Data: A Parallel Particle Swarm Optimization-Back-Propagation Neural Network Algorithm Based on MapReduce

Abstract

A back-propagation (BP) neural network can solve complicated random nonlinear mapping problems; therefore, it can be applied to a wide range of problems. However, as the sample size increases, the time required to train BP neural networks becomes lengthy. Moreover, the classification accuracy decreases as well. To improve the classification accuracy and runtime efficiency of the BP neural network algorithm, we proposed a parallel design and realization method for a particle swarm optimization (PSO)-optimized BP neural network based on MapReduce on the Hadoop platform using both the PSO algorithm and a parallel design. The PSO algorithm was used to optimize the BP neural network’s initial weights and thresholds and improve the accuracy of the classification algorithm. The MapReduce parallel programming model was utilized to achieve parallel processing of the BP algorithm, thereby solving the problems of hardware and communication overhead when the BP neural network addresses big data. Datasets on 5 different scales were constructed using the scene image library from the SUN Database. The classification accuracy of the parallel PSO-BP neural network algorithm is approximately 92%, and the system efficiency is approximately 0.85, which presents obvious advantages when processing big data. The algorithm proposed in this study demonstrated both higher classification accuracy and improved time efficiency, which represents a significant improvement obtained from applying parallel processing to an intelligent algorithm on big data.

Raven Calls Indicate Sender’s Neural State

“…According to the raven's call recorded under the different circumstances, the biological meanings may be presented differently. Therefore, we selected Back Propagation Neural Network (BPNN) method [33][34][35]. A typical BPNN consists of the input layer, hidden layer and output layer ( Figure 1).…”

The role of big data analytics in industrial Internet of Things

“…The enrichment of intelligent features can lead towards highly optimised and automated industrial processes [91,92]. Therefore, AI will be the core component of big data optimisation and analytics, which will result in highly efficient industrial processes [93].…”

Application of artificial intelligence algorithms on modeling of reflection phase characteristics of a nonuniform reflectarray element

“…Data sets had become extremely large especially with emerge of the big data era. In many cases of regression problems, the required model is aimed to be created from a data set that has either an enormous data size or complex relations within the variables and the targeted output, which traditionally, prediction algorithms commonly become 62,63 Recently, a novel AI regression technique based on evolutionary algorithms for problems with big data size and complex relations has been proposed (SR). [64][65][66][67][68][69][70] Symbolic regression has been inspired by "Darwinian theory of evolution," where there is no any calculated solution.…”