A novel neural network model with distributed evolutionary approach for big data classification

Abstract

The considerable improvement of technology produced for various applications has resulted in a growth in data sizes, such as healthcare data, which is renowned for having a large number of variables and data samples. Artificial neural networks (ANN) have demonstrated adaptability and effectiveness in classification, regression, and function approximation tasks. ANN is used extensively in function approximation, prediction, and classification. Irrespective of the task, ANN learns from the data by adjusting the edge weights to minimize the error between the actual and predicted values. Back Propagation is the most frequent learning technique that is used to learn the weights of ANN. However, this approach is prone to the problem of sluggish convergence, which is especially problematic in the case of Big Data. In this paper, we propose a Distributed Genetic Algorithm based ANN Learning Algorithm for addressing challenges associated with ANN learning for Big data. Genetic Algorithm is one of the well-utilized bio-inspired combinatorial optimization methods. Also, it is possible to parallelize it at multiple stages, and this may be done in an extremely effective manner for the distributed learning process. The proposed model is tested with various datasets to evaluate its realizability and efficiency. The results obtained from the experiments show that after a specific volume of data, the proposed learning method outperformed the traditional methods in terms of convergence time and accuracy. The proposed model outperformed the traditional model by almost 80% improvement in computational time.

A memetic dynamic coral reef optimisation algorithm for simultaneous training, design, and optimisation of artificial neural networks

“…The Backpropagation algorithms (BPs) 3 or Extreme Learning Machines (ELM) 4 belong to the first group, commonly used for weight optimisation, while Evolutionary Algorithms (EAs) 5 belong to the second group. This second group is usually referred to Neuroevolution 6 or application of metaheuristics such as EAs to the evolution of ANNs, also known in the literature as Evolutionary Artificial Neural Networks (EANNs) 7 – 9 , so that both the weights and the ANN architecture are optimised. Using EAs is an efficient tool because finding a suitable ANN architecture is a controversial topic in Machine Learning (ML), requiring a lot of trial and error procedures and a great deal of experience of the researcher 2 .…”

Critical Review of Neural Network Generations and Models Design

“…A large and diverse training dataset can lead to more accurate neural network models as it helps cover a broader range of input possibilities. Conversely, sufficient or low-quality training data can result in better performance and accurate predictions [59,60]. It is also essential that the training data is representative of the problem domain and the inputs that the neural network is expected to handle.…”

“…Preprocessing the data this way can lead to more efficient neural networks by ensuring that the input data is consistent and that the neural network can better recognize relevant patterns and relationships. In summary, it is important to have a diverse, representative, and preprocessed dataset to ensure optimal performance [60].…”

Harmonizing Data Streams for Edge AI Protocols to Quantify Shannon's Bounds

“…This dynamic collaboration is weaving a tapestry of innovation, reshaping entire industries, and transforming user experiences. The journey through this terrain includes VM-based cloudlets 36 , supercharging efficiency in mobile devices, the development of programming frameworks for large-scale IoT applications 37 , a comprehensive exploration of mobile cloud computing 38 , the crucial role of fog computing in extending resources to the digital frontier, real-time handling of IoT data at the edge 39 , in-depth dives into the rich landscape of benefits and challenges within edge computing 40 , and a survey of multi-access edge computing within the architectural realm of 5G 41 .…”