Multi-Swarm Algorithm for Extreme Learning Machine Optimization

Abstract

There are many machine learning approaches available and commonly used today, however, the extreme learning machine is appraised as one of the fastest and, additionally, relatively efficient models. Its main benefit is that it is very fast, which makes it suitable for integration within products that require models taking rapid decisions. Nevertheless, despite their large potential, they have not yet been exploited enough, according to the recent literature. Extreme learning machines still face several challenges that need to be addressed. The most significant downside is that the performance of the model heavily depends on the allocated weights and biases within the hidden layer. Finding its appropriate values for practical tasks represents an NP-hard continuous optimization challenge. Research proposed in this study focuses on determining optimal or near optimal weights and biases in the hidden layer for specific tasks. To address this task, a multi-swarm hybrid optimization approach has been proposed, based on three swarm intelligence meta-heuristics, namely the artificial bee colony, the firefly algorithm and the sine–cosine algorithm. The proposed method has been thoroughly validated on seven well-known classification benchmark datasets, and obtained results are compared to other already existing similar cutting-edge approaches from the recent literature. The simulation results point out that the suggested multi-swarm technique is capable to obtain better generalization performance than the rest of the approaches included in the comparative analysis in terms of accuracy, precision, recall, and f1-score indicators. Moreover, to prove that combining two algorithms is not as effective as joining three approaches, additional hybrids generated by pairing, each, two methods employed in the proposed multi-swarm approach, were also implemented and validated against four challenging datasets. The findings from these experiments also prove superior performance of the proposed multi-swarm algorithm. Sample code from devised ELM tuning framework is available on the GitHub.

Artificial Neural Network Tuning by Improved Sine Cosine Algorithm for HealthCare 4.0

“…Other successful applications of metaheuristics optimizers include tuning of the cloud, edge and fog computing [2,5,15,23,46,59], feature selection challenge [8,19,22,32,37,49,61], dropout regularization [11], a variety of COVID-19 applications [25,58,[62][63][64], tuning artificial neural networks [3,6,7,10,13,18,44], text clustering [21,50] and cryptocurrency price forecast [42].…”

Intrusion Detection by XGBoost Model Tuned by Improved Multi-verse Optimizer

“…NP-hard complexity with real world problems is common and hence the application of these algorithms is diverse. Some notable examples are artificial neural network optimization [7][8][9][10]12,14,15,19,21,26,32,36,48,53,54], wireless sensors networks (WSNs) [4,11,13,52,65,75], cryptocurrency trends estimations [44,49], finally the COVID-19 global epidemic-associated applications [22,25,64,66,[69][70][71]73], computer-conducted MRI classification and sickness determination [17,20,24,33,55], cloud-edge and fog computing and task scheduling [3,5,6,16,23,50,67], and lastly securing networks through intrusion detection [2,31,43,62,…”

Training a Logistic Regression Machine Learning Model for Spam Email Detection Using the Teaching-Learning-Based-Optimization Algorithm

“…Consequently, the researchers have implemented a large number of algorithms, and employed them on a wide range of real-world problems from different domains, such as medical diagnostics [15,21,25,37,47], wireless sensor networks [5,10,13,53,63,72], stock price forecasting [17], intrusion detection and other security applications [2,35,45,51,61,62,66,71] and plant classification problem [18]. Metaheuristics algorithms have been also employed to tune the cloud, edge and fog computing [3,6,16,24,52,65], feature selection [9,20,23,36,41,54,67], dropout regularization [12], a wide spectrum of COVID-19 challenges [26,64,[68][69][70], artificial neural networks optimization [4,7,8,11,14,19,…”