Ensemble Pruning of RF via Multi-Objective TLBO Algorithm and Its Parallelization on Spark

Abstract

Ensemble learning has been widely used in various fields. Still, too many base classifiers will affect the classification time of the ensemble classifier under the big data environment, while reducing base classifiers will affect the classification accuracy of the ensemble classifier. Therefore, the multi-objective teaching-learning-based optimization (MO-TLBO) algorithm is used to carry out ensemble pruning of random forest (RF) to improve the classification accuracy and speed of RF. MO-TLBO algorithm aims at maximizing classification accuracy and minimizing classification time, and it can find a sub-forest with higher classification accuracy and faster classification speed. In addition, considering the vast computational time of ensemble pruning of RF via MO-TLBO algorithm under the big data environment, a vote set is constructed to improve the fitness evaluation process. In the Spark platform, the RF improved by the MO-TLBO algorithm (MO-TLBO-RF) is parallelized based on data parallelism. The Shuffle optimization strategy is proposed to reduce the number of Shuffles in the execution of parallel MO-TLBO-RF. The proposed MO-TLBO-RF is applied to rolling bearing fault diagnosis. The experimental results show that the algorithm can obtain an RF with high fault diagnosis accuracy and fast fault diagnosis speed. The results also prove that the ensemble pruning time can be greatly reduced via the vote set and parallelization of MO-TLBO-RF. INDEX TERMS Ensemble pruning, multi-objective TLBO algorithm, parallelization, random forest, Spark.

A Spark-Based Parallel Implementation of Arithmetic Optimization Algorithm

“…Therefore, many traditional metaheuristics such as genetic algorithm (Lu et al, 2020), particle swarm optimization (Al-Sawwa & Ludwig, 2020), differential evolution (He et al, 2021), whale optimization (AlJame et al, 2020), sine cosine (Alfailakawi et al, 2021), teaching-learning-based optimization (Wan et al, 2021), and grey wolf optimizer (Jarray et al, 2022a) have been successfully parallelized on Spark environments showing considerable performance gains for large scale problems. However, AOA being a recently proposed metaheuristic has not been parallelized under such an environment yet.…”

A Cascaded Multilevel Inverter design based Harmonic Optimization using TLBO Algorithm for Wind Energy System

“…Major power networks are also growing more sophisticated as the world's energy usage rises. However, the usage of alternative energy sources has rapidly increased as a result of rising worries about global pollution and the finite supply of fossil fuels [4][5][6]. Due to its capacity to lower pollution, renewable energy has recently gained popularity and currently provides a sizeable amount of the world's power [7][8].…”