Distinct Multiple Learner-Based Ensemble SMOTEBagging (ML-ESB) Method for Classification of Binary Class Imbalance Problems

Abstract

Traditional classification algorithms often fail in learning from highly imbalanced datasets because the training involves most of the samples from majority class compared to the other existing minority class. In this paper, a Multiple Learners-based Ensemble SMOTEBagging (ML-ESB) technique is proposed. The ML-ESB algorithm is a modified SMOTEBagging technique in which the ensemble of multiple instances of the single learner is replaced by multiple distinct classifiers. The proposed ML-ESB is designed for handling only the binary class imbalance problem. In ML-ESB the ensembles of multiple distinct classifiers include Naïve Bays, Support Vector Machine, Logistic Regression and Decision Tree (C4.5) is used. The performance of ML-ESB is evaluated based on six binary imbalanced benchmark datasets using evaluation measures such as specificity, sensitivity, and area under receiver operating curve. The obtained results are compared with those of SMOTEBagging, SMOTEBoost, and cost-sensitive MCS algorithms with different imbalance ratios (IR). The ML-ESB algorithm outperformed other existing methods on four datasets with high dimensions and class IR, whereas it showed moderate performance on the remaining two low dimensions and small IR value datasets.

Anomaly Prediction in Electricity Consumption Using a Combination of Machine Learning Techniques

“…According to Feng et al (2020), imbalanced datasets can cause a decrease in the detection accuracy rate. Traditional classification algorithms frequently struggle to learn from unbalanced datasets when the training set contains a disproportionate number of samples from the majority class compared to the other minority classes (Sisodia & Verma, 2019).…”

Predicting Customer Churn using ensemble learning: Case Study of a Fixed Broadband Company

“…Applying SMOTE for data balancing was expected to ensure that the model has robust output (Chawla et al, 2002;Sisodia and Verma, 2019). Relatedly, most algorithms in ensemble learning have several parameters that need to be tuned to obtain optimal accuracy, and so these adjustments were made using the heuristic RandomSearchCV during development in order to generate a model with the best performance (Bergstra and Bengio, 2012).…”

A hybrid data‐level sampling approach in learning from skewed user‐click data for click fraud detection in online advertising

“…Improving learning methods on skewed datasets with uneven class distribution is the foremost challenge in data mining. Unequal class distribution (Sisodia & Verma, 2019) in the dataset has severe implications for several real‐world classification applications such as fault diagnosis (Mathew et al, 2018), credit‐card fraud detection (Sisodia et al, 2017), click fraud detection in online advertising (Haider et al, 2018; Li et al, 2012; Perera et al, 2013; Springborn & Barford, 2013; Xu et al, 2014) and so on. Online advertising or web advertising is one of the most popular sources of revenue generation for different commercial entities (Sisodia & Sisodia, 2022b).…”