A Novel Adaptive-Boost-Based Strategy for Combining Classifiers Using Diversity Concept

Golestani, Abbas; Amiri, Khitem; Motlagh, Mohammad Reza Jahed

doi:10.1109/icis.2007.37

Cited by 8 publications

(1 citation statement)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The prediction performance of the Stacking is tightly dependent on the accuracy and diversity of the base classifiers in the first layer [ 22 , 28 , 31 ]. In this paper, we propose a novel approach for the smart selection of the base classifiers in order to improve the prediction performance of the final model.…”

Section: Introductionmentioning

confidence: 99%

HDEC: A Heterogeneous Dynamic Ensemble Classifier for Binary Datasets

Ostvar

Moghadam

2020

Computational Intelligence and Neuroscience

View full text Add to dashboard Cite

In recent years, ensemble classification methods have been widely investigated in both industry and literature in the field of machine learning and artificial intelligence. The main advantage of this approach is to benefit from a set of classifiers instead of using a single classifier with the aim of improving the prediction performance, such as accuracy. Selecting the base classifiers and the method for combining them are the most challenging issues in the ensemble classifiers. In this paper, we propose a heterogeneous dynamic ensemble classifier (HDEC) which uses multiple classification algorithms. The main advantage of using heterogeneous algorithms is increasing the diversity among the base classifiers as it is a key point for an ensemble system to be successful. In this method, we first train many classifiers with the original data. Then, they are separated based on their strength in recognizing either positive or negative instances. For doing this, we consider the true positive rate and true negative rate, respectively. In the next step, the classifiers are categorized into two groups according to their efficiency in the mentioned measures. Finally, the outputs of the two groups are compared with each other to generate the final prediction. For evaluating the proposed approach, it has been applied to 12 datasets from the UCI and LIBSVM repositories and calculated two popular prediction performance metrics, including accuracy and geometric mean. The experimental results show the superiority of the proposed approach in comparison to other state-of-the-art methods.

show abstract

Section: Introductionmentioning

confidence: 99%