Ensemble learning methods for decision making: Status and future prospects

Abstract

Abstract:In real world situations every model has some weaknesses and will make errors on training data. Given the fact that each model has certain limitations, the aim of ensemble learning is to supervise their strengths and weaknesses, leading to best possible decision in general. Ensemble based machine learning is a solution of minimizing risk in decision making. Bagging, boosting, stacked generalization and mixture of expert methods are the most popular techniques to construct ensemble systems. For the purpose of combining outputs of class labels, weighted majority voting, behaviour knowledge space and border count methods are used to construct independent classifiers and to achieve diversity among the classifiers which is important in ensemble learning. It was found that an ideal ensemble method should work on the principal of achieving six paramount characteristics of ensemble learning; accuracy, scalability, computational cost, usability, compactness and speed of classification. In addition, the ideal ensemble method would be able to handle large huge image size and long term historical data particularly of spatial and temporal. In this paper we reveal that ensemble models have obtained high acceptability in terms of accuracy than single models. Further, we present an analogy of various ensemble techniques, their applicability, measuring the solution diversity, challenges and proposed methods to overcome these challenges without diverting from the original concepts.

Combining and comparing various machine‐learning algorithms to improve dissolved gas analysis interpretation

“…The ensemble methodology has been used across various disciplines to improve predictive performance. However, sometimes it tends to increase storage space and computational time due to the presence of a vast number of base classifiers in the ensemble [39].…”

A Survey on Requirements of Future Intelligent Networks: Solutions and Future Research Directions

“…Besides the need for suitable methods for global representation of services and networks for the FIN, it should also be able to decide actions/optimizations from the related action space of the domain or layer. Ensemble Learning (EL) is a potential technique to combine features learned from different base classifiers [105]. A comparison of widely used ensemble learning algorithms in the networking domains is given in Table 5.…”

An Ensemble Machine Learning Approach for Fake News Detection and Classification Using a Soft Voting Classifier

“…Scholars have applied machine learning ensemble approaches to solve many related problems. Ali et al [13] suggest that when compared to single models, ensemble models have a higher acceptance in terms of accuracy. Ensemble techniques have proven to be very reliable in many domains due to their ability to cancel weaknesses in some machine learning algorithms, hence increasing the predictive power of a model.…”