Confidence-Based Voting for the Design of Interpretable Ensembles with Fuzzy Systems

Abstract

In this study, a new voting procedure for combining the fuzzy logic based classifiers and other classifiers called confidence-based voting is proposed. This method combines two classifiers, namely the fuzzy classification system, and for the cases when the fuzzy system returns high confidence levels, i.e., the returned membership value is large, the fuzzy system is used to perform classification, otherwise, the second classifier is applied. As a result, most of the sample is classified by the explainable and interpretable fuzzy system, and the second, more accurate, but less interpretable classifier is applied only for the most difficult cases. To show the efficiency of the proposed approach, a set of experiments is performed on test datasets, as well as two problems of estimating the person’s emotional state with the data collected by non-contact vital sensors, which use the Doppler effect. To validate the accuracies of the proposed approach, the statistical tests were used for comparison. The obtained results demonstrate the efficiency of the proposed technique, as it allows for both improving the classification accuracy and explaining the decision making process.

Multiclass Fuzzily Weighted Adaptive-Boosting-Based Self-Organizing Fuzzy Inference Ensemble Systems for Classification

“…In addition, to improve the overall classification accuracy, only the selected fuzzy models satisfying the prediction precision and diversity criteria can join the decision-making committee. An ensemble classification model combines a fuzzy classifier and a less interpretable but more accuracy classifier, i.e., ANN, is proposed in [45]. This ensemble aims to achieve high classification precision while maintaining its interpretability by utilising the so-called confidence-based voting strategy such that the fuzzy classifier serves as the main component and the second classifier will be activated only when the confidence level of the fuzzy classifier is low.…”