Multiobjective Evolutionary Feature Selection for Fuzzy Classification

Abstract

The interpretability of classification systems refers to the ability of these to express their behaviour in a way that is easily understandable by a user. Interpretable classification models allow for external validation by an expert and, in certain disciplines such as medicine or business, providing information about decision making is essential for ethical and human reasons. Fuzzy rule-based classification systems are consolidated powerful classification tools based on fuzzy logic and designed to produce interpretable models; however, in presence of a large number of attributes, even rule-based models tend to be too complex to be easily interpreted. In this work, we propose a novel multivariate feature selection method in which both search strategy and classifier are based on multi-objective evolutionary computation. We designed a set of experiments to establish an acceptable setting with respect to the number of evaluations required by the search strategy and by the classifier, and we tested our strategy on a real-life dataset. Then, we compared our results against a wide range of feature selection methods that includes filter, wrapper, multivariate and univariate methods, with deterministic and probabilistic search strategies, and with evaluators of diverse nature. Finally, the fuzzy rule-based classification model obtained with the proposed method has been evaluated with standard performance metrics and compared with other wellknown fuzzy rule-based classifiers. We have used two real-life datasets extracted from a contact center; in one case, with the proposed method we obtained an accuracy of 0.7857 with 8 rules, while the best fuzzy classifier compared obtained 0.7679 with 8 rules, and in the second case, we obtained an accuracy of 0.7403 with 5 rules, while the best fuzzy classifier compared obtained 0.6364 with 4 rules.

A New Feature Scoring Method in Keystroke Dynamics-Based User Authentications

“…As shown in Fig. 7, when X is the data excluding both ends of p% as shown in the formula (9), and the number of data in X is n, the trimmed mean of X denoted by TrMean(X ) is equal to the arithmetic mean as shown in the formula (10).…”

A Three-Step Authentication Model for Mobile Phone User Using Keystroke Dynamics

“…The model was further optimized using a wrapperbased approach. Optimization is desired to get one of the two outcomes -reducing the error rates or reducing the number of features while keeping the error rates at almost the same value [54], [55]. Reduction in the number of features is a desired output of optimization because the model is developed for mobile phones, which have limited processing power.…”

A novel aggregation-based dominance for Pareto-based evolutionary algorithms to configure software product lines

“…Moreover, we plan to investigate more Pareto-based evolutionary algorithms by using the proposed ADO and understand its characteristics in more depth. Finally, we attempt to apply ADO to some other interesting areas related to optimal feature selection, such as data classification in medicine or business [60,61].…”