Revisiting evolutionary algorithms in feature selection and nonfuzzy/fuzzy rule based classification

Abstract

This paper discusses the relevance and possible applications of evolutionary algorithms, particularly genetic algorithms, in the domain of knowledge discovery in databases. Knowledge discovery in databases is a process of discovering knowledge along with its validity, novelty, and potentiality. Various genetic-based feature selection algorithms with their pros and cons are discussed in this article. Rule (a kind of high-level representation of knowledge) discovery from databases, posed as single and multiobjective problems is a difficult optimization problem. Here, we present a review of some of the genetic-based classification rule discovery methods based on fidelity criterion. The intractable nature of fuzzy rule mining using single and multiobjective genetic algorithms reported in the literatures is reviewed. An extensive list of relevant and useful references are given for further research. C 2013 Wiley Periodicals, Inc.

Support vector machines in engineering: an overview

“…There are three main general problems that involve hybrid algorithms involving SVMs: obtaining SVM (or SVR) best set of parameters (BSPs), feature selection of input variables (FSPs), and kernel selection and combination problems (KSPs) …”

DecisionTree for Classification and Regression: A State-of-the Art Review

“…The embedded sensors, IoTs, ubiquitous devices like scanners, bar code readers, and smartphones generate a huge amount of data at an exponential rate, which contributes to the expansion of data size and volume [1] [2] [3]. Intuitively, the valuable hidden knowledge and information in this huge amount of accumulated data could be the potential source to enhance the decision-making capability of the decision-makers of an organization or society [4] [5] [6]. Some of the classification techniques like decision tree (DT), support vector machine (SVM), and random forest [7] [8] have been proven to be effective models for extracting knowledge, that is valid, potential, novel, and finally useful.…”

Feature Selection Methods for Classification – a Comparison

“…In filter approach the feature selection is performed without considering the classification algorithm that will be applied to the selected attributes. [2] Here a subset of attributes that preserves the possible relevant information found in the entire set of attributes is selected. [3] In wrapper approach feature selection is performed by taking into account the classification algorithm that will be applied to the selected attributes.…”