An efficient fuzzy classifier with feature selection based on fuzzy entropy

Abstract

This paper presents an efficient fuzzy classifier with the ability of feature selection based on a fuzzy entropy measure. Fuzzy entropy is employed to evaluate the information of pattern distribution in the pattern space. With this information, we can partition the pattern space into nonoverlapping decision regions for pattern classification. Since the decision regions do not overlap, both the complexity and computational load of the classifier are reduced and thus the training time and classification time are extremely short. Although the decision regions are partitioned into nonoverlapping subspaces, we can achieve good classification performance since the decision regions can be correctly determined via our proposed fuzzy entropy measure. In addition, we also investigate the use of fuzzy entropy to select relevant features. The feature selection procedure not only reduces the dimensionality of a problem but also discards noise-corrupted, redundant and unimportant features. Finally, we apply the proposed classifier to the Iris database and Wisconsin breast cancer database to evaluate the classification performance. Both of the results show that the proposed classifier can work well for the pattern classification application.

A hybrid possibilistic approach for Arabic full morphological disambiguation

“…This gain includes the information entropy [30,42] which has been studied in many applications of artificial intelligence domain such as clustering [43] and classification [42]. The entropy divides the space into non-overlapping decision regions for classification [44].…”

Computer Graphic and Photographic Image Classification using Local Image Descriptors

“…Fuzzy entropy [27][28] involves fuzziness uncertainties. using the steps given as follows, we compute fuzzy entropy of each variable (feature) [29][30] …”

Fuzzy Decision Tree Based Classification of Psychometric Data

“…In the recalled approach, for each real valued attribute A i ∈ Attr describing cases, fuzzy partitions A i1 , A i2 , ..., A i k i , with ranges [0, 1], are determined (see an example in Figure 1). [16] is used. The cardinality measure M (A i1 ) for each A i1 is calculated as:…”