An Enhanced Rough Set based Feature Grouping Approach for Supervised Feature Selection

Abstract

Selection of useful information from a large data collection is an important and challenging problem. Feature selection refers to the problem of selecting relevant features from a given dataset which produces the most predictive outcome as the original features maintain before the selection. Rough set theory (RST) and its extension are the most successful mathematical tools for feature selection from a given dataset. This paper starts with an outline of the fundamental concepts behind the rough set and fuzzy rough set based feature grouping techniques which are related to supervise feature selection. Supervised Quickreduct (QR) and fuzzyrough feature grouping Quickreduct (FQR) algorithms are highlighted here. Then an enhanced version of FQR method is proposed here which is based on rough set dependency criteria with feature significance measure that select a minimal subset of features. Also, the termination condition of the base method is modified. Experimental studies of the algorithms are carried out on five public domain benchmark datasets available in UCI machine learning repository. JRip and J48 classifier are used to measure the classification accuracy. The performance of the proposed method is found to be satisfactory in comparison with other methods.