Predicting Missing Attribute Values Using k-Means Clustering

Abstract

Problem statement: Predicting the value for missing attributes is an important data preprocessing problem in data mining and knowledge discovery tasks. Several methods have been proposed to treat missing data and the one used more frequently is deleting instances containing at least one missing value of a feature. When the dataset has minimum number of missing attribute values then we can neglect the instances. But if it is high, deleting those instances may neglect the essential information. Some methods, such as assigning an average value to the missing attribute, assigning the most common values make good use of all the available data. However the assigned value may not come from the information which the data originally derived from, thus noise is brought to the data. Approach: In this study, k-means clustering is proposed for predicting missing attribute values. The performance of the proposed approach is analyzed with nine different methods. The overall analysis shows that the k-means clustering can predict the missing attribute values better than other methods. After assigning the missing attributes, the feature selection is performed with Bees Colony Optimization (BCO) and the improved Genetic KNN is applied for finding the classification performance as discussed in our previous study. Results: The performance is analyzed with four different medical datasets; Dermatology, Cleveland Heart, Lung Cancer and Wisconsin. For all the datasets, the proposed k-means based missing attribute prediction achieves higher accuracy of 94.60 %, 90.45 %, 87.51 % and 95.70 % respectively. Conclusion: The greater classification accuracy shows the superior performance of the k-means based missing attribute value prediction.

Neural Networks Based Nonlinear Time Series Regression for Water Level Forecasting of Dungun River

“…Table 1 There are a lot of approaches to deal with missing data. In some cases, deletion or elimination the missing variable is the default method for most procedures (Suguna and Thanuskodi, 2011). However in time series regression, this approach seems like not the best methods to be used.…”

“…It has been reported that the results using Radial Basis Function (RBF) neural network is better than Back Propagation Neural Network (BPNN) in modeling a meteorological problems such as weather forecasting. In addition, there was analysis shows that pre-processing data analysis also can influenced the performance of prediction model (Zhang, 2002;Suguna and Thanuskodi, 2011). From previous work, the method of BPNN is better compared to SARIMA in obtaining water level prediction at Dungun River, Terengganu (Arbain and Wibowo, 2012).…”

Improving the Performance of Multivariate Bernoulli Model based Documents Clustering Algorithms using Transformation Techniques

“…It will often be desirable to choose a subset of all the features available, to reduce the dimensionality of the problem space. This step often requires a good deal of domain knowledge and data analysis (Suguna et al, 2011, Rao, 2003.…”

An algorithmic approach to missing data problem in modeling human aspects in software development

“…Another category of methods to handle missing data consists of machine learning techniques such as multi-layer perceptrons (MLP), self-organizing maps (SOM) k-nearest neighbour (kNN) [15,31], decision trees [27] and Linear Discriminant Analysis (LDA) [1]. Moreover, there are various techniques, which are used to handle missing data in software cost estimation models such as mean imputation, list-wise deletion (LD), kNN, and Expectation Maximization (EM) algorithms.…”