Appropriate medical data categorization for data mining classification techniques

Abstract

Some data mining (DM) methods, or software tools, require normalized data, others rely on categorized data, and some can accommodate multiple data scales. Each DM technique has a specific background theory; therefore, different results are expected when applying multiple methods. The purpose of this study is to find the data format appropriate for each DM classification technique for wider applications, and efficiently to obtain trustworthy results. Considering the nature of medical data, categorical variables are sometimes useful for making decisions and can make it easier to extrapolate knowledge. In this study, three mathematical data categorization methods (Fusinter, minimum description length principle [MDLPC] and Chi-merge) were applied to accommodate five data mining classification techniques (statistics discriminant analysis, supervised classification with Neural Networks, Decision trees, Genetic supervised clustering and Bayesian classification [probability neural networks; PNN]) using a heart disease database with four types of data (continuous data, binary data, nominal data, and ordinal data). Compared with original or normalized data, data categorized by the MDLPC categorization method was found to perform better in most of the DM classification techniques used in this study. Categorical data is good for most DM classification techniques (e.g. classification of disease and non-disease groups) and is relatively easy to use for extracting medical knowledge.

Important variable selection techniques with multiple solutions for medical information applications

“…In our previous study [10], we have proved that categorical data is good for most DM techniques, and the minimum description length principle (MDLPC) discretization method [11] performed best for this heart disease database. SIPINA_W # [12] program has a built-in MDLPC discretization function so that the original values have been categorized by this function for further applications.…”

<p>Fluvoxamine treatment response prediction in obsessive-compulsive disorder: association rule mining approach</p>

“…Data mining approach is becoming increasingly popular for providing a deeper understanding of medical data, including disease pathogenesis and treatment leading to a new discovery from the medical data set that the conventional methods are unable to process due to their limitations 13–16. Data mining algorithms are classified into two main categories: supervised and unsupervised learning 17.…”

Applying k-Nearest Neighbour in Diagnosing Heart Disease Patients

“…Healthcare data mining attempts to solve real world health problems in diagnosis and treatment of diseases [13]. Researchers are using data mining techniques in the medical diagnosis of several diseases such as diabetes [14], stroke [15], cancer [16], and heart disease [17].…”