Individual Attribute Selection Using Information Gain Based Distance for Group Classification of Elderly People With Hypertension

Abstract

Attribute selection is the process of selecting relevant attributes being used in model construction to enhance model accuracy. For general medical oriented classification applications, classical attribute selection methods principally select common attributes in the dataset for all individuals. The idea of using individual attributes is proposed in this study to represent the difference among individuals for self-diagnosis. Consequently, this study proposes a new attribute selection method, called information gain based distance (IGD), for individual attribute selection, which represents an individual's health condition differently and can be used for effective classification. The proposed method combines the concept of information gain and objective distance to select individual attributes affecting classification. The IGD method is expected to provide higher classification performance than classical attribute selection methods. To assess the performance of the IGD method, classification accuracy between data with classical attribute selections and with the IGD method is compared. The case study is conducted with 971 secondary data used for group classification of elderly people with hypertension. The classification result of different classifiers was compared, including K-nearest neighbors, neural network, and naive Bayes. The comparison revealed that the classification of data with the IGD attribute selection method provided an average classification accuracy of 98.73%. In comparison, those classifications of data with classical attribute selection methods provided 62.99%, 62.99%, 62.62%, and 62.85% for information gain, Gini index, chisquared, and decision tree, respectively. The results showed that data classification with the IGD method provided higher performance than those with the classical attribute selection methods.

Average Weighted Objective Distance-Based Method for Type 2 Diabetes Prediction

“…Information gain is still applied to prioritize factors for AWOD. Generally, information gain measures reductions in entropy [32] and determines irrelevant attributes of a dataset [33][34][35][36], including individual factors [37] by considering information gain levels after reducing entropy. For AWOD, the information gain is applied to determine both significant and insignificant factors for individuals.…”

Implementasi Algoritma Decision Tree Dengan Fitur Seleksi Weight by Information Gain

“…Nilai yang ditampilkan dari operator weight by information gain merupakan nilai entropy. Entropy merupakan ukuran ketidakmurnian atau ketidak teraturan data, dimana nilainya berada pada range 0-1 [11] Feature selection merupakan sebuah teknik penting dalam data preprocessing [12] dengan cara mengeliminasi fitur atau mereduksi fitur yang bertujuan untuk meningkatkan akurasi klasifikasi [13]. Information gain merupakan teknik seleksi fitur berbasis filter [14] Information gain menggunakan perangkingan atribut dan mengurangi noise yang disebabkan oleh fitur yang tidak relevan.…”

“…Penggunaan feature selection weight by information gain dapat mengurangi waktu yang dibutuhkan dalam proses pembuatan pohon keputusan serta memberikan performance yang lebih tinggi [13] Penelitian ini juga melakukan pengujian dengan data imbalance sebanyak 205 dataset dengan label tidak lulus 41 dan label lulus 164. Performance yang dihasilkan hampir sama tetapi perbedaan yang paling terlihat adalah nilai recall yang sangat rendah yaitu hanya sebesar 50%.…”

Reliable plagiarism detection system based on deep learning approaches

“…The order of TFS features is effective in the construction process of DenseNet and LSTM classifiers. Therefore, information gain [31] was applied to rank the features. Table 4 shows the description of the ranked features of TSF database.…”