Feature selection method based on mutual information and class separability for dimension reduction in multidimensional time series for clinical data

Abstract

a b s t r a c tIn clinical medicine, multidimensional time series data can be used to find the rules of disease progress by data mining technology, such as classification and prediction. However, in multidimensional time series data mining problems, the excessive data dimension causes the inaccuracy of probability density distribution to increase the computational complexity. Besides, information redundancy and irrelevant features may lead to high computational complexity and over-fitting problems. The combination of these two factors can reduce the classification performance. To reduce computational complexity and to eliminate information redundancies and irrelevant features, we improved upon a multidimensional time series feature selection method to achieve dimension reduction. The improved method selects features through the combination of the Kozachenko-Leonenko (K-L) information entropy estimation method for feature extraction based on mutual information and the feature selection algorithm based on class separability. We performed experiments on the Electroencephalogram (EEG) dataset for verification and the non-small cell lung cancer (NSCLC) clinical dataset for application. The results show that with the comparison of CLeVer, Corona and AGV, respectively, the improved method can effectively reduce the dimensions of multidimensional time series for clinical data.

Motor Imagery EEG Classification for Patients with Amyotrophic Lateral Sclerosis Using Fractal Dimension and Fisher’s Criterion-Based Channel Selection

“…For the second aim, we apply Fisher’s criterion [ 42 , 43 ] to accomplish the task of channel selection for each patient. This method calculates the Fisher score of the fractal dimension feature computed from the EEG signal of each channel.…”

A Novel Approach to Improving Brain Image Classification Using Mutual Information-Accelerated Singular Value Decomposition

“…Then, the multi-level segmentation by weighted aggregation algorithm (SWA) is used. A study by Fang et al [13] computed the value of MI by using the Kozachenko Leonenko information entropy estimation method to find robust features. Then, it factorized the obtained feature matrices to satisfy the input of the classification stage.…”

Investigation of Single‐Station Classification for Short Tectonic Tremor in Taiwan

“…To evaluate the classification performance of the feature candidates and select an optimal feature set by using Fisher's class separability criterion, we aim at finding the top‐ranked features that achieve the highest classification accuracy. Fisher class separability criterion is a filter method for feature selection in the machine learning community (Fang et al, ). The Fisher method computes the Fisher score ( F score) for an individual feature that is defined by the ratio of interclass scatter and intraclass scatter; the higher the value of the F score, the higher the between‐class separability of the feature.…”