An Efficient Feature Selection Strategy Based on Multiple Support Vector Machine Technology with Gene Expression Data

Abstract

The application of gene expression data to the diagnosis and classification of cancer has become a hot issue in the field of cancer classification. Gene expression data usually contains a large number of tumor-free data and has the characteristics of high dimensions. In order to select determinant genes related to breast cancer from the initial gene expression data, we propose a new feature selection method, namely, support vector machine based on recursive feature elimination and parameter optimization (SVM-RFE-PO). The grid search (GS) algorithm, the particle swarm optimization (PSO) algorithm, and the genetic algorithm (GA) are applied to search the optimal parameters in the feature selection process. Herein, the new feature selection method contains three kinds of algorithms: support vector machine based on recursive feature elimination and grid search (SVM-RFE-GS), support vector machine based on recursive feature elimination and particle swarm optimization (SVM-RFE-PSO), and support vector machine based on recursive feature elimination and genetic algorithm (SVM-RFE-GA). Then the selected optimal feature subsets are used to train the SVM classifier for cancer classification. We also use random forest feature selection (RFFS), random forest feature selection and grid search (RFFS-GS), and minimal redundancy maximal relevance (mRMR) algorithm as feature selection methods to compare the effects of the SVM-RFE-PO algorithm. The results showed that the feature subset obtained by feature selection using SVM-RFE-PSO algorithm results has a better prediction performance of Area Under Curve (AUC) in the testing data set. This algorithm not only is time-saving, but also is capable of extracting more representative and useful genes.

State-of-the-art in artificial neural network applications: A survey

“…While common supervised artificial neural networks and their adaptations include single-layer perceptron (SLP) [ 10 , 31 ], multilayer perceptron (MLP) [ 42 , 43 ], and linear classifiers [ 44 , 45 ]. Also, popular supervised ANNs include support vector machines (SVMs) [ 46 , 47 ], k-nearest neighbours (kNNs) [48] . More also in the category of popular supervised ANNs are Bayesian statistics [49] , decision trees [50] and hidden Markov model (HMM) [51] .…”

Activation Modeling and Classification of Voluntary and Imagery Movements From the Prefrontal fNIRS Signals

“…The solutions of (14) and (15) can be found considering them as an eigenvalue problem that leads to finding the optimum values of the projection matrix, P. In Matlab 2017a, fitclda() was used to construct the LDA based predictive model which was further utilized with 5-fold cross-validation to check the classification performance. SVM: SVM is an extensively employed classifier for its high prediction accuracy in high-dimensional features [60][61][62]. SVM can be used as a linear or nonlinear method.…”

“…To find the optimal results of d * maximizes the distance between the hyper-plane and the support vectors. This maximization procedure is obtained by minimizing the following cost function (17) cogitating the restrictions given in (18) [60][61][62][63].…”

Estimation of 18F-FDG PET Image Texture Features for Metastasis Prediction in Non-Small Cell Lung Cancer Using Epithelial Mesenchymal Transition-Related Genes

“…To predict the patient's outcome in terms of metastasis, we used a machine learning approach [34] called random forest (RF) [35]. The machine learning prediction model was used to evaluate the accuracy, precision, and recall score using test data.…”