A Variable Impacts Measurement in Random Forest for Mobile Cloud Computing

Abstract

Recently, the importance of mobile cloud computing has increased. Mobile devices can collect personal data from various sensors within a shorter period of time and sensor-based data consists of valuable information from users. Advanced computation power and data analysis technology based on cloud computing provide an opportunity to classify massive sensor data into given labels. Random forest algorithm is known as black box model which is hardly able to interpret the hidden process inside. In this paper, we propose a method that analyzes the variable impact in random forest algorithm to clarify which variable affects classification accuracy the most. We apply Shapley Value with random forest to analyze the variable impact. Under the assumption that every variable cooperates as players in the cooperative game situation, Shapley Value fairly distributes the payoff of variables. Our proposed method calculates the relative contributions of the variables within its classification process. In this paper, we analyze the influence of variables and list the priority of variables that affect classification accuracy result. Our proposed method proves its suitability for data interpretation in black box model like a random forest so that the algorithm is applicable in mobile cloud computing environment.

Lipidomics as a Diagnostic Tool for Prostate Cancer

“…Variable importance was verified based on the calculated mean decrease in accuracy [ 16 ] (in the case of RF) and Olden’s method output [ 17 ] (in the case of ANN). The data was split randomly into two groups: one half of the data (50%) comprised the training set (used for model learning), while the other half was used for testing (the previously developed model was used to make predictions on this new data; the observed rates of false positive, false negative, true positive, and true negative were used to evaluate performance by class).…”

Machine Learning to Predict Lower Extremity Musculoskeletal Injury Risk in Student Athletes

“…While we have attempted to reduce training time and the potential for overfitting with careful feature selection methods, random forest modeling has inherent limitations, which include high model complexity requiring computational resources and longer training periods than other machine learning frameworks. We use Mean Decrease Accuracy for feature selection, which has been known to have limitations due to the multicollinearity problem (variable impact calculation is less accurate when there are high numbers of correlated variables) (Hur et al, 2017 ). Future studies with significantly larger sample sizes will be required to improve upon this framework for general student athlete injury risk.…”

“…In future studies, gradient tree boosting, another tree-based machine learning model, could be considered to reduce the computational resources necessary for random forest modeling. Additionally, new methods of feature selection that solve the multicollinearity problem, such as the Shapley Value method (Hur et al, 2017 ), could be considered for future selection in future studies.…”

Filter Variable Selection Algorithm Using Risk Ratios for Dimensionality Reduction of Healthcare Data for Classification

“…By doing so, the importance of a variable in predicting the response is quantified by evaluating the difference of how much including or excluding that variable decreases or increases accuracy [18][19][20]. This difference is referred to as the Mean Decrease Accuracy (MDA), and is computed by the formula shown in Equation 3 [21,22].…”