Visual research on the trustability of classical variable selection methods in Cox regression

Abstract

Multivariate models such as the Cox regression model, if developed carefully, are powerful tools for making prognostic prediction which are frequently used in studies of clinical outcomes. Many applications require a large number of variables to be modelled by using a relatively small patient sample. Determination of the important variables in a model is critical to understand the behaviour of phenomena as the independent variables contribute the most to the outcome. From a practical perspective, a small subset of independent variables are usually selected from a large data set without the loss of any predictive efficiency. Automatic variable selection algorithms in scientific studies are commonly used for obtaining interpretable and practically applicable models. However, the careless use of these methods may lead to statistical problems. The performance of the generated models may be poor due to the violation of assumption, omission of the important variables, problems of overfitting, and the problem of multicollinearity and outliers. In order to enhance the accuracy of a model, it is essential to explore the data and its main characteristics before making any statistical inference. This study suggests an approach for acquiring a trustworthy model selection procedure for survival data by performing classical variables selection methods, accompanied by a graphical visualization method, namely robust coplot. Thus, it enables us to investigate the discrimination of observations, clusters of the variables and clusters of the observations that are highly characterized by a particular variable in a one graph. We present an application of combined method, as an integral part of statistical modelling, on survival data on multiple myeloma to show how coplot results are used in automatic variable selection algorithm in Cox regression model-building.

Probabilistic prediction of the time to hard freeze using seasonal weather forecasts and survival time methods

“…A fundamental assumption in the proportional hazard model is that the hazard ratio of two individuals is independent over time. If this is inappropriate, one can consider a Cox model with time‐dependent regression coefficients (Ata Tutkun and Tekin, 2007) or an accelerated failure time model that assumes that the effect of a covariate increases or decreases during the study period by some constant (Wei, 1992; Faruk, 2018). Survival models also exist where the hazard rate is estimated by using neural networks or other machine‐learning techniques (Faraggi and Simon, 1995; Katzman et al ., 2018).…”

Selection of Temporal Lags for Predicting Riverflow Series from Hydroelectric Plants Using Variable Selection Methods

“…• Rendall et al [26]-extensive comparison of large scale data driven prediction methods based on VS and machine learning; • Marcjasz et al [27]-to electricity price forecasting; • Santi et al [28]-to predict mathematics scores of students; • Karim et al [29]-to predict post-operative outcomes of cardiac surgery patients; • Kim and Kang [30]-to faulty wafer detection in semiconductor manufacturing; • Furma ńczyk and Rejchel [31]-to high-dimensional binary classification problems; • Fouad and Loáiciga [5]-to predict percentile flows using inflow duration curve and regression models; • Ata Tutkun and Kayhan Atilgan [32]-investigated VS models in Cox regression, a multivariate model; • Mehmood et al [33]-compared several VS approaches in partial least-squares regression tasks;…”