Predictive modeling is a critical technique in many real-world applications, including auto insurance rate-making and the decision making of rate filings review for regulation purposes. It is also important in predicting financial and economic risk in business and economics. Unlike testing hypotheses in statistical inference, results obtained from predictive modeling serve as statistical evidence for the decision making of the underlying problem and discovering the functional relationship between the response variable and the predictors. As a result of this, the variable importance measures become an essential aspect of helping to better understand the contributions of predictors to the built model. In this work, we focus on the study of using generalized linear models (GLM) for the size of loss distributions. In addition, we address the problem of measuring the importance of the variables used in the GLM to further evaluate their potential impact on insurance pricing. In this regard, we propose to shift the focus from variable importance measures of factor levels to factors themselves and to develop variable importance measures for factors included in the model. Therefore, this work is exclusively for modeling with categorical variables as predictors. This work contributes to the further development of GLM modeling to make it even more practical due to this added value. This study also aims to provide benchmark estimates to allow for the regulation of insurance rates using GLM from the variable importance aspect.