A Novel Approach for Data Feature Weighting Using Correlation Coefficients and Min–Max Normalization

Abstract

In the realm of data analysis and machine learning, achieving an optimal balance of feature importance, known as feature weighting, plays a pivotal role, especially when considering the nuanced interplay between the symmetry of data distribution and the need to assign differential weights to individual features. Also, avoiding the dominance of large-scale traits is essential in data preparation. This step makes choosing an effective normalization approach one of the most challenging aspects of machine learning. In addition to normalization, feature weighting is another strategy to deal with the importance of the different features. One of the strategies to measure the dependency of features is the correlation coefficient. The correlation between features shows the relationship strength between the features. The integration of the normalization method with feature weighting in data transformation for classification has not been extensively studied. The goal is to improve the accuracy of classification methods by striking a balance between the normalization step and assigning greater importance to features with a strong relation to the class feature. To achieve this, we combine Min–Max normalization and weight the features by increasing their values based on their correlation coefficients with the class feature. This paper presents a proposed Correlation Coefficient with Min–Max Weighted (CCMMW) approach. The data being normalized depends on their correlation with the class feature. Logistic regression, support vector machine, k-nearest neighbor, neural network, and naive Bayesian classifiers were used to evaluate the proposed method. Twenty UCI Machine Learning Repository and Kaggle datasets with numerical values were also used in this study. The empirical results showed that the proposed CCMMW significantly improves the classification performance through support vector machine, logistic regression, and neural network classifiers in most datasets.

Improving Electric Vehicle Structural-Borne Noise Based on Convolutional Neural Network-Support Vector Regression

“…The samples are normalized by [0, 1] to remove the impact of various data outlines and avoid masking the data that significantly affects the dependent variable. Equation ( 4) provides the data normalization formula [39].…”

Machine learning-enabled characterization of concrete mechanical strength through correlation of flexural and torsional resonance frequencies

“…Since these parameters are different in the ranges, the training process of the ML-based prediction model may be deviated. In previous studies [35,36], it has been noted that parameter normalization can significantly increase the performance of the training process of the ML estimation model. Although different ranges can be possible for normalizing the input data, [0.1 0.9] has been served in several studies which maximize the efficiency of the training process [37].…”

Remote Sensing Monitoring of Grassland Locust Density Based on Machine Learning

“…In the formula, Z denotes the calculated value of the Min-Max normalization of the current environmental variable, X i denotes the current environmental variable at the time of operation, X min denotes the minimum value of the current environmental variable at the time of operation, and X max denotes the maximum value of the current environmental variable at the time of operation [11].…”