SVM-RBF Parameters Testing Optimization Using Cross Validation and Grid Search to Improve Multiclass Classification

Abstract

The accuracy of using optimal parameter values in kernel functions is as a determinant to obtain maximum accuracy results on Image retrieval with Support Vector Machine (SVM) classification. Experiments conducted in this study aimed to obtain optimal Gaussian / Radial Basis Function (RBF) kernel function parameter values on non-linear multi class Support Vector Machine (SVM) method. Cross Validation and Grid Search methods were applied in analyzing and testing the optimization range of SVM-RBF kernel parameter values to recognize the image of Indonesian traditional Batik which has geometric decorative patterns. In addition, a feature dataset of Batik images from the results of Discrete Wavelet Transform (DWT) level 3 db2 was used in this study. The feature dataset was used as training and test dataset. By using Cross validation and Grid Search, it resulted in the range value of parameter C = {2 6.5 , 2 6.75 , 2 7 , 2 7.25 , 2 7.5 , 2 7.75 , 2 8 } and γ ={2-14.5 , 2-14.75 , 2-15 , 2-15.25 , 2-15.5 , 2-15.75 , 2-16 }, and the accuracy value of maximum classification for parameter C = 2 7 and γ=2-15. These range results of parameter values and optimal parameter values can be used as a reference in applying parameters on image recognition with geometric decorative motif texture using SVM-RBF kernel classification.

Gross Solids Content Prediction in Urban WWTPs Using SVM

“…A grid search methodology with 10-fold cross-validation on the training set was applied to establish the best type of kernel function and to retrieve the optimal values for the model parameters. This k-fold cross-validation procedure is an extensively used approach for assessing the values of model architecture parameters [42,43]. After this process, the RBF was the kernel with the best results (Equation (7)):…”

Parallel classification and optimization of telco trouble ticket dataset

“…One goal is to enhance the existing conventional softmax algorithm into parallel functionality based on the MapReduce framework. Implementing K-fold cross-validation [13] improves the accuracy of the model estimation and prevents overfitting. In a distributed system like Hadoop, the concluding model demonstrates enhanced overall performance and faster computation.…”

Dynamic Inversion Analysis of Structural Layer Modulus of Semirigid Base Pavement considering the Influence of Temperature and Humidity

“…e three methods are basically consistent with each other, which proves that the method in this paper has high accuracy and completely meets the practical engineering calculation requirements. is paper adopts standard SVM in which the loss function is an insensitive loss function and the kernel function is a radial basis kernel function (RBF) [28].…”

“…e final moisture content of any point in the seasonal frozen area is calculated as follows: suppose that the phase change interface reaches here at time t 0 , and its water content is w(t 0 ,x,y); when the phase change interface develops downward at time t 1 , the final water content of this point is w(x, y) � w t 0 , x, y + t 1 − t 0 G 2.72 . (28) e correlation between subgrade modulus and humidity can be obtained by embedding the model into the inversion program.…”