Research on Multiple Classification Based on Improved SVM Algorithm for Balanced Binary Decision Tree

Abstract

Support vector machines (SVMs) are designed to solve the binary classification problems at the beginning, but in the real world, there are a lot of multiclassification cases. The multiclassification methods based on SVM are mainly divided into the direct methods and the indirect methods, in which the indirect methods, which consist of multiple binary classifiers integrated in accordance with certain rules to form the multiclassification model, are the most commonly used multiclassification methods at present. In this paper, an improved multiclassification algorithm based on the balanced binary decision tree is proposed, which is called the IBDT-SVM algorithm. In this algorithm, it considers not only the influence of “between-classes distance” and “class variance” in traditional measures of between-classes separability but also takes “between-classes variance” into consideration and proposes a new improved “between-classes separability measure.” Based on the new “between-classes separability measure,” it finds out the two classes with the largest between-classes separability measure and uses them as the positive and negative samples to train and learn the classifier. After that, according to the principle of the class-grouping-by-majority, the remaining classes are close to these two classes and merged into the positive samples and the negative samples to train SVM classifier again. For the samples with uneven distribution or sparse distribution, this method can avoid the error caused by the shortest canter distance classification method and overcome the “error accumulation” problem existing in traditional binary decision tree to the greatest extent so as to obtain a better classifier. According to the above algorithm, each layer node of the decision tree is traversed until the output classification result is a single-class label. The experimental results show that the IBDT-SVM algorithm proposed in this paper can achieve better classification accuracy and effectiveness for multiple classification problems.

Fast plug-in capacitors polarity detection with morphology and SVM fusion method in automatic optical inspection system

“…In AOI system, we use SVM as one of the classifiers. The SVM [23,24] is a binary linear classifier. The principle of SVM is to use the kernel function to map data to a high-dimensional feature space, solve the hyperplane appropriately partitioning the two categories of data in the high-dimensional space, and maximize the separation interval between the two types of data.…”

Financial Crisis Prediction Based on Long-Term and Short-Term Memory Neural Network

“…Although the prediction performance of the 13-th enterprise was the worst, from the perspective of RMSE, the enterprise financial crisis prediction stability of wolf pack optimization LSTM neural network was high. In order to further verify the performance of wolf pack optimization LSTM neural network in the financial crisis prediction of large-scale enterprises, SVM [27], convolutional neural network (CNN) [28], and LSTM neural network [29] were used to predict the financial crisis with 417 alarm data from 300 enterprises, and the results are shown in Figure 7.…”

The Effect of Hyper Parameters on the Classification of Lung Cancer Images Using Deep Learning Methods

“…Thanks to SVM, the separating surface is at the same distance and maximum distance to both classes. In the realization of this operation, the Lagrangian method has been used (Xie et al, 2021). In this paper, the results were obtained by using the linear functions of the SVM algorithm (Agner et al, 2011).…”