Multi‐innovation Newton recursive methods for solving the support vector machine regression problems

Abstract

The support vector machine has been widely used in binary classification applications because of the simplicity of its implementation. This article proposes an online identification method based on the support vector machine in the field of parameter identification. By substituting the constraint item into the original criterion function to form a new criterion function about the weight vector and the bias item, and then on the basis of the recursive identification methods, the newly established criterion function is minimized by using the Newton search to derive the Newton recursive support vector machine algorithm. Additionally, in order to improve the performance of the Newton recursive support vector machine algorithm, the multi-innovation identification theory is applied to optimize the algorithm, and a multi-innovation Newton recursive support vector machine algorithm is derived. In addition, the convergence and the calculation amount of the proposed algorithms are carefully analyzed in this article.Finally, a numerical simulation example is given to compare the Newton recursive algorithm and the corresponding multi-innovation recursive algorithm. The results show that the algorithms and optimization strategy studied in this article are effective.