Parallelized Tensor Train Learning of Polynomial Classifiers

Abstract

In pattern classification, polynomial classifiers are well-studied methods as they are capable of generating complex decision surfaces. Unfortunately, the use of multivariate polynomials is limited to kernels as in support-vector machines, because polynomials quickly become impractical for high-dimensional problems. In this paper, we effectively overcome the curse of dimensionality by employing the tensor train (TT) format to represent a polynomial classifier. Based on the structure of TTs, two learning algorithms are proposed, which involve solving different optimization problems of low computational complexity. Furthermore, we show how both regularization to prevent overfitting and parallelization, which enables the use of large training sets, are incorporated into these methods. The efficiency and efficacy of our tensor-based polynomial classifier are then demonstrated on the two popular data sets U.S. Postal Service and Modified NIST.

A Method for Extracting High‐Quality Core Data from Edge Computing Nodes

“…Gorodetsky [11] proposed a method based on tensor chain decomposition to solve the optimal solution of the control synthesis problem efficiently. Chen [12] constructed the classifier model based on the tensor chain model. Phien [13] combines data recovery algorithm with tensor chain data, and the application of tense-based algorithm reflects the efficiency advantage of tensor chain decomposition in processing high-order tensors.…”

Tensor networks for MIMO LPV system identification

“…This orthogonalisation is also performed on the initialisation of the cores. We refer to Oseledets (2011), Batselier et al (2017) and Chen, Batselier, Suykens, and Wong (2016) for this common step. For this orthogonalisation step, some assumptions are made on the sizes of the cores.…”

Deep Model Compression and Inference Speedup of Sum-Product Networks on Tensor Trains

“…On the other hand, there has been an exploding number of works on tensors (a multilinear operator rooted in physics) [6] including their connection and utilization in various engineering fields such as signal processing [7], and lately also in neural networks and machine learning [8], [9], [10]. The power of tensors lies in their ability to lift the curse of dimensionality, reducing computational and storage complexity from exponential to linear cost.…”