A Multitask Learning Model for Online Pattern Recognition

Abstract

This paper presents a new learning algorithm for multitask pattern recognition (MTPR) problems. We consider learning multiple multiclass classification tasks online where no information is ever provided about the task category of a training example. The algorithm thus needs an automated task recognition capability to properly learn the different classification tasks. The learning mode is "online" where training examples for different tasks are mixed in a random fashion and given sequentially one after another. We assume that the classification tasks are related to each other and that both the tasks and their training examples appear in random during "online training." Thus, the learning algorithm has to continually switch from learning one task to another whenever the training examples change to a different task. This also implies that the learning algorithm has to detect task changes automatically and utilize knowledge of previous tasks for learning new tasks fast. The performance of the algorithm is evaluated for ten MTPR problems using five University of California at Irvine (UCI) data sets. The experiments verify that the proposed algorithm can indeed acquire and accumulate task knowledge and that the transfer of knowledge from tasks already learned enhances the speed of knowledge acquisition on new tasks and the final classification accuracy. In addition, the task categorization accuracy is greatly improved for all MTPR problems by introducing the reorganization process even if the presentation order of class training examples is fairly biased.

Visual classification with multi-task joint sparse representation

“…This new learning scheme has inspired the study of multi-task learning (MTL). A large body of works have provided evidence on the benefit of such a framework in theory [10]- [12] and in practice [13]- [15].…”

Learning Pattern Recognition Through Quasi-Synchronization of Phase Oscillators

“…As a result, diverse computational models based on networks of oscillators have been proposed. Ozawa and collaborators produced a pattern recognition model capable of learning multiple multiclass classifications online [24]. Meir and Baldi [25] were among the first to apply oscillator networks to texture discrimination.…”

Autoregressive Integrated Adaptive Neural Networks Classifier for EEG-P300 Classification

“…This has led to the development of new computational models for solving complex problems such as pattern recognition, rapid information processing, learning and adaptation, classification, identification and modelling, speech, vision and control systems [8][9][10][11][12][13][14].…”