Weakly Supervised Dictionary Learning

Abstract

We present a probabilistic modeling and inference framework for discriminative analysis dictionary learning under a weak supervision setting. Dictionary learning approaches have been widely used for tasks such as low-level signal denoising and restoration as well as high-level classification tasks, which can be applied to audio and image analysis. Synthesis dictionary learning aims at jointly learning a dictionary and corresponding sparse coefficients to provide accurate data representation. This approach is useful for denoising and signal restoration, but may lead to sub-optimal classification performance. By contrast, analysis dictionary learning provides a transform that maps data to a sparse discriminative representation suitable for classification. We consider the problem of analysis dictionary learning for timeseries data under a weak supervision setting in which signals are assigned with a global label instead of an instantaneous label signal. We propose a discriminative probabilistic model that incorporates both label information and sparsity constraints on the underlying latent instantaneous label signal using cardinality control. We present the expectation maximization (EM) procedure for maximum likelihood estimation (MLE) of the proposed model. To facilitate a computationally efficient E-step, we propose both a chain and a novel tree graph reformulation of the graphical model. The performance of the proposed model is demonstrated on both synthetic and real-world data.

A Novel Attribute-Based Symmetric Multiple Instance Learning for Histopathological Image Analysis

“…However, a simple reduction of the model for MIML would fail in the cancer classification problem as the bag labels in MIL are binary but not a subset of the class labels. Recently, You et al [41] introduced cardinality constraints to the MIML setting and demonstrated that optimizing the control over the maximum number of instances per bag can significantly improve the performance of the model. Motivated by the result, we propose using cardinality constraints to limit the number of relevant attributes in each bag.…”

“…Given that there are hundreds of instances per bag, cardinality constraints can help control the model complexity. While the probabilistic machinery for implementing cardinality constraints is similar to the approach in You et al [41], the graphical model and inference methods differ. The modeling difference: instance-level labels include unknown attribute/ cluster labels (see Fig.…”

Weakly Supervised Learning for Evaluating Road Surface Condition from Wheelchair Driving Data

“…The following research applied weakly supervised learning or unsupervised learning to time-series data. You et al analyzed weakly supervised dictionary learning that only relies on weak supervision that describes presence or absence in a set of data points [37]. Zhang et al proposed a weakly supervised method to detect involuntary body vibrations due to illness from voluntary exercise [38].…”

Sparse representation of visual data for compression and compressed sensing

“…There exists a family of "task-driven" dictionary learning methods that tune the dictionary for a specific task, e.g. classification and clustering [176,177,178,179,180,181,182], image denoising [183,184,185,186], medical imaging [187,188,189], plenoptic imaging [190], or even reducing the block artifacts of JPEG images [191].…”