Multi-label learning by Image-to-Class distance for scene classification and image annotation

Abstract

In multi-label learning, an image containing multiple objects can be assigned to multiple labels, which makes it more challenging than traditional multi-class classification task where an image is assigned to only one label. In this paper, we propose a multi-label learning framework based on Imageto-Class (I2C) distance, which is recently shown useful for image classification. We adjust this I2C distance to cater for the multi-label problem by learning a weight attached to each local feature patch and formulating it into a large margin optimization problem. For each image, we constrain its weighted I2C distance to the relevant class to be much less than its distance to other irrelevant class, by the use of a margin in the optimization problem. Label ranks are generated under this learned I2C distance framework for a query image. Thereafter, we employ the label correlation information to split the label rank for predicting the label(s) of this query image. The proposed method is evaluated in the applications of scene classification and automatic image annotation using both the natural scene dataset and Microsoft Research Cambridge (MSRC) dataset. Experiment results show better performance of our method compared to previous multi-label learning algorithms. Categories and Subject Descriptors General TermsAlgorithm, Experimentation, Performance KeywordsMulti-label learning, Image-to-Class distance, Scene classification, Automatic image annotation Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. CIVR '10, July 5-7, Xi'an China Copyright c 2010 ACM 978-1-4503-0117-6/10/07 ...$10.00.

Sparsity-Induced Similarity Measure and Its Applications

“…In the past several years, there has been a lot of interests in the Nearest Neighbor based Image Classifiers (NNIC) [11], [117], [102], [98], [103], [104], [46], [122], [4], [105], [123], [71], [50], [18], [27]. Compared to learning based classifiers, the NNIC approach has the following advantages.…”