Fuzzy based Multiple Dictionary Bag of Words for Image Classification

Sujatha, K.; Keerthana, P.; Priya, S; Kaavya, E.; Vinod, B.

doi:10.1016/j.proeng.2012.06.264

Cited by 10 publications

(1 citation statement)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although several efforts have been conducted in computer vision [20, 21] and medical imaging [22] to integrate semantics into image retrieval applications, most of the proposed approaches are dedicated to automatic annotation of the images with semantic terms, and they do not focus on the potential relations among the semantic terms during the retrieval step. Consequently, there is an opportunity to improve image retrieval applications by considering these semantic aspects.…”

Section: Introductionmentioning

confidence: 99%

A hierarchical knowledge-based approach for retrieving similar medical images described with semantic annotations

Kurtz

Beaulieu

Napel

et al. 2014

Journal of Biomedical Informatics

View full text Add to dashboard Cite

Computer-assisted image retrieval applications could assist radiologist interpretations by identifying similar images in large archives as a means to providing decision support. However, the semantic gap between low-level image features and their high level semantics may impair the system performances. Indeed, it can be challenging to comprehensively characterize the images using low-level imaging features to fully capture the visual appearance of diseases on images, and recently the use of semantic terms has been advocated to provide semantic descriptions of the visual contents of images. However, most of the existing image retrieval strategies do not consider the intrinsic properties of these terms during the comparison of the images beyond treating them as simple binary (presence/absence) features. We propose a new framework that includes semantic features in images and that enables retrieval of similar images in large databases based on their semantic relations. It is based on two main steps: (1) annotation of the images with semantic terms extracted from an ontology, and (2) evaluation of the similarity of image pairs by computing the similarity between the terms using the Hierarchical Semantic-Based Distance (HSBD) coupled to an ontological measure. The combination of these two steps provides a means of capturing the semantic correlations among the terms used to characterize the images that can be considered as a potential solution to deal with the semantic gap problem. We validate this approach in the context of the retrieval and the classification of 2D regions of interest (ROIs) extracted from computed tomographic (CT) images of the liver. Under this framework, retrieval accuracy of more than 0.96 was obtained on a 30-images dataset using the Normalized Discounted Cumulative Gain (NDCG) index that is a standard technique used to measure the effectiveness of information retrieval algorithms when a separate reference standard is available. Classification results of more than 95% were obtained on a 77-images dataset. For comparison purpose, the use of the Earth Mover's Distance (EMD), which is an alternative distance metric that considers all the existing relations among the terms, led to results retrieval accuracy of 0.95 and classification results of 93% with a higher computational cost. The results provided by the presented framework are competitive with the state-of-the-art and emphasize the usefulness of the proposed methodology for radiology image retrieval and classification.

show abstract

Section: Introductionmentioning

confidence: 99%