Collaborative tagging applications have become a popular tool allowing Internet users to manage online resources with tags. Most collaborative tagging applications permit unsupervised tagging resulting in tag ambiguity in which a single tag has many different meanings and tag redundancy in which several tags have the same meaning. Common metrics for evaluating tag recommenders may overestimate the utility of ambiguous tags or ignore the appropriateness of redundant tags. Ambiguity and redundancy may even burden the user with additional effort by requiring them to clarify an annotation or forcing them to distinguish between highly related items. In this paper we demonstrate that ambiguity and redundancy impede the evaluation and performance of tag recommenders. Five tag recommendation strategies based on popularity, collaborative filtering and link analysis are explored. We use a cluster-based approach to define ambiguity and redundancy and provide extensive evaluation on three real world datasets.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.