Novelty and topicality in interactive information retrieval

Xu, Yunjie; Yin, Hainan

doi:10.1002/asi.20709

Cited by 37 publications

(43 citation statements)

References 31 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…There have been numerous attempts (Tombros, Ruthven, & Jose, 2005;Xu & Yin, 2008;Xu & Chen, 2006;Zhang, Zhang, Lease, & Gwizdka, 2014) to understand users' search behaviors when retrieving information with search engines, foe example, relevance judgment, satisfaction or dissatisfaction with search results. Understanding how users conduct relevance judgment and what factors influence users' satisfaction with the search results would help researchers design more effective retrieval models and better evaluation methodologies, aiming to further improve users' search experience.…”

Section: Introductionmentioning

confidence: 99%

“…A large number of studies (Barry, 1998;Tombros et al, 2005;Xu & Yin, 2008;Xu & Chen, 2006;Zhang et al, 2014) have revealed that there exist a range of complex factors (e.g., topicality, novelty, reliability, understandability, and scope) affecting users' perception of relevance for the retrieved documents. However, the existing work is mainly based on small scale user studies, which may not reflect users' natural search scenarios, and the relevance judgments involved were made in a static way that cannot capture the dynamics of a user's information need, search interest, and habit.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Understanding an enriched multidimensional user relevance model by analyzing query logs

Zhang

Song

et al. 2017

Asso for Info Science & Tech

View full text Add to dashboard Cite

Modeling multidimensional relevance in information retrieval (IR) has attracted much attention in recent years. However, most existing studies are conducted through relatively small-scale user studies, which may not reflect a real-world and natural search scenario. In this article, we propose to study the multidimensional user relevance model (MURM) on large scale query logs, which record users' various search behaviors (e.g., query reformulations, clicks and dwelling time, etc.) in natural search settings. We advance an existing MURM model (including five dimensions: topicality, novelty, reliability, understandability, and scope) by providing two additional dimensions, that is, interest and habit. The two new dimensions represent personalized relevance judgment on retrieved documents. Further, for each dimension in the enriched MURM model, a set of computable features are formulated. By conducting extensive document ranking experiments on Bing's query logs and TREC session Track data, we systematically investigated the impact of each dimension on retrieval performance and gained a series of insightful findings which may bring benefits for the design of future IR systems. IntroductionThere have been numerous attempts (Tombros, Ruthven, & Jose, 2005;Xu & Yin, 2008;Xu & Chen, 2006;Zhang, Zhang, Lease, & Gwizdka, 2014) to understand users' search behaviors when retrieving information with search engines, foe example, relevance judgment, satisfaction or dissatisfaction with search results. Understanding how users conduct relevance judgment and what factors influence users' satisfaction with the search results would help researchers design more effective retrieval models and better evaluation methodologies, aiming to further improve users' search experience.Judging the relevance (or utility) of a retrieved document with respect to a user issued query (representing the user's current information need) is a central task for search engines. A large number of studies (Barry, 1998;Tombros et al., 2005;Xu & Yin, 2008;Xu & Chen, 2006;Zhang et al., 2014) have revealed that there exist a range of complex factors (e.g., topicality, novelty, reliability, understandability, and scope) affecting users' perception of relevance for the retrieved documents. However, the existing work is mainly based on small scale user studies, which may not reflect users' natural search scenarios, and the relevance judgments involved were made in a static way that cannot capture the dynamics of a user's information need, search interest, and habit.To address aforementioned limitations, in this article, we propose to study and understand the multidimensional relevance through analyzing real query logs that record real world user interactions (e.g., query reformulations, clicks, and dwelling time, etc.) with the search engine, as an important supplement to the numerous existing work based on user studies. Specifically, we analyze how different factors affect the users' perception of relevance on retrieved documents within the framework of the Multidi...

show abstract

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Understanding an enriched multidimensional user relevance model by analyzing query logs

Zhang

Song

et al. 2017

Asso for Info Science & Tech

View full text Add to dashboard Cite

show abstract

“…Es importante plantear los principales criterios documentales en función del tipo de proceso comunicativo (argumentativo, narrativo, explicativo, instruccional, informe o informativo, etc.). En general, los criterios más importantes que deben regir la búsqueda de la información en un ámbito temático son la novedad (novelty) (Kumaran y Maguire, 2009) y la relevancia (Xu y Yin, 2008). Otros criterios son la accesibilidad de la información, la magnitud o nivel de afectación física, social, geográfica, económica, cultural… de la información, la jerarquía de los elementos informativos y la proximidad (geográfica y simbólica) del hecho informativo.…”

Section: Competencias Documentales Profesionalesunclassified

Competencias documentales, textuales y enunciativas para un nuevo profesional de la comunicación

Manchón¹

2017

Pragmalinguistica

View full text Add to dashboard Cite

RESUMEN:Mientras el mercado laboral de la comunicación vive una crisis estructural, las competencias comunicativas son las más valoradas por las empresas, las instituciones y la sociedad. Los planes de estudios de los grados en comunicación necesitan adaptarse a esta realidad mediante la creación de nuevos modelos docentes basados en la articulación de conocimientos y destrezas de ámbitos comunicativos diferentes. En particular, este artículo presenta un modelo que combina las competencias documentales, textuales y orales como dimensiones de un proceso comunicativo integral. Para ello, se desarrollan los criterios informativos de recuperación, selección y configuración de la información en función de las claves lingüísticas y cognitivas de la redacción textual, y de la estructura acústica y expresiva del discurso oral. Los diferentes niveles de cada dimensión son solidarios y recursivos entre sí en el marco de un proceso de la estrategia comunicativa.ABSTRACT: While the communication labor market is struggling within a structural crisis, communication skills are most valued by companies, institutions and society. The curricula of the degrees in communication need to adapt to this reality by creating new teaching models based on the articulation of knowledge and skills from different communication fields. In particular, this article presents a model that combines the documentary, textual and oral skills as dimensions of an integrated communication process. To do this, this article presents the basic criteria to retrieve, select and structure information based on the linguistic and cognitive keys of writing, and the acoustic and expressive structure of oral speech. The different levels of these dimensions are recursively dependent with each other as part of a strategic and comprehensive communication process. RÉSUMÉ:Alors que le marché de travail de la communication vive une crise structurelle, les compétences communicatives sont les plus valorisées par les entreprises, les institutions et la société. Les cursus des études en communication ont besoin de s'adapter à cette réalité moyennant la création d'un nouveau modèle d'enseignement basé sur l'articulation des connaissances et des habilités de milieux communicationnels différents. En particulier, cet article présente un modèle qui combine les compétences sur la gestion de documents, des compétences textuelles et des compétences orales comme dimensions d'un procès communicatif intégral. Pour ce faire, les critères informatifs de récupération, sélection et configuration de l'information sont développés en fonction des clés linguistiques et cognitives de la rédac-tion textuelle, et de la structure acoustique et expressive du discours orale. Les différents niveaux de chaque dimension sont solidaires et récursifs les uns des autres dans les cadre d'une stratégie communicative.PALABRAS CLAVES: discurso informativo; estructura enunciativa; competencias docentes; texto; criterios informativos.

show abstract

“…However, they do not take the quality of diversification into consideration. Several metrics, including the k-call metric [20] and a-NDCG [21], have been proposed for evaluating the diversity of search results. However, these metrics do not consider the relative importance of different categories (DCs) and how well a result matches a category.…”

Section: Dataset and Performance Measuresmentioning

confidence: 99%

mNIR: Diversifying Search Results Based on a Mixture of Novelty, Intention and Relevance

Hemayati

Dehkordi

Meng

2012

Web Information Systems Engineering - WISE 2012

View full text Add to dashboard Cite

ABSTRACT. Current search engines do not explicitly take different meanings and usages of user queries into consideration when they rank the search results. As a result, they tend to retrieve results that cover the most popular meanings or usages of the query. Consequently, users who want results that cover a rare meaning or usage of query or results that cover all different meanings/usages may have to go through a large number of results in order to find the desired ones. Another problem with current search engines is that they do not adequately take users' intention into consideration. In this paper, we introduce a novel result ranking algorithm (mNIR) that explicitly takes result novelty, user intention-based distribution and result relevancy into consideration and mixes them to achieve better result ranking. We analyze how giving different emphasis to the above three aspects would impact the overall ranking of the results. Our approach builds on our previous method for identifying and ranking possible categories of any user query based on the meanings and usages of the terms and phrases within the query. These categories are also used to generate category queries for retrieving results matching different meanings/usages of the original user query. Our experimental results show that the proposed algorithm can outperform state-of-the-art diversification approaches.

show abstract

Novelty and topicality in interactive information retrieval

Cited by 37 publications

References 31 publications

Understanding an enriched multidimensional user relevance model by analyzing query logs

Understanding an enriched multidimensional user relevance model by analyzing query logs

Competencias documentales, textuales y enunciativas para un nuevo profesional de la comunicación

mNIR: Diversifying Search Results Based on a Mixture of Novelty, Intention and Relevance

Contact Info

Product

Resources

About