Evaluating user interfaces to information retrieval systems

Brajnik, Giorgio; Mizzaro, Stefano; Tasso, Carlo

doi:10.1145/243199.243249

Cited by 68 publications

(49 citation statements)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, the analysis of the first query expansion showed that search success was related both to how exhaustively search facets were covered by query terms and to the relevance feedback. This result is consistent with the findings of Brajnik & al (1996) and Fowkes & Beaulieu (2000) which suggest that query expansion is successful if searchers are able to articulate the facets of topics in query terms.…”

Section: Discussionsupporting

confidence: 91%

See 1 more Smart Citation

Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion

Vakkari

Jones

MacFarlane

et al. 2004

Journal of Documentation

View full text Add to dashboard Cite

This is the accepted version of the paper.This version of the publication may differ from the final published version. Permanent repository link AbstractThis study explored how the expression of search facets and relevance feedback by users was related to search success in interactive and automatic query expansion in the course of the search process. Search success was measured both in the number of relevant documents retrieved and relevance scores of these items based on a four point scaling. Research design consisted of 26 users searching for four TREC topics in Okapi IR system, half using interactive and half automatic query expansion based on RF. The search logs were recorded, and the users filled in a questionnaire for each topic concerning various features of searching. The results showed that the exhaustivity of the query was the most significant predictor of search success, and that interactive expansion led to better search success than automatic one.2

show abstract

Section: Discussionsupporting

confidence: 91%

“…There is scattered evidence either on how RF (Hancock- or term selection is related to search success (Beaulieu & al. 1996;Brajnik & al. 1996;Fowkes & Beaulieu 2000;Koeneman & Belkin 1996) in IQE, but no studies on the combined contribution of these two factors on search success.…”

Section: Introductionmentioning

confidence: 99%

Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion

Vakkari

Jones

MacFarlane

et al. 2004

Journal of Documentation

View full text Add to dashboard Cite

show abstract

“…A popular solution for multiple-query searches is to use manually [Brajnik et al 1996] or automatically built [Grefenstette 1994;Cooper and Byrd 1997;Carpineto and Romano 1998] thesauri for guiding the user to reformulate queries in an interactive process. A thesaurus can also be used for automatic query expansion on single-query searches, but doubts have been expressed about the benefits for the retrieval effectiveness in this case [Voorhees 1994].…”

Section: Introductionmentioning

confidence: 99%

An information-theoretic approach to automatic query expansion

Carpineto

Mori

Romano

et al. 2001

ACM Trans. Inf. Syst.

286

218

View full text Add to dashboard Cite

Techniques for automatic query expansion from top retrieved documents have shown promise for improving retrieval effectiveness on large collections; however, they often rely on an empirical ground, and there is a shortage of cross-system comparisons. Using ideas from Information Theory, we present a computationally simple and theoretically justified method for assigning scores to candidate expansion terms. Such scores are used to select and weight expansion terms within Rocchio's framework for query reweighting. We compare ranking with information-theoretic query expansion versus ranking with other query expansion techniques, showing that the former achieves better retrieval effectiveness on several performance measures. We also discuss the effect on retrieval effectiveness of the main parameters involved in automatic query expansion, such as data sparseness, query difficulty, number of selected documents, and number of selected terms, pointing out interesting relationships.

show abstract

“…In particular, it seems useful to try to extend conventional measures of batch retrieval to the interactive context by taking also into account the dynamics of retrieval sessions [6], [5] and the user's opinions [4]. We focus on precision (i.e., the ratio of number of items retrieved and relevant to the number of items retrieved), because this is usually the primary concern for users engaged in on-line interactive searches.…”

Section: Performance Measuresmentioning

confidence: 99%

Effectiveness of Keyword-Based Display and Selection of Retrieval Results for Interactive Searches

Berenci

Carpineto

Giannini

et al. 1999

Research and Advanced Technology for Digital Libraries

Self Cite

View full text Add to dashboard Cite

Abstract. We present an approach to increasing the effectiveness of rankedoutput retrieval systems that relies on graphical display and user manipulation of "views" of retrieval results, where a view is the subset of retrieved documents that contain a specified subset of query terms. This approach has been implemented in a system named VIEWER (VIEwing WEb Results), acting as an interface to available search engines. An experimental evaluation of the performance of VIEWER in contrast to AltaVista is the major focus of the paper. We first report the results of an experiment on single, short query searches where VIEWER, used as an interactive ranking system, markedly outperformed AltaVista. We then concentrate on a more realistic searching scenario, involving free query formulation, unconstrained selection of retrieval results, and possibility of query reformulation. We report the results of an experiment where the use of VIEWER, compared to AltaVista, seemed to shift the user effort from inspection to evaluation of results, increasing retrieval effectiveness and user satisfaction. In particular, we found that the VIEWER users retrieved half as many nonrelevant documents as the AltaVista users while retrieving a comparable number of relevant documents.

show abstract

Evaluating user interfaces to information retrieval systems

Cited by 68 publications

References 20 publications

Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion

Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion

An information-theoretic approach to automatic query expansion

Effectiveness of Keyword-Based Display and Selection of Retrieval Results for Interactive Searches

Contact Info

Product

Resources

About