Improving the effectiveness of information retrieval with local context analysis

Abstract

Techniques for automatic query expansion have been extensively studied in information research as a means of addressing the word mismatch between queries and documents. These techniques can be categorized as either global or local. While global techniques rely on analysis of a whole collection to discover word relationships, local techniques emphasize analysis of the top-ranked documents retrieved for a query. While local techniques have shown to be more effective that global techniques in general, existing local techniques are not robust and can seriously hurt retrieved when few of the retrieval documents are relevant. We propose a new technique, called local context analysis, which selects expansion terms based on cooccurrence with the query terms within the top-ranked documents. Experiments on a number of collections, both English and non-English, show that local context analysis offers more effective and consistent retrieval results.

Improving retrieval feedback with multiple term-ranking function combination

“…Recent variants of this general scheme for locating expansion terms make use of different knowledge sources such as past similar queries (Fitzpatrick and Dent 1997) and enriched collection (Singhal et al 1999), or they try to improve the quality of the initial run by reranking the retrieved documents ), or they use more sophisticated index units such as passages (Xu and Croft 1996, Hawking et al 1998, Xu and Croft 2000 or document summaries (Lam-Adesina and Jones 2001).…”

Story Link Detection in Turkish Corpus

“…Large numbers of overlapping words between the two stories represent higher probability that the two stories discuss the same topic. This approach formed the basis of all the methods from vector space models [24][25] [27] up to statistical language models [16][28] [29]. Information retrieval researchers focus on how to select terms representing documents and weight them effectively.…”

Question answering in conversations: Query refinement using contextual and semantic information

“…Query expansion methods hypothesize one or more words or terms to add to a query by recognizing its possible interpretations. These methods use knowledge coming either directly from the document corpus over which retrieval is performed [9,10,11,12,13] or from Web data 75 or personal profiles in the case of Web search [14,15,16,17]. Moreover, query expansion techniques may select suggestions for query refinement either interactively or automatically [8].…”