With the ever increasing size of the web, relevant information extraction on the Internet with a query formed by a few keywords has become a big challenge. Query Expansion (QE) plays a crucial role in improving searches on the Internet. Here, the user's initial query is reformulated by adding additional meaningful terms with similar significance. QE -as part of information retrieval (IR) -has long attracted researchers' attention. It has become very influential in the field of personalized social document, question answering, cross-language IR, information filtering and multimedia IR. Research in QE has gained further prominence because of IR dedicated conferences such as TREC (Text Information Retrieval Conference) and CLEF (Conference and Labs of the Evaluation Forum). This paper surveys QE techniques in IR from 1960 to 2017 with respect to core techniques, data sources used, weighting and ranking methodologies, user participation and applications -bringing out similarities and differences.There is a huge amount of data available on the Internet, and it is growing exponentially. This unconstrained information-growth has not been accompanied by a corresponding technical advancement in the approaches for extracting relevant information [191]. Often, a web-search does not yield relevant results. There are multiple reasons for this. First, the keywords submitted by the user can be related to multiple topics; as a result, the search results are not focused on the topic of interest. Second, the query can be too short to capture appropriately what the user is looking for. This can happen just as a matter of habit (e.g., the average size of a web search is 2.4 words [257,255]). Third, the user is often not sure about what he is looking for until he sees the results. Even if the user knows what he is searching for, he does not know how to formulate an appropriate query (navigational queries are exceptions to this [51]). QE plays an important part in fetching relevant results in the above cases. Most web queries fall under the following three fundamental categories [51, 139] :-Informational Queries: Queries that cover a broad topic (e.g., India or journals) for which there may be thousands of relevant results. -Navigational Queries: Queries that are looking for specific website or URL (e.g., ISRO).-Transactional Queries: Queries that demonstrate the user's intent to execute a specific activity (e.g., downloading papers or buying books).2 Hiteshwar Kumar Azad, Akshay DeepakCurrently, user-queries are mostly processed using indexes and ontologies, which work on exact matches and are hidden from the users. This leads to the problem of term mismatch: user queries and search index are not based on the same set of terms. This is also known as the vocabulary problem [99]; it results from a combination of synonymy and polysemy. Synonymy refers to multiple words with common meaning, e.g., "buy" and "purchase". Polysemy refers to words with multiple meanings, e.g., "mouse" (a computer device or an animal). Synonymous and polysemou...
Query expansion (QE) is a well-known technique used to enhance the effectiveness of information retrieval. QE reformulates the initial query by adding similar terms that help in retrieving more relevant results. Several approaches have been proposed in literature producing quite favorable results, but they are not evenly favorable for all types of queries (individual and phrase queries). One of the main reasons for this is the use of the same kind of data sources and weighting scheme while expanding both the individual and the phrase query terms. As a result, the holistic relationship among the query terms is not well captured or scored. To address this issue, we have presented a new approach for QE using Wikipedia and WordNet as data sources. Specifically, Wikipedia gives rich expansion terms for phrase terms, while WordNet does the same for individual terms.We have also proposed novel weighting schemes for expansion terms: in-link score (for terms extracted from Wikipedia) and a tf-idf based scheme (for terms extracted from WordNet). In the proposed Wikipedia-WordNet-based QE technique (WWQE), we weigh the expansion terms twice: first, they are scored by the weighting scheme individually, and then, the weighting scheme scores the selected expansion terms concerning the entire query using correlation score. The proposed approach gains improvements of 24% on the MAP score and 48% on the GMAP score over unexpanded queries on the FIRE dataset. Experimental results achieve a significant improvement over individual expansion and other related state-of-the-art approaches. We also analyzed the effect on retrieval effectiveness of the proposed technique by varying the number of expansion terms. makes information processing a big challenge and creates a vocabulary gap between user queries and indexed documents. It is common for a user's query Q and its set of relevant documents D to use different vocabulary and language styles while referring to the same concept. For example, terms 'buy' and 'purchase' have the same meaning; however, only one of these can be present in the documents' index while the other one can be the user's query term. This makes it difficult to retrieve the information actually wanted by the user [21,28]. An effective strategy to fill this gap is to use the Query Expansion (QE) technique, which enhances the retrieval effectiveness by adding expansion terms to the initial query. Selection of the expansion terms plays a crucial role in QE because only a small subset of the expanded terms are actually relevant to the query [26].In this sense, the approach for selection of expansion terms is equally important in comparison to what we do further with the expanded terms in order to retrieve the desired information. QE has a long research history in information retrieval (IR) [31,39]. It has the potential to enhance IR's effectiveness by adding relevant terms that can help to discriminate the relevant documents from irrelevant ones. The source of expansion terms plays a significant role in QE. A variety of ...
No abstract
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.