Query Expansion for Sentence Retrieval Using Pseudo Relevance Feedback and Word Embedding

Arora, Piyush; Foster, Jennifer; Jones, Gareth J. F.

doi:10.1007/978-3-319-65813-1_8

Cited by 6 publications

(1 citation statement)

References 11 publications

(20 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…where x i and y i are vector values of two words, and n is size of the vectors. Similar to the works of Diaz et al [24] and Arora et al [47], we found that the top 10 returned words were more similar to each query term. Therefore, for each query term (or word), 10 expanded terms are selected for retrieval.…”

Section: Cos(x Y)supporting

confidence: 90%

Learned Text Representation for Amharic Information Retrieval and Natural Language Processing

2023

View full text Add to dashboard Cite

Over the past few years, word embeddings and bidirectional encoder representations from transformers (BERT) models have brought better solutions to learning text representations for natural language processing (NLP) and other tasks. Many NLP applications rely on pre-trained text representations, leading to the development of a number of neural network language models for various languages. However, this is not the case for Amharic, which is known to be a morphologically complex and under-resourced language. Usable pre-trained models for automatic Amharic text processing are not available. This paper presents an investigation on the essence of learned text representation for information retrieval and NLP tasks using word embeddings and BERT language models. We explored the most commonly used methods for word embeddings, including word2vec, GloVe, and fastText, as well as the BERT model. We investigated the performance of query expansion using word embeddings. We also analyzed the use of a pre-trained Amharic BERT model for masked language modeling, next sentence prediction, and text classification tasks. Amharic ad hoc information retrieval test collections that contain word-based, stem-based, and root-based text representations were used for evaluation. We conducted a detailed empirical analysis on the usability of word embeddings and BERT models on word-based, stem-based, and root-based corpora. Experimental results show that word-based query expansion and language modeling perform better than stem-based and root-based text representations, and fastText outperforms other word embeddings on word-based corpus.

show abstract

Section: Cos(x Y)supporting

confidence: 90%