PARADE: Passage Representation Aggregation forDocument Reranking

Abstract

Pre-trained transformer models, such as BERT and T5, have shown to be highly effective at ad-hoc passage and document ranking. Due to the inherent sequence length limits of these models, they need to process document passages one at a time rather than processing the entire document sequence at once. Although several approaches for aggregating passage-level signals into a document-level relevance score have been proposed, there has yet to be an extensive comparison of these techniques. In this work, we explore strategies for aggregating relevance signals from a document’s passages into a final ranking score. We find that passage representation aggregation techniques can significantly improve over score aggregation techniques proposed in prior work, such as taking the maximum passage score. We call this new approach PARADE. In particular, PARADE can significantly improve results on collections with broad information needs where relevance signals can be spread throughout the document (such as TREC Robust04 and GOV2). Meanwhile, less complex aggregation techniques may work better on collections with an information need that can often be pinpointed to a single passage (such as TREC DL and TREC Genomics). We also conduct efficiency analyses and highlight several strategies for improving transformer-based aggregation.

Online health search via multi-dimensional information quality assessment based on deep language models

“…In this sense, it defines how pertinent a document is to a given topic. Thus, to compute the usefulness of retrieved documents, topic-document similarity models based on pre-trained language models, such as BERT-base [39], mono-BERT-large [40], and ELECTRA [41], could be used. Given a topicdocument pair, the language model infers a score that gives the level of similarity between the two input text passages.…”

A Purely Entity-Based Semantic Search Approach for Document Retrieval

“…In this section, we present some state-of-the-art document retrieval models which are not based on knowledge bases. Li et al (2020) [26] proposed an approach named PARADE, which is a re-ranking model. They claimed that an improvement was achieved by the model on TREC Robust04 and GOV2 collections; the model achieves its most effective performance when it is adopted as a re-ranker, namely PARADE-Transformer.…”