2015
DOI: 10.1002/asi.23304
|View full text |Cite
|
Sign up to set email alerts
|

Evaluating the retrieval effectiveness of web search engines using a representative query sample

Abstract: Search engine retrieval effectiveness studies are usually small-scale, using only limited query samples. Furthermore, queries are selected by the researchers. We address these issues by taking a random representative sample of 1,000 informational and 1,000 navigational queries from a major German search engine and comparing Google's and Bing's results based on this sample. Jurors were found through crowdsourcing, data was collected using specialised software, the Relevance Assessment Tool (RAT). We found that … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
3
1
1

Citation Types

2
58
0
1

Year Published

2017
2017
2023
2023

Publication Types

Select...
7
1

Relationship

1
7

Authors

Journals

citations
Cited by 86 publications
(62 citation statements)
references
References 47 publications
2
58
0
1
Order By: Relevance
“…Eighty percent (80%) of the income generated by clicks on these ads is donated to programs for reforestation [19]. The remaining 20% is used to pay for necessary costs such as salaries, servers, domains, or marketing.…”
Section: The Search Engine Ecosystemmentioning
confidence: 99%
See 2 more Smart Citations
“…Eighty percent (80%) of the income generated by clicks on these ads is donated to programs for reforestation [19]. The remaining 20% is used to pay for necessary costs such as salaries, servers, domains, or marketing.…”
Section: The Search Engine Ecosystemmentioning
confidence: 99%
“…The projects that Ecosia finances are for planting trees, mainly in the African and Brazilian continents, and therefore we can say that Ecosia is an example of a social business model in the search engine market [19].…”
Section: The Search Engine Ecosystemmentioning
confidence: 99%
See 1 more Smart Citation
“…After studying the impacts of these factors, they proposed enhanced from of vector space model to improve efficiency. In [33], Lewandowski et al take randomly selected 1000 informational and 1000 navigational queries for a major German SE and compare their performance with Google and Bing. According to their results, Google is able to establish the precise responses in 95.3% of cases, while Bing only yields the right response 76.6% of the time for navigational queries.…”
Section: Related Workmentioning
confidence: 99%
“…Despite the fact that essential results have already been achieved to build search engines, there is still an obvious need for new approaches to large-scale search. Among others, Marz et al [5], Cambazoglu and Baeza-Yates [6] focus on the scalability problem related to the high computational costs of storing and processing large volumes of distributed data, Lewandowski [7] deals with providing fast access to large amounts of information and effectiveness providing relevant search results and optimizing the search process for a user.…”
Section: Introductionmentioning
confidence: 99%