Search results presentation and interface design: A comparative evaluation study of five web search engines in Arabic language

Tawileh, Wissam; Mandl, Thomas; Griesbaum, Joachim

doi:10.1109/isda.2010.5687201

Cited by 2 publications

(2 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this category of studies, researchers have evaluated the performance of one or several information retrieval system(s) using criteria such as precision. Below are some of these criteria and the research done with them: (a) Expected Search Length Criteria: Chignell et al, 1999; Cooper, 1968; Dunlop, 1997; Silverstein et al, 1998; (b) Precision criteria: Garoufallou, 2012; Griesbaum, 2004; Khan et al, 2014; Ljosland, 1999; Meghabghab and Meghabghab, 1996; Tawileh et al, 2010; (c) Relative recall: Clarke and Willett (1997), (d) Stability criteria: Bar-Ilan, 1998, 2002; (e) Coverage criteria: Henzinger et al (2000, (f) Relative Size & Search Engine Overlap Criteria: Bharat and Broder (1998, g) Click Criterion, Query Log Analysis: Joachims (2002), Joachims et al (2017), Radlinski et al (2008), Dupret and Liao (2010), and Bitirim and Görür (2017).…”

Section: Related Researchmentioning

confidence: 99%

Proposing a New Combined Indicator for Measuring Search Engine Performance and Evaluating Google, Yahoo, DuckDuckGo, and Bing Search Engines based on Combined Indicator

Hoseinabadi

CheshmehSohrabi

2022

Journal of Librarianship and Information Science

View full text Add to dashboard Cite

This study has developed a combined indicator to evaluate the performance of different search engines. Documentary analysis, survey, and evaluative methods are employed in the present study. The research was conducted in two stages. First, a combined indicator was designed to measure search engines. To this end, 72 criteria for measuring the performance of search engines were identified, out of which 22 criteria were selected. Accordingly, 10 criteria were selected in six general classes through a survey of subject matter experts. Validation of our proposed combined indicator was obtained by Delphi method and using the opinions of experts in the fields of information science and information system. Second, web search engines were evaluated based on the proposed combined indicator. The statistical population of this part of the research consisted of two categories: (1) general web search engines, and (2) general subjects. The sample size of the first category contained four search engines Yahoo, Google, DuckDuckGo, and Bing, and the second category involved 40 search terms under 10 general categories. The results showed that the combined indicator had six general criteria: (1) relevance, (2) ranking, (3) novelty ratio, (4) coverage ratio, (5) ratio of unrelated documents, and (6) proportion of duplication hits. According to this indicator, Google is at the top, followed by Bing. This study proposes a new indicator for evaluating search engine performance, which can measure the efficiency of search engines. Therefore, its use to measure the performance of search engines is recommended to researchers and search engine developers.

show abstract

Section: Related Researchmentioning

confidence: 99%

Proposing a New Combined Indicator for Measuring Search Engine Performance and Evaluating Google, Yahoo, DuckDuckGo, and Bing Search Engines based on Combined Indicator

Hoseinabadi

CheshmehSohrabi

2022

Journal of Librarianship and Information Science

View full text Add to dashboard Cite

show abstract

“…These problems have been evident for years, and some software solutions have been developed. However, these are tools primarily designed for one-time use in studies (e.g., Bar-Ilan & Levene, 2011;Tawileh et al, 2010;Trielli & Diakopoulos, 2020), prototypes that have not been further developed (Lingnau et al, 2010;Renaud & Azzopardi, 2012), and software for test collections (Dussin & Ferro, 2008;Koopman, 2014;Ogilvie & Callan, 2001) or for narrowly limited use cases (The Digital Methods Initiative, 2022;Thelwall, 2009). To integrate all steps of the testing process into a complete and sustainable solution, we develop the Result Assessment Tool (RAT).…”

Section: Introductionmentioning

confidence: 99%

Result Assessment Tool: A Software Toolkit for Conducting Studies Based on Search Results

Sünkler,

Yagci,

Sygulla

et al. 2023

Proceedings of the Association for Information Science and Tech

View full text Add to dashboard Cite

The Result Assessment Tool (RAT) is a software toolkit for conducting research using results from commercial search engines and other information retrieval (IR) systems. This software combines modules used for the design and management of studies, the automatic collection of search results through web scraping, and the assessment of search results by jurors using different scales in an assessment interface. Due to the flexibility of RAT, several types of studies can be implemented, for example, classification studies and qualitative content analyses in addition to classic retrieval tests. Therefore, RAT is a versatile tool and useful in various disciplines.

show abstract

Search results presentation and interface design: A comparative evaluation study of five web search engines in Arabic language

Cited by 2 publications

References 13 publications

Proposing a New Combined Indicator for Measuring Search Engine Performance and Evaluating Google, Yahoo, DuckDuckGo, and Bing Search Engines based on Combined Indicator

Proposing a New Combined Indicator for Measuring Search Engine Performance and Evaluating Google, Yahoo, DuckDuckGo, and Bing Search Engines based on Combined Indicator

Result Assessment Tool: A Software Toolkit for Conducting Studies Based on Search Results

Contact Info

Product

Resources

About