1994
DOI: 10.1002/(sici)1097-4571(199404)45:3<207::aid-asi10>3.0.co;2-1
|View full text |Cite
|
Sign up to set email alerts
|

The relevance of recall and precision in user evaluation

Abstract: The appropriateness of evaluation criteria and measures have been a subject of debate and a vital concern in the information retrieval evaluation literature. A study was conducted to investigate the appropriateness of 20 measures for evaluating interactive information retrieval performance, representing four major evaluation criteria. Among the 20 measures studied were the two most well-known relevancebased measures of effectiveness, recall and precision. The user's judgment of information retrieval success wa… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

2
62
0

Year Published

1997
1997
2018
2018

Publication Types

Select...
7
1

Relationship

0
8

Authors

Journals

citations
Cited by 97 publications
(64 citation statements)
references
References 3 publications
2
62
0
Order By: Relevance
“…Su, Al-Maskari [88,126] and others have discussed the relationships between user satisfaction and IR measures; Su found that search efficiency, in terms of user time spent on the search, was the most highly ranked measure of search success. Chapelle et al [24] and others have applied DCG and RBP to evaluate systems' results for text retrieval.…”
Section: Related Worksupporting
confidence: 92%
See 2 more Smart Citations
“…Su, Al-Maskari [88,126] and others have discussed the relationships between user satisfaction and IR measures; Su found that search efficiency, in terms of user time spent on the search, was the most highly ranked measure of search success. Chapelle et al [24] and others have applied DCG and RBP to evaluate systems' results for text retrieval.…”
Section: Related Worksupporting
confidence: 92%
“…Even for this search, however, the "quicker" and "query expression" scores were high, signifying that even when no relevant data is found, the fact that this situation can be ascertained quickly is likely to be of value. This experience is consistent with Su's findings [126].…”
Section: Ratings Resultsmentioning
confidence: 99%
See 1 more Smart Citation
“…They indicate "partially relevant" as any document considered only somewhat, or in some part, related to the question or to any part of the question. Pao (1993) and Su (1994) also used a relevant, partially relevant, and not relevant methodology. In most cases, however, even though users and/or judges were able to conceptualize a meaningful difference between relevant and partially relevant documents, the experimental results were combined, collapsed, or grouped into a single category of "relevant" for the purpose of analysis.…”
Section: Degrees Of Relevancementioning
confidence: 99%
“…The effectiveness of information retrieval system can be measured as relevance includes both recall and precision factors [14]. Later, if relevant information is made available on a bigger scale through social media, the user will retrieve valuable information more easily.…”
Section: Relevancementioning
confidence: 99%