When information retrieval measures agree about the relative quality of document rankings

Losee, Robert M.

doi:10.1002/(sici)1097-4571(2000)51:9<834::aid-asi60>3.3.co;2-t

Cited by 10 publications

(2 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Precision and recall are the two statistical analysis measures used to evaluate retrieval performance and effectiveness of this framework. Precision is the ability of the framework to retrieve more relevant cases to a given query beside the specified threshold similarity boundary, whereas recall is the ability of the framework to retrieve all relevant cases to the current new problem [24,25,26]. Moreover, to incorporate the precision and recall evaluation the relevant malaria cases from the case base for each test cases should be known.…”

Section: A Evaluation Of Retrieval Cycle Performancementioning

confidence: 99%

Case-Based Reasoning Framework for Malaria Diagnosis

Addisu¹,

Boltena²,

Amare³

2020

IJITCS

View full text Add to dashboard Cite

Malaria is life threatening disease in Ethiopia specifically in Tigray region. Having common symptoms with other diseases makes it complex and challenging to diagnose effectively. In this paper case based reasoning framework for malaria diagnosis has been designed to diminish the challenges faced by inexperienced practitioners during malaria diagnosis and to solve the problem on shortage of health professionals. The required knowledge for this study was collected through interview and document analysis from domain experts, malaria patient history cards and other related relevant documents. In the case acquisition process the manual format of cases makes the process too challenging. Decision tree is used to model the acquired knowledge. The case structure was then constructed using the selected most determinant attributes. Machine learning approach is applied to select the most relevant features. Feature-vector case representation technique is applied to represent the collected malaria cases. Jcolibri programming tool integrated with Eclipse and Nearest Neighbor retrieval algorithm are used to design the framework. To the end based on the results we can say that the machine learning approach can be used to select most relevant attributes in diseases having several common symptoms and designing case-based diagnosis frameworks could overcome the main problems observed in health centers of Tigray. As an artifact the framework is evaluated by statistical analysis, comparative evaluation, user evaluation and other evaluation techniques. Averagely 79 % precision, 89 % recall, 91.4% accuracy and 78.8% domain expert’s evaluation was the results scored.

show abstract

Section: A Evaluation Of Retrieval Cycle Performancementioning

confidence: 99%

Case-Based Reasoning Framework for Malaria Diagnosis

Addisu¹,

Boltena²,

Amare³

2020

IJITCS

View full text Add to dashboard Cite

show abstract

“…Single number performance measures have the advantage that that they are easily compared, with the more desired or less desired value being obvious, whereas multiple different measures, such as precisionrecall, are difficult to compare. Although different performance measures address different concerns (Losee, 2000), often there is a large amount of agreement between the measures. However, if one uses a measure that is analytically tractable, such as EPRD, more sophisticated techniques can be developed, such as the decision rule that indexes based on improving the EPRD.…”

Section: Should a Document Be Indexed By A Term?mentioning

confidence: 99%

The effect of assigning a metadata or indexing term on document ordering

Losee

2013

J Am Soc Inf Sci Tec

Self Cite

View full text Add to dashboard Cite

The assignment of indexing terms and metadata to documents, data, and other information representations is considered useful, but the utility of including a single term is seldom discussed. The author discusses a simple model of document ordering and then shows how assigning index and metadata labels improves or decreases retrieval performance. The Indexing and Metadata Advantage (IMA) factor measures how indexing or assigning a metadata term helps (or hurts) ordering performance. Performance values and the associated IMA expressions are computed, consistent with several different assumptions. The economic value associated with various term assignment decisions is developed. The IMA term advantage model itself is empirically validated with computer software that shows that the analytic results obtained agree completely with the actual performance gains and losses found when ordering all sets of 14 or fewer documents. When the formulas in the software are changed to differ from this model, the predictions of the actual performance are erroneous.

show abstract

Is 1 noun worth 2 adjectives? Measuring relative feature utility

Losee

2006

Information Processing & Management

Self Cite

View full text Add to dashboard Cite

Are two adjectives worth the same as a single noun when documents are ordered based on decreasing topicality? We propose an easy to interpret single number Relative Feature Utility (RFU) measure of the relative worth of using specific linguistic or non-linguistic features or sets of features in computational systems that order or filter media, such as information retrieval and classification systems. This measure allows one to make easily interpreted claims about the relative utility of features such as parts-of-speech, term suffixes, phrases vs. single terms, annotations, hyperlinks, citations, index terms, and metadata when ordering natural language text or other media. Data is provided for the RFU for stemming characteristics, part-of-speech tags, and phrase lengths, as well as retrieval characteristics and procedures. Using this linear measure of the relative utility of features makes available a wide range of cost-benefit analyses and decision theoretic techniques, allowing the study of whether or not to use many different kinds of representational information or tagging systems, and for the design of indexing and metadata systems. Some characteristics of natural languages used in the spectrum from softer to harder sciences, as well as medical terminology, are studied.

show abstract

When information retrieval measures agree about the relative quality of document rankings

Cited by 10 publications

References 23 publications

Case-Based Reasoning Framework for Malaria Diagnosis

Case-Based Reasoning Framework for Malaria Diagnosis

The effect of assigning a metadata or indexing term on document ordering

Is 1 noun worth 2 adjectives? Measuring relative feature utility

Contact Info

Product

Resources

About