2003
DOI: 10.1148/radiol.2282011860
|View full text |Cite
|
Sign up to set email alerts
|

Measurement of Observer Agreement

Abstract: Statistical measures are described that are used in diagnostic imaging for expressing observer agreement in regard to categorical data. The measures are used to characterize the reliability of imaging methods and the reproducibility of disease classifications and, occasionally with great care, as the surrogate for accuracy. The review concentrates on the chance-corrected indices, kappa and weighted kappa. Examples from the imaging literature illustrate the method of calculation and the effects of both disease … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

9
653
2
7

Year Published

2005
2005
2022
2022

Publication Types

Select...
9

Relationship

0
9

Authors

Journals

citations
Cited by 1,063 publications
(680 citation statements)
references
References 22 publications
9
653
2
7
Order By: Relevance
“…In analysis of concordance between the immunohistochemistry patterns from two separate tissue microarray sets, significance of κ-value was considered as follows: value ≤ 0.40, poor to fair concordance; 0.41-0.60, moderate concordance; 0.61-0.80, substantial concordance; 0.81-1.00, almost perfect concordance. 32 Comparisons between variables were performed using the χ 2 test, Fisher's exact test, or Student's t-test. Multivariate logistic regression analysis was used to examine predictive factors with consideration of collinearity.…”
Section: Discussionmentioning
confidence: 99%
“…In analysis of concordance between the immunohistochemistry patterns from two separate tissue microarray sets, significance of κ-value was considered as follows: value ≤ 0.40, poor to fair concordance; 0.41-0.60, moderate concordance; 0.61-0.80, substantial concordance; 0.81-1.00, almost perfect concordance. 32 Comparisons between variables were performed using the χ 2 test, Fisher's exact test, or Student's t-test. Multivariate logistic regression analysis was used to examine predictive factors with consideration of collinearity.…”
Section: Discussionmentioning
confidence: 99%
“…Agreement between raters, and between MR image and physical examination findings, are reported using overall proportion of agreement, positive agreement, negative agreement, agreement expected by chance, and agreement corrected for chance (Cohen's kappa). These statistical computations, each with advantages and disadvantages in describing the data, are detailed in Kundel and Polansky [2003] …”
Section: Discussionmentioning
confidence: 99%
“…Observer agreement was measured according to Cohen κ [42]. Positive staining of tissue macrophages was considered a positive internal control staining for CD163; as negative controls, the primary antibodies were replaced by an irrelevant isotype anti-mouse IgG1.…”
Section: Evaluation Of Histology and Immunostainingmentioning
confidence: 99%
“…A tumor was evaluated as positive if it contained any positive cancer cells; otherwise it was considered negative. Inter-observer variation calculated as Cohen kappa index [42] was κ=0.699.…”
Section: Evaluation Of Histology and Immunostainingmentioning
confidence: 99%