Percent Agreement, Pearson's Correlation, and Kappa as Measures of Inter-examiner Reliability

Hunt, Ronald J.

doi:10.1177/00220345860650020701

Cited by 235 publications

(151 citation statements)

References 17 publications

Supporting

Mentioning

141

Contrasting

Unclassified

Order By: Relevance

“…The inflammatory response of the negative control group was statistically significant (P > 0.05) when compared with Aloe vera or calcium hydroxide at all periods. The intraexaminer performance evaluated by kappa analysis resulted in 0.807, which is considered an excellent agreement with the literature (Hunt, 1986) and perfect agreement (Eklud et al, 1986).…”

Section: Group 3: Control Groupsupporting

confidence: 77%

Effect ofAloe vera. on Rat Pulp Tissue

Gala-García

Teixeira

Mendes

et al. 2008

Pharmaceutical Biology

View full text Add to dashboard Cite

show abstract

Section: Group 3: Control Groupsupporting

confidence: 77%

Effect ofAloe vera. on Rat Pulp Tissue

Gala-García

Teixeira

Mendes

et al. 2008

Pharmaceutical Biology

View full text Add to dashboard Cite

show abstract

“…1 Additionally, despite high percentage levels of agreement with some adventitious sounds being coupled with lower kappa values, the kappa values should be deemed representative of inter-rater agreement because this considers the influence of chance, whereas percentage agreement does not. 36 However, because kappa values are influenced by the prevalence of the factor being investigated, infrequent occurrences of clinical factors (eg, bronchial breathing) may generate low kappa values but not necessarily be representative of low overall agreement. 37 Despite scant evidence for its clinical benefit, palpable chest-wall fremitus is commonly used by practitioners 38 and has been established as a key clinical indicator of retained secretions throughout management of pulmonary dysfunction in adults receiving mechanical ventilation.…”

Section: Discussionmentioning

confidence: 99%

Inter-Rater Agreement of Auscultation, Palpable Fremitus, and Ventilator Waveform Sawtooth Patterns Between Clinicians

2016

View full text Add to dashboard Cite

BACKGROUND: Clinicians often use numerous bedside assessments for secretion retention in participants who are receiving invasive mechanical ventilation. This study aimed to evaluate interrater agreement between clinicians when using standard clinical assessments of secretion retention and whether differences in clinician experience influenced inter-rater agreement. METHODS: Seventy-one mechanically ventilated participants were assessed by a research clinician and by one of 13 ICU clinicians. Each clinician conducted a standardized assessment of lung auscultation, palpation for chest-wall (rhonchal) fremitus, and ventilator inspiratory/expiratory flow-time waveforms for the sawtooth pattern. RESULTS: On the presence of breath sounds, agreement ranged from absolute to moderate in the upper zones and the lower zones, respectively. Kappa values for abnormal and adventitious lung sounds achieved moderate agreement in the upper zones, less than chance agreement to substantial agreement in the middle zones, and moderate agreement to almost perfect agreement in the lower zones. Moderate to almost perfect agreement was established for palpable fremitus in the upper zones, moderate to substantial agreement in the middle zones, and less than chance to moderate agreement in the lower zones. Inter-rater agreement on the presence of expiratory sawtooth pattern identification showed moderate agreement. The level of percentage agreement between the research and ICU clinicians for each respiratory assessment studied did not relate directly to level of clinical experience. CONCLUSIONS: Inter-rater agreement for all assessments showed variability between lung regions but maintained reasonable percentage agreement in mechanically ventilated participants. The level of percentage agreement achieved between clinicians did not directly relate to clinical experience for all respiratory assessments. Therefore, these respiratory assessments should not necessarily be viewed in isolation but interpreted within the context of a full clinical assessment.

show abstract

“…Frequently used indices for inter-examiner agreement are the percentage agreement and Pearson's correlation coefficient. These indices may be misleading, and kappa statistics were therefore chosen (51). The kappa statistic is a measure of the proportion of agreement beyond chance which is actually achieved.…”

Section: Discussionmentioning

confidence: 99%

Assessment of marginal degradation of restorations on impressions

Jokstad

Mjör

1991

Acta Odontologica Scandinavica

View full text Add to dashboard Cite

The study aimed to validate the scoring of the degree of marginal degradation of amalgam restorations by using impressions, as an alternative to other indirect scoring methods using photographs or casts. Ten-year-old condensation silicone elastomer impressions and epoxy replicas made in 1979 were compared in a scanning electron microscope at 5 kV with different magnifications up to x200. The impre~sion material was not distorted or degraded, and the dimensional stability was good after 10 years of storage in a dry environment. The interexaminer agreement of the scorings of impressions and a six-point scale reference set was satisfactory as evaluated by kappa statistics, demonstrating that degrees of marginal degradation can be distinguished on impressions with relatively high accuracy. The rating distribution of the scorings of impressions showed good correlation to the rating distributions obtained with the clinical USPHS rating method and with photographs for recording marginal degradation. A slight difference between the photographic and impression ratings at the upper and lower levels of the six-point rating scale was observed. The difference varied with the type of alloy, possibly due to a bias depending on the surface quality-that is, whether the restoration kept the glossiness of high polishing or became heavily tarnished. 0 Amalgam degradation; clinical rating; clinical study; kappa statistics; silicone elastomer AsbjomJokstad,

show abstract

Percent Agreement, Pearson's Correlation, and Kappa as Measures of Inter-examiner Reliability

Cited by 235 publications

References 17 publications

Effect ofAloe vera. on Rat Pulp Tissue

Effect ofAloe vera. on Rat Pulp Tissue

Inter-Rater Agreement of Auscultation, Palpable Fremitus, and Ventilator Waveform Sawtooth Patterns Between Clinicians

Assessment of marginal degradation of restorations on impressions

Contact Info

Product

Resources

About