Seventeen measures o f association f o r observer reliabifity dnterobserver agreement) are reviewed and computational formulas are given in a common notational system. A n empirical comparison o f 10 o f these measures is made over a range o f potential reliability check results. The effects on percentage and correlational measures o f occurrence frequency, error frequency, and error distribution are examined. The question o f which is the "'best" measure o f interobserver agreement is discussed in terms o f critical issues to be consideredKEY WORDS: interobserver agreement; observer reliability; measures of association; naturalistic observation; interval-by-interval coding systems.

No abstract

No abstract