This technical report provides detailed information on the rationale for using a common computer spreadsheet program (Microsoft Excel ® ) to calculate various forms of interobserver agreement for both continuous and discontinuous data sets. In addition, we provide a brief tutorial on how to use an Excel spreadsheet to automatically compute traditional total count, partial agreement-withinintervals, exact agreement, trial-by-trial, interval-by-interval, scored-interval, unscored-interval, total duration, and mean duration-per-interval interobserver agreement algorithms. We conclude with a discussion of how practitioners may integrate this tool into their clinical work. Keywords: computer software, interobserver agreement, Microsoft Excel, technology ABSTRACT T
The process of scheduling classroom observations-either for staff or for student performance data collection-is often done haphazardly or out of simple convenience. However, slapdash approaches to scheduling are rich with possible confounds to the validity of the data being collected. Due to the possibility of detrimental outcomes such as reactivity or stimulus control, classrooms observations ought to be scheduled in a calculated "randomized" approach. In this technical article, we outline the various ways in which unsystematic scheduling of observation may evoke undesirable trends in data. We then present a task analysis detailing ways in which a supervisor may use Microsoft ® Office Excel ® -a widely available spreadsheet program-to create randomized schedules to promote the integrity of the dependent variables being collected during scheduled observations. Implications of using simple spreadsheets to assist supervisors in scheduling "random" observations are discussed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.