We reviewed all research articles in 10 recent volumes of the Journal of Applied Behavior Analysis (JABA): Vol. 28(3), 1995, through Vol. 38(2), 2005. Continuous recording was used in the majority (55%) of the 168 articles reporting data on free-operant human behaviors. Three methods for reporting interobserver agreement (exact agreement, block-by-block agreement, and time-window analysis) were employed in more than 10 of the articles that reported continuous recording. Having identified these currently popular agreement computation algorithms, we explain them to assist researchers, software writers, and other consumers of JABA articles.
Recent advancements in telecommunication technologies make it possible to conduct a variety of healthcare services remotely (e.g., behavioral-analytic intervention services), thereby bridging the gap between qualified providers and consumers in isolated locations. In this study, web-based telehealth technologies were used to remotely train direct-care staff to conduct a multiple-stimulus-without-replacement preference assessment. The training package included three components: (a) a multimedia presentation; (b) descriptive feedback from previously recorded baseline sessions; and (c) scripted role-play with immediate feedback. A nonconcurrent, multiple-baseline-across-participants design was used to demonstrate experimental control. Training resulted in robust and immediate improvements, and these effects maintained during 1- to 2-month follow-up observations. In addition, participants expressed high satisfaction with the web-based materials and the overall remote-training experience.
The three algorithms most frequently selected by behavior-analytic researchers to compute interobserver agreement with continuous recording were used to assess the accuracy of data recorded from video samples on handheld computers by 12 observers. Rate and duration of responding were recorded for three samples each. Data files were compared with criterion records to determine observer accuracy. Block-by-block and exact agreement algorithms were susceptible to inflated agreement and accuracy estimates at lower rates and durations. The exact agreement method appeared to be overly stringent for recording responding at higher rates (23.5 responses per minute) and for higher relative duration (72% of session). Time-window analysis appeared to inflate accuracy assessment at relatively high but not at low response rate and duration (4.8 responses per minute and 8% of session, respectively).
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.