Operations analysis of behavioral observation procedures: a taxonomy for modeling in an expert training system

Abstract

This article introduces a taxonomy based on a procedural operations analysis (Verplanck, 1996) of various method descriptions found in the behavior observation research literature. How these alternative procedures impact the recording and subsequent analysis of behavioral events on the basis of the type of time and behavior recordings made is also discussed. The taxonomy was generated as a foundation for the continuing development of an expert training system called Train-to-Code (TTC;

The Potential of Computer-Assisted Direct Observation Apps

“…The context in which behavior is shown, including environmental conditions, is an important factor when it comes to understanding behavior [1]. Especially dynamically changing contexts (see [1]) can be tracked easily with mobile devices.…”

“…Using a basic set of categories for all observers ensures comparability, while additional or more detailed categories can be used as "add-on" for more experienced observers. When it comes to output, personal reminders via prompts and feedback can be given according to the observer's skill level (as implemented for video observation/coding by [1]). …”

“…Observer agreement, the "sine qua non of observational research" [10] can usually only be determined after the observation, and only if multiple observers or observations are available (intraobserver and interobserver agreement, cf. [1]). It is not an easy task to conduct valid observations under economic and practical constraints (e.g., feasibility, operating ease, and costbenefit ratio; see, e.g., [4]).…”

“…By using virtual buttons and automatic logging to code behavior and behavior patterns, they allow for more accurate recording with separate times for concurrent behaviors ( [1]; [2]), are easy to learn ([16]; [2]), eliminate the need to digitize/transcribe the data [2] and thus help to avoid possible transcription errors [3]. They are also harder for the observed subject to notice [2], allow the observer to code more categories of behaviors ( [1]; [16]), can assist in the observation (e.g., via questions, [16]) and provide a means of checking whether data was entered completely and at the correct time [3]. Especially the elimination of transcription costs can make mobile devices cost-effective, despite their higher initial costs ( [16]; [2]).…”

“…Observational studies are used in many scientific disciplines, among others, applied behavior analysis, child development, animal behavior [1], and visitor studies [2]. They provide important information about actual behavior ( [3]; [4]; [2]) with a high level of detail [2] and without being dependent on language [4].…”