A critique of the effectiveness of applied behavior analysis research

Abstract

Since its inception, applied behavior analysis has required that solutions to socially significant problems be effective, though criteria for this dimension have remained largely implicit. This paper reviews three explicit technique for determining the effectiveness of behavioral research: graphical, social validational, and cost analyses. The concept of effect size is introduced as an additional means of comparing the effectiveness of various treatment alternatives. Survey data are utilized to support a bothersome implication of this review, namely that the contingency to produce large effects placed on behavioral researchers may actually decrease the likelihood that a useful technology of application will be produced. Finally, strategies are offered for preserving the effectiveness of behavioral procedures when existing technologies are disseminated to settings of relevance.

The Generality and Social Validity of a Competency‐based Self‐control Training Intervention for Underachieving Students

“…Future research efforts should assess the relative effectiveness of the components of this treatment package and both treated and untreated students' implementation of the procedures (i.e., the integrity of the independent variable) in nontraining settings and during maintenance. Given the significant financial cutbacks in public school education, a cost analysis should be induded in future evaluations and refinements of this training package to further extend and maximize the use of this type of school-based self-control training intervention (Yeaton, 1982). Additionally, future research should explore practical means of training groups of children in the same dassroom, in order to extend the therapeutic value of these procedures to large groups of students.…”

“…Given the significant financial cutbacks in public school education, a cost analysis should be induded in future evaluations and refinements of this training package to further extend and maximize the use of this type of school-based self-control training intervention (Yeaton, 1982). Additionally, future research should explore practical means of training groups of children in the same dassroom, in order to extend the therapeutic value of these procedures to large groups of students.…”

How to behave ethically in a world of fads

“…Thus, following efficacy criteria (Chambless et al, 1996; Chambless & Hollon, 1998; Lonigan et al, 1998), the theoretical premise and assumptions of SI remain unsubstantiated by research (Green, 2007; Kay & Vyse, 2005). See Cummins (1991), Griffer (1999), Luiselli and Hurley (2005), Parham et al (2007), Smith et al (2005), Spirito (1999), and Yeaton (1982) for reviews of the treatment literature.…”

Independent Variable Integrity in Behavioral Research: A Review of the Literature

“…Furthermore, the measurement system must permit the assessment of any event which may influence the Salvia & Hunt, 1984). Such an assessment of treatment application has several advantages: (1) a detailed assessment of the treatment would prompt researchers to provide adequate description of independent variables (O'Learly & Turkewitz, 1978), (2) meaningful comparisons of the effectiveness of different treatment approaches to the same problem are attainable only when reliable data on treatment integrity are obtained (Yeaton, 1982), and (3) monitoring the implementation of treatment variables would help avoid misapplications of behavioral procedures (Carsrud, Carsrund, & Dodd, 1980). Basic issues in behavioral observation of the dependent variable are also applicable to independent variable assessment (Billingsley et al, 1980;Peterson et al, 1982;Salvia & Hunt, 1984).…”