Effectiveness of interventions influencing academic behaviors: A quantitative synthesis of single-subject researches using the PEM approach.

Abstract

The purpose of the present study is twofold: (a) to test the repeatability of the superiority of the percentage of data points exceeding the median of the baseline phase (PEM) approach over the percentage of nonoverlapping data (PND) approach for the synthetic analysis of single-subject researches, and (b) to demonstrate the application of the PEM approach in conducting a quantitative synthesis of single -subject researches, which investigated the effectiveness of interventions on academic behaviors. The analyzed studies were obtained through a computer-assisted search of the relevant databases and a hand search of the relevant behavior analysis journals. The major finding demonstrates the repeatability of the superiority of the PEM approach over that of the PND. Key words: PEM approach (the percentage of data points exceeding the median of the baseline phase); PND approach (the percentage of nonoverlapping data); Synthetic analysis of single-subject researches. *Wu, S. S. (2001). Using a comprehensive reading strategies program to improve the reading comprehension skills of students with low reading comprehension.

Application of the percentage of non-overlapping data (PND) in systematic reviews and meta-analyses: A systematic review of reporting characteristics

“…For instance, Chen and Ma (2007) found only 0.72% (n ¼ 5) of baseline-treatment pairs exhibited orthogonal slope changes. Similarly, Gao and Ma (2006) found only 2.6% (n ¼ 4) of baseline-treatment pairs displayed orthogonal slope changes.…”

“…Third, that the PND was applied to an original data set; secondary analyses of PND applications previously reported elsewhere did not qualify (e.g., Campbell, 2004;Schlosser & Goetze, 1992). Fourth, the use of PND and other outcome metrics for the purposes of methodological or statistical comparisons among outcome metrics (e.g., with simulated data) did not qualify a study for inclusion unless it also involved a systematic review to answer a question related to the efficacy or effectiveness of an intervention; Gao and Ma (2006) did engage in a comparison but also conducted a meta-analysis and, therefore, it was included. Fifth, that the manuscript was published in a peer-reviewed journal or as a book chapter; unpublished papers were excluded.…”

“…Mastropieri & Scruggs, 1985-1986Mastropieri, Scruggs, Bakken, & Whedon, 1996;Scruggs et al, 1987) for interpreting the effectiveness of the interventions synthesized. Gao and Ma (2006) initially used the taxonomy, but then collapsed the lower two levels of effectiveness because they were difficult to distinguish from each other through visual analysis of the graphs. Scotti, Evans, Meyer, and Walker (1991) developed and applied their own taxonomy because their distribution of yielded PND scores was skewed.…”

“…. just the initial baseline phase was used to calculate PND'' (p. 88) Gao & Ma (2006) ''Each pair of a baseline -treatment phases in a multiple baseline design was treated as the first pair except in the case that it contained a reversal design'' (p. 3) Mastropieri & Scruggs (1985) ''. .…”

“…Author ( Gao & Ma (2006) ''order of pairs of baseline-treatment of a reversal design: 1 ¼ the first pair, 2 ¼ the second pair'' (p. 3) Herzinger & Campbell (2007) ''. .…”