Comparative evaluation of the reliability and validity of three data extraction programs: UnGraph, GraphClick, and DigitizeIt

Rakap, Salih; Rakap, Serife; Evran, Derya; Çığ, Oğuzcan

doi:10.1016/j.chb.2015.09.008

Cited by 61 publications

(46 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Because there is some unreliability in data extraction (i.e., coders may click slightly different areas on a data point), intercoder reliability for y ‐values was examined proportionally, as such, y ‐values within 1% of the y ‐axis range were considered to be in agreement. This metric is commonly used to assess intercoder reliability of plot digitizing tools (Boyle, Samaha, Rodewald, & Hoffmann, ; Rakap, Rakap, Evran, & Cig, ). For the current study, 86% of data points were in proportional agreement.…”

Section: Methodsmentioning

confidence: 99%

A meta‐analytic review of the evidence for check‐in check‐out

Drevon

Hixson

Wyse

et al. 2018

Psychology in the Schools

View full text Add to dashboard Cite

The purpose of this study was to conduct a descriptive and quantitative review of the literature examining the effectiveness of check-in check-out (CICO), a commonly used behavioral intervention in the context of a Positive Behavior Interventions and Supports framework. Studies that experimentally investigated the effectiveness of CICO or modified CICO compared with a baseline or control condition on student outcomes were included. A between-case d-statistic comparable across single-case and between-groups experiments was calculated for 59 dependent variables across 32 studies. The meta-analysis was conducted using robust variance estimation allowing for the inclusion of multiple effect sizes per study by accounting for dependency between outcomes. The overall effect size,̅ g = 1.22, 95% confidence intervals (1.00, 1.44), suggested CICO improves student outcomes by over one standard deviation. Studies were characterized by considerable heterogeneity that went largely unexplained in moderator analyses. Results are situated in the context of other systematic reviews of CICO and modified CICO. Overall, CICO appears to be an effective intervention; however, at this time, it is unclear what study-and sample-level variables may impact its effectiveness. K E Y W O R D S behavior education program, check-in check-out, positive behavior, evidence-based practice, interventions and support, meta-analysis Psychol Schs. 2019;56:393-412. wileyonlinelibrary.com/journal/pits

show abstract

Section: Methodsmentioning

confidence: 99%

A meta‐analytic review of the evidence for check‐in check‐out

Drevon

Hixson

Wyse

et al. 2018

Psychology in the Schools

View full text Add to dashboard Cite

show abstract

“…For each study, baseline and treatment data points for challenging behavior were extracted from graphs using the computer software UnGraph™ (BioSoft, 2004) by the first author. The UnGraph™ software allowed for precise extraction of data presented on electronic graphs, and the reliability and validity has been supported by prior research (Rakap et al, 2016;Shadish et al, 2009). In UnGraph™, graph images are imported as a .pdf or image file into the UnGraph™ software.…”

Section: Data Extractionmentioning

confidence: 99%

Evaluation of publication bias in response interruption and redirection: A meta‐analysis

Dowdy

Tincani

Schneider

2020

J of App Behav Analysis

View full text Add to dashboard Cite

Publication bias is the disproportionate representation of studies with large effects and statistically significant findings in the published research literature. If publication bias occurs in singlecase research design studies on applied behavior-analytic (ABA) interventions, it can result in inflated estimates of ABA intervention effects. We conducted an empirical evaluation of publication bias on an evidence-based ABA intervention for children diagnosed with autism spectrum disorder, response interruption and redirection (RIRD). We determined effect size estimates for published and unpublished studies using 3 metrics, percentage of nonoverlapping data (PND), Hedges' g, and log response ratios (LRR). Omnibus effect size estimates across all 3 metrics were positive, supporting that RIRD is an effective treatment for reducing problem behavior maintained by nonsocial consequences. We observed larger PND for published compared to unpublished studies, small and nonsignificant differences in LRR for published compared to unpublished studies, and significant differences in Hedges' g for published compared to unpublished studies, with published studies showing slightly larger effect. We found little, if any, difference in methodological quality between published and unpublished studies. While RIRD appears to be an effective intervention for challenging behavior maintained by nonsocial consequences, our results reflect some degree of publication bias present in the RIRD research literature.

show abstract

“…If the dataset could not be retrieved (n = 17) the figure was digitised using graph digitiser software (DigitizeIt, Germany) and the means and SD/SEM were measured manually at the pixel level to the scale provided on the figure. DigitizeIt has been shown to provide valid and reliable results which provide good agreement with raw data values [13]. If area under the curve values were reported rather than the mean values, the mean values were calculated by dividing the area under the curve scores by time duration.…”

Section: Data Abstractionmentioning

confidence: 99%

Differences in circulating appetite-related hormone concentrations between younger and older adults: a systematic review and meta-analysis

et al. 2019

View full text Add to dashboard Cite

Ageing is associated with reduced appetite and energy intakes. However, the mechanisms underlying this phenomenon are not fully understood. This systematic review and meta-analysis quantified differences in circulating concentrations of appetite-related hormones between healthy older and younger adults. Six databases were searched through 12th June 2018 for studies that compared appetite-related hormone concentrations between older and younger adults. Data were pooled using random-effects meta-analysis and are presented as standardised mean difference (Hedges' g) with 95% confidence intervals (95% CI). Thirty-five studies were included involving 710 older adults (mean ± SD; age: 73 ± 5 years) and 713 younger adults (age: 28 ± 7 years). Compared with younger adults, older adults exhibited higher fasted and postprandial concentrations of the anorectic hormones cholecystokinin (Fasted: SMD 0.41 (95% CI 0.

show abstract

Comparative evaluation of the reliability and validity of three data extraction programs: UnGraph, GraphClick, and DigitizeIt

Cited by 61 publications

References 13 publications

A meta‐analytic review of the evidence for check‐in check‐out

A meta‐analytic review of the evidence for check‐in check‐out

Evaluation of publication bias in response interruption and redirection: A meta‐analysis

Differences in circulating appetite-related hormone concentrations between younger and older adults: a systematic review and meta-analysis

Contact Info

Product

Resources

About