Systematic review of tools to measure outcomes for young children with autism spectrum disorder

Abstract

BackgroundThe needs of children with autism spectrum disorder (ASD) are complex and this is reflected in the number and diversity of outcomes assessed and measurement tools used to collect evidence about children’s progress. Relevant outcomes include improvement in core ASD impairments, such as communication, social awareness, sensory sensitivities and repetitiveness; skills such as social functioning and play; participation outcomes such as social inclusion; and parent and family impact.ObjectivesTo examine the measurement properties of tools used to measure progress and outcomes in children with ASD up to the age of 6 years. To identify outcome areas regarded as important by people with ASD and parents.MethodsThe MeASURe (Measurement in Autism Spectrum disorder Under Review) research collaboration included ASD experts and review methodologists. We undertook systematic review of tools used in ASD early intervention and observational studies from 1992 to 2013; systematic review, using the COSMIN checklist (Consensus-based Standards for the selection of health Measurement Instruments) of papers addressing the measurement properties of identified tools in children with ASD; and synthesis of evidence and gaps. The review design and process was informed throughout by consultation with stakeholders including parents, young people with ASD, clinicians and researchers.ResultsThe conceptual framework developed for the review was drawn from the International Classification of Functioning, Disability and Health, including the domains ‘Impairments’, ‘Activity Level Indicators’, ‘Participation’, and ‘Family Measures’. In review 1, 10,154 papers were sifted – 3091 by full text – and data extracted from 184; in total, 131 tools were identified, excluding observational coding, study-specific measures and those not in English. In review 2, 2665 papers were sifted and data concerning measurement properties of 57 (43%) tools were extracted from 128 papers. Evidence for the measurement properties of the reviewed tools was combined with information about their accessibility and presentation. Twelve tools were identified as having the strongest supporting evidence, the majority measuring autism characteristics and problem behaviour. The patchy evidence and limited scope of outcomes measured mean these tools do not constitute a ‘recommended battery’ for use. In particular, there is little evidence that the identified tools would be good at detecting change in intervention studies. The obvious gaps in available outcome measurement include well-being and participation outcomes for children, and family quality-of-life outcomes, domains particularly valued by our informants (young people with ASD and parents).ConclusionsThis is the first systematic review of the quality and appropriateness of tools designed to monitor progress and outcomes of young children with ASD. Although it was not possible to recommend fully robust tools at this stage, the review consolidates what is known about the field and will act as a benchmark for future developments. With input from parents and other stakeholders, recommendations are made about priority targets for research.Future workPriorities include development of a tool to measure child quality of life in ASD, and validation of a potential primary outcome tool for trials of early social communication intervention.Study registrationThis study is registered as PROSPERO CRD42012002223.FundingThe National Institute for Health Research Health Technology Assessment programme.

Therapy interventions for children with neurodisabilities: a qualitative scoping study

“…In addition, a similar project but specific to young children with autism has also been published recently. 56 Both of these studies identify measure development work as a research priority. Given the move towards goals-focused approaches to therapy interventions, goal attainment scaling was suggested as an approach that had the potential to capture participation-type outcomes that may be more directly attributable to a specific intervention.…”

International multicentre randomised controlled trial of improvisational music therapy for children with autism spectrum disorder: TIME-A study

“…At the time that the study was designed, there was a lack of validated measures of the core problems of social affect and communication experienced by children with ASD that were sensitive to change. 35,36 The ADOS was originally developed as a diagnostic tool to assess whether or not children have impairments and unusual behaviours that would indicate ASD. Although some previous studies have used the ADOS to assess the clinical effectiveness of interventions, 22,37,38 concerns have been raised about the suitability of the ADOS to assess changes in the adaptive functioning of children with ASD.…”

“…A systematic review of outcome measures used to assess the impact of interventions for young children with ASD concluded that there is an urgent need for validated assessments that are sensitive to change. 35 Following this, the Brief Observation of Social Communication Change was developed specifically to assess changes in social communication skills of children with ASD. 40 Longitudinal data from children with ASD suggest that the Brief Observation of Social Communication Change may be more sensitive to change than the ADOS, 40 and we cannot rule out the possibility that music therapy brought about changes in social affect that were not detected using the ADOS.…”

A Systematic Review of Hippotherapy (horseback riding) for Individuals with Autism is the Cognitive Level Considered?

“…The Gilliam Autism Rating scale-2 (GARS-2) is a behavioral checklist divided into social interaction, communication, and stereotyped behaviors scales which helps identify or diagnose autism and estimate its severity [53]. However, concerns about the capacity of the scale to detect autism has been raised [54]. This measure was used by one study.…”

“…Social skills were measured by Child Activity Card Sort (CACS, developed by Mandich et al [59] which measures leisure interests and Child Behavior Checklist (CBCL, developed by Achenbach and Ruffle [60] were used by one study each. The CBCL is a normreferenced measure that assesses for a wide range of emotional and behavioral disorders in children aged 1.5-5 years [54]. Four studies used the Vineland Adaptive Behavioral Scales (VABS-II-Sparrow, developed by Achenbach and Ruffle [60] to measure adaptive skills.…”