Background: Patient Reported Outcome Measures (PROMs) are increasingly being used in Child and Adolescent Mental Health Services (CAMHS). The aim of this research was to explore change in standardized and idiographic outcome measures in CAMHS using naturalistic, routinely collected data. Method: We explored change in psychosocial difficulties and impact on daily life as evaluated by a broad standardized measure, the Strengths and Difficulties Questionnaire (SDQ) (Goodman, 1997, J. Child Psychol. Psychiatry, 38, 581) and progress toward goals as evaluated by a personalized idiographic measure, the Goal Based Outcomes tool (GBO) (Law, 2011, Goals and Goal Based Outcomes (GBOs): some useful information. London: CAMHS Press) in a sample of N = 137 CAMHS attenders. Results: Psychosocial difficulties and impact on daily life showed less change over the course of treatment than progress toward goals in this study. Change in psychosocial difficulties and impact on daily life were also less strongly associated with change in clinician-reported functioning and satisfaction with care at time two than change in progress toward goals. Conclusions: Findings of the present research may support previous studies in which service users and clinicians report that idiographic measures are more capable than standardized measures of capturing relevant change for individuals.
Key Practitioner Message• For normative comparison and clinical purposes, it is important to know how to interpret change in standardized and idiographic measures in CAMHS.• Past research suggests that standardized measures (e.g. the Strengths and Difficulties Questionnaire or SDQ) may be less clinically useful than idiographic measures (e.g. the Goal Based Outcome tool or GBO), but more amenable for aggregation and therefore comparing groups of patients.• The SDQ showed less change than the GBO in this study in terms of mean score change and reliable change.• Change captured by the SDQ was less strongly associated with change in clinician-reported functioning and satisfaction with care at time two than change captured by the GBO, and only change in the GBO was uniquely associated with change in clinician-reported functioning over treatment.• Findings of this study suggest that change greater than 2.45 points in the GBO represents reliable change.
The results suggest that goals may capture areas not captured by other normed outcome measures. In particular, goals may capture higher order, underlying factors, such as confidence, resilience, coping, and parenting factors that may not be explored by other measures. The differences across perspectives also link to existing literature suggesting a different focus on treatment based on perspectives and highlights the potential importance when jointly agreeing goals of ensuring the voice of the child/young person is heard and included in goal setting.
This is an open access article under the terms of the Creative Commons Attribution-NonCommercial License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited and is not used for commercial purposes.
Idiographic patient‐reported outcome measures (I‐PROMs) are a growing set of individualized tools for use in routine outcome monitoring (ROM) in psychological therapies. This paper presents a position statement on their conceptualization, use, and analysis, based on contemporary evidence and clinical practice. Four problem‐based, and seven goal‐based, I‐PROMs, with some evidence of psychometric evaluation and use in psychotherapy, were identified. I‐PROMs may be particularly valuable to the evaluation of psychological therapies because of their clinical utility and their alignment with a patient‐centered approach. However, there are several challenges for I‐PROMs: how to generate items in a robust manner, their measurement model, methods for establishing their reliability and validity, and the meaning of an aggregated I‐PROM score. Based on the current state of the literature, we recommend that I‐PROMs are used to complement nomothetic measures. Research recommendations are also made regarding the most appropriate methods for analyzing I‐PROM data.
This presents a powerful framework for how clinicians can use goals to help select a standardised outcome measure (where this is helpful) in addition to the use of a goal-based outcome measure and personalise choices. There may be areas not captured by standardised outcome measures that may be important for children and young people and which may only be currently captured in goal measurement. There is an indication that we may not be measuring what is important to children and young people. We may need to develop or look for new measures that capture these areas.
Service comparison is a policy priority but is not without controversy. This paper aims to investigate the amount of service-level variation in outcomes in child mental health, whether it differed when examining outcomes unadjusted vs. adjusted for expected change over time, and which patient-level characteristics were associated with the difference observed between services. Multilevel regressions were used on N = 3256 young people (53% male, mean age 11.33 years) from 13 child mental health services. Outcome was measured using the parent-reported Strengths and Difficulties Questionnaire. The results showed there was 4–5% service-level variation in outcomes. Findings were broadly consistent across unadjusted vs. adjusted outcomes. Young people with autism or infrequent case characteristics (e.g., substance misuse) had greater risk of poor outcomes. Comparison of services with high proportions of young people with autism or infrequent case characteristics requiring specialist input needs particular caution as these young people may be at greater risk of poor outcomes.
Goal formulation and tracking may support preference-based care. Little is known about the likelihood of goal formulation and tracking and associations with care satisfaction. Logistic and Poisson stepwise regressions were performed on clinical data for N = 3757 children from 32 services in the UK (M
age = 11; SDage = 3.75; most common clinician-reported presenting problem was emotional problems = 55.6%). Regarding the likelihood of goal formulation, it was more likely for pre-schoolers, those with learning difficulties or those with both hyperactivity disorder and conduct disorder. Regarding the association between goal formulation and tracking and satisfaction with care, parents of children with goals information were more likely to report complete satisfaction by scoring at the maximum of the scale. Findings of the present research suggest that goal formulation and tracking may be an important part of patient satisfaction with care. Clinicians should be encouraged to consider goal formulation and tracking when it is clinically meaningful as a means of promoting collaborative practice.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.