Inter-rater Reliability of Clinician-rated Outcome Measures in Child and Adolescent Mental Health Services

Hanssen‐Bauer, Ketil; Aalen, Odd O.; Ruud, Torleif; Heyerdahl, Sonja

doi:10.1007/s10488-007-0134-y

Cited by 52 publications

(45 citation statements)

References 35 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We did not measure the interrater reliability of the CGAS for this study. However, the interrater reliability of the CGAS in routine use was found to be moderate (intraclass correlation coefficient, .61) in a large study of clinicians in Norwegian outpatient child and adolescent mental health services [25]. …”

Section: Methodsmentioning

confidence: 99%

Characteristics of adolescents frequently restrained in acute psychiatric units in Norway: a nationwide study

Furre

Falk

Sandvik

et al. 2017

Child Adolesc Psychiatry Ment Health

Self Cite

View full text Add to dashboard Cite

BackgroundThe use of restraints in adolescent psychiatric settings requires particular professional, ethical, and legal considerations. The purpose of this study was to investigate whether the number of restraint episodes per patient was related to any of several characteristics of the adolescents.MethodsIn this nationwide study, we included all adolescents restrained during the period 2008–2010 (N = 267) in Norwegian adolescent acute psychiatric inpatient units. They constitute 6.5% of the adolescents hospitalized in these units in the same period of time. We collected data on the number of restraint episodes they experienced during the study period; Poisson regression was then used to analyze the impact of gender, social, mental health, and treatment characteristics on the frequency of restraint. We developed a risk index for the likelihood of experiencing multiple restraint episodes.ResultsWe found a skewed distribution of restraint episodes in which a small group (18%) of restrained adolescents experienced a majority (77%) of the restraint episodes. A large percentage of the restrained adolescents (36%) experienced only one restraint episode. Risk factors for multiple restraint episodes were female gender, lower psychosocial functioning (Children’s Global Assessment Scale below 35), more and longer admissions, and concomitant use of pharmacological restraint. Except for gender, we used these variables to develop a risk index that was moderately associated with multiple restraint episodes.ConclusionsAs a small group of patients accounted for a large percentage of the restraint episodes, future research should further investigate the reasons for and consequences of multiple restraint episodes in patients at acute adolescent psychiatric units, and evaluate preventive approaches targeted to reduce their risk for experiencing restraint.

show abstract

Section: Methodsmentioning

confidence: 99%

Characteristics of adolescents frequently restrained in acute psychiatric units in Norway: a nationwide study

Furre

Falk

Sandvik

et al. 2017

Child Adolesc Psychiatry Ment Health

Self Cite

View full text Add to dashboard Cite

show abstract

“…Interrater reliability, discriminant validity, and clinical usefulness of the CGAS are well documented [35,36]. Scores greater than 70 are designated as indicating normal function [34].…”

Section: Psychosocial Functioningmentioning

confidence: 99%

Mental health and psychosocial functioning in adolescents with esophageal atresia

Faugli

Björnland

Emblem

et al. 2009

Journal of Pediatric Surgery

View full text Add to dashboard Cite

“…The CGAS is a widely used measure, shown to have high inter-rater reliability, with intra-class correlations (ICCs) of .84 between clinicians' initial ratings, and excellent test-retest stability with ICCs of .85 between raters 6 months after initial ratings (Shaffer et al, 1983). More modest ICCs of .73 and .61 were found with larger samples (Hanssen-Bauer, Aalen, Ruud, & Heyerdahl, 2007;Lundh, Kowalski, Sundberg, Gumpert, & Landén, 2010). CGAS is sensitive to 'differences in level of impairment', with the tool yielding statistically significant differences between outpatient and inpatient scores (Shaffer et al, 1983).…”

Section: Methodsmentioning

confidence: 99%

Associations between family and clinician ratings of child mental health: A study of UK CAMHS assessments and outcomes

Terrelonge

Fugard

2017

Clin Child Psychol Psychiatry

View full text Add to dashboard Cite

Background: The rated severity of child mental health problems depends on who is doing the rating, whether child, carer or clinician. It is important to know how these ratings relate to each other. Aims:To investigate to what extent clinicians' views are associated with carers' and young people's views in routine care in the United Kingdom. Method: Ratings of clinician and parent/child viewpoints from a large Child and Adolescent Mental Health Services (CAMHS) sample (ns 1773-47,299), as measured by the Children's Global Assessment Scale (CGAS) and Strengths and Difficulties Questionnaire (SDQ) respectively, were analysed. The parent SDQ added value score (AVS), which adjusts for regression to the mean and other non-treatment change, was also included in the analyses. Results: Small-to-medium correlations were found between family and clinician ratings; however, ratings diverged for the lowest-function CGAS bands. Regression analyses showed that pro-social ratings from both child and parent contributed to clinician ratings. Knowing childreported emotional problem severity made parent ratings of emotions irrelevant to clinician judgements. There was a positive association between SDQ AVS and CGAS; as hypothesised, CGAS showed more change than the SDQ AVS, suggesting that clinicians over-estimate change. Conclusion: This study shows the importance of multi-informant data gathering and the integration of multiple views by clinicians when monitoring outcomes.

show abstract

Inter-rater Reliability of Clinician-rated Outcome Measures in Child and Adolescent Mental Health Services

Cited by 52 publications

References 35 publications

Characteristics of adolescents frequently restrained in acute psychiatric units in Norway: a nationwide study

Characteristics of adolescents frequently restrained in acute psychiatric units in Norway: a nationwide study

Mental health and psychosocial functioning in adolescents with esophageal atresia

Associations between family and clinician ratings of child mental health: A study of UK CAMHS assessments and outcomes

Contact Info

Product

Resources

About