Conditions influencing the impact of state level program evaluation

Newman, Frederick L.; Smukler, Michael; Griffin, Brian P.; Fishman, Daniel B.

doi:10.1016/0149-7189(92)90073-4

Cited by 3 publications

(1 citation statement)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A more basic implication of this and other studies is that preestablished criteria may not be valid representations of appropriate care. In studies in which mental health appropriateness has been investigated, researchers have measured appropriateness of care with expert clinician ratings and consensus panels (Leff et al, 1994; Newman et al, 1987; Newman, Smukler, Griffin, & Fishman, 1992). Whereas expert judgment and panel approaches may be important sources for the development of mental health appropriateness standards, these standards are still prone to significant errors in clinical judgment.…”

Section: Resultsmentioning

confidence: 99%

Clinican reliability and accuracy in judging appropriate level of care.

Bickman¹,

Karver²,

Schut³

1997

Journal of Consulting and Clinical Psychology

View full text Add to dashboard Cite

Accurately assigning children to the most appropriate level of care is widely recognized as important. Managed care companies conduct utilization reviews in which they monitor the level of care to which clients are assigned using written placement criteria. However, no research has examined the ability of clinicians to perform this task. In the present study, 47 child and adolescent clinical profiles consisting of 48 variables were developed. Eighteen clinicians, trained to use their agency's level-of-care guidelines, made level-of-care decisions on these profiles. Their interjudge reliability in assigning a child to an appropriate level of care was close to zero (kappa = .07). There was a small, statistically significant correlation between client placement and actual placement, but chance-corrected agreement between client placement and actual placement was very low (kappa = .09). Implications of these findings for clinical research, practice, policy, and training are discussed.

show abstract

Section: Resultsmentioning

confidence: 99%