Psychometric Properties of the Outcome Rating Scale (ORS) in a Spanish Clinical Sample

Abstract

The Outcome Rating Scale (ORS) is an ultra-brief measure of well-being designed to track outcome in psychotherapy. This research studied the psychometric properties of the ORS in a Spanish clinical sample. One-hundred and sixty-five adult participants from different primary care centers of the city of Barcelona were recruited. The psychometric properties of the ORS in the sample were explored and described, comparing them to the properties of other instruments already validated in Spain. Our results showed good reliability (α = .91 [.88, .93]; α = .96; test re-test correlations from .61 to .84), good validity (convergent validity correlations with distress and symptoms measures from -.32 to -.76), and good sensitivity to change (pre-post comparison through Wilcoxon signed-rank test, Mdnpre = 31.0, Mdnpost = 19.6, z = -7.38, p < .05, r = .42). These results are consistent with previous findings in other countries. We conclude suggesting that the instrument can be applied to monitor outcome in psychotherapy and to test the effectiveness of treatments imparted with Spanish speaking clients. However, further research with the ORS in Spanish could provide more evidence of its psychometric properties.

Validation of the French Versions of Two Brief,Clinician-friendly Outcome Monitoring Tools: The ORS and SRS.

“…The score in non-feedback condition is near precedent research findings (Janse et al, 2013), and comparable to Moggia et al (2017;P (25) = 35.5). The more conservative cut-off could be considered at 36, as in the original SRS validation.…”

“…These compare to: Miller et al, (2003; .87), Janse et al, (2014; .82) and Moggia et al (2017;2018;.88) for the clinical population.…”

Exploring counselling outcomes in New Zealand schools

“…Efforts to validate the ORS in other countries are ongoing (e.g. Moggia, Nina‐Robles, Miller, & Fexias, 2018 in Spain; and She, Sun, & Jiang, 2017 in China). In the meantime, the scales continue to be used in different countries and with varying cultures as though they were culturally neutral.…”

Patterns of change and their relationship to outcome and follow-up in group and individual psychotherapy for depression.

“…Therefore, the ongoing therapeutic effectiveness can be assessed for each patient, comparing the patient's actual progress with the expected trajectory. These models have been implemented in clinical practice with instruments for routine outcome monitoring (ROM; Boswell, Kraus, Miller, & Lambert, 2015) such as the Outcome Questionnaire -45 (OQ-45; Lambert et al, 1996), the Clinical Outcome in Routine Evaluation (CORE; Evans et al, 2000;Trujillo et al, 2016), and the Outcome Rating Scale (ORS; Miller, Duncan, Sparks, & Claud, 2003;Moggia, Niño-Robles, Miller, & Feixas, 2018). With these questionnaires, computerised feedback systems have been created to support clinical decision making, informing the clinician whether the treatment is working for a particular patient ).…”