Patient-reported outcome data generated in a clinical intervention in community mental health care - psychometric properties

Abstract

BackgroundDIALOG is an intervention to structure the communication between patient and key worker, which has been shown to improve patient outcomes in community mental health care. As part of the intervention, patients provide ratings of their subjective quality of life (SQOL) on eight Likert type items and their treatment satisfaction on three such items. This study explored the psychometric qualities of the outcome data generated in the DIALOG intervention to explore whether they may be used for evaluating treatment outcomes.MethodData were taken from 271 patients who received the DIALOG intervention. All patients were diagnosed with schizophrenia or a related disorder and treated in community mental health care. For SQOL and treatment satisfaction as assessed in the DIALOG intervention, we established the internal consistency (Cronbach’s alpha), the convergent validity of SQOL items (correlation with Manchester Short Assessment of Quality of Life [MANSA]) and treatment satisfaction items (correlation with Client Satisfaction Questionnaire [CSQ]), the concurrent validity (correlations with Positive and Negative Syndrome Scale [PANSS]) and the sensitivity to change (t-test comparing ratings of the first and last intervention). We also explored the factorial structure of the eight SQOL items.ResultsThe internal consistency of the eight SQOL items was .71 and of the three treatment satisfaction items .57. SQOL scores were correlated with the MANSA (r = .95) and PANSS scores (general psychopathology: r = −.37, positive symptoms: r = −.27, negative symptoms: r = −.27). Treatment satisfaction scores were correlated with the CSQ (r = 0.36) and the PANSS (r = −.29, -.20, -.20). SQOL and treatment satisfaction score improved significantly over time. SQOL items loaded on two meaningful factors, one capturing health and personal safety and one reflecting other life domains.ConclusionsThe psychometric qualities of the SQOL scores generated in DIALOG are strong. The properties of the three treatment satisfaction items may be seen as acceptable. Although DIALOG has been designed as a therapeutic intervention, it can generate outcome data on SQOL and treatment satisfaction with acceptable psychometric qualities.

Effective patient–clinician interaction to improve treatment outcomes for patients with psychosis: a mixed-methods design

“…The DIALOG assessment itself has also been shown to be a valid indicator of subjective quality of life and treatment satisfaction. 69 The intervention could, therefore, provide regular patient-reported outcomes in a clinically meaningful procedure. This would be more economical and provide better response rates than separate assessments purely for evaluation purposes.…”

The Effectiveness of a Patient-Centred Assessment with a Solution-Focused Approach (DIALOG+) for Patients with Psychosis: A Pragmatic Cluster-Randomised Controlled Trial in Community Care

“…Using the intervention in practice will also deliver, quasi as a side effect, patient-reported outcome measures. The scores of the scale in DIALOG and DIALOG+ have been shown to be valid indicators of SQOL and treatment satisfaction [35] . Obtaining such outcomes in a clinically meaningful procedure may be more economical and provide better response rates than separate assessments purely for evaluation purposes.…”

Financial incentives to improve adherence to antipsychotic maintenance medication in non-adherent patients: a cluster randomised controlled trial

“…59 The scale consists of 11 items asking patients to rate their satisfaction with eight life domains and three treatment aspects, one of which is medication, on a scale ranging from 1 (lowest satisfaction) to 7 (highest satisfaction). The subjective quality-of-life subscale has been shown to have good psychometric properties 60 8. Use and costs of inpatient care, outpatient and community mental health care and other health services during the 12-month treatment period, including the cost of the intervention, and in the subsequent 6-month post-intervention period.…”