BackgroundOutcome measures for mental health services need to adopt a service-user recovery focus.AimsTo develop and validate a 10- and 20-item self-report recovery-focused quality of life outcome measure named Recovering Quality of Life (ReQoL).MethodQualitative methods for item development and initial testing, and quantitative methods for item reduction and scale construction were used. Data from >6500 service users were factor analysed and item response theory models employed to inform item selection. The measures were tested for reliability, validity and responsiveness.ResultsReQoL-10 and ReQoL-20 contain positively and negatively worded items covering seven themes: activity, hope, belonging and relationships, self-perception, well-being, autonomy, and physical health. Both versions achieved acceptable internal consistency, test–retest reliability (>0.85), known-group differences, convergence with related measures, and were responsive over time (standardised response mean (SRM) > 0.4). They performed marginally better than the Short Warwick-Edinburgh Mental Well-being Scale and markedly better than the EQ-5D.ConclusionsBoth versions are appropriate for measuring service-user recovery-focused quality of life outcomes.Declaration of interestM.B. and J.Co. were members of the research group that developed the Clinical Outcomes in Routine Evaluation (CORE) outcome measures.

PurposeService user involvement in instrument development is increasingly recognised as important, but is often not done and seldom reported. This has adverse implications for the content validity of a measure. The aim of this paper is to identify the types of items that service users felt were important to be included or excluded from a new Recovering Quality of Life measure for people with mental health difficulties.MethodsPotential items were presented to service users in face-to-face structured individual interviews and focus groups. The items were primarily taken or adapted from current measures and covered themes identified from earlier qualitative work as being important to quality of life. Content and thematic analysis was undertaken to identify the types of items which were either important or unacceptable to service users.ResultsWe identified five key themes of the types of items that service users found acceptable or unacceptable; the items should be relevant and meaningful, unambiguous, easy to answer particularly when distressed, do not cause further upset, and be non-judgemental. Importantly, this was from the perspective of the service user.ConclusionsThis research has underlined the importance of service users’ views on the acceptability and validity of items for use in developing a new measure. Whether or not service users favoured an item was associated with their ability or intention to respond accurately and honestly to the item which will impact on the validity and sensitivity of the measure.

BackgroundMental health problems account for almost half of all ill health in people under 65 years. The majority are non-psychotic (e.g. depression, anxiety and phobias). For some people, art therapy may provide more profound and long-lasting healing than more standard forms of treatment, perhaps because it can provide an alternative means of expression and release from trauma. As yet, no formal evaluation of art therapy for non-psychotic mental health disorders has been conducted.AimThis review aimed to evaluate evidence for the clinical effectiveness and cost-effectiveness of art therapy for non-psychotic mental health disorders.MethodsComprehensive literature searches for studies examining art therapy in populations with non-psychotic mental health disorders were performed in major health-related and social science bibliographic databases including MEDLINE, EMBASE, The Cochrane Library, Cumulative Index to Nursing and Allied Health Literature (CINAHL), PsycINFO, Allied and Complementary Medicine Database (AMED) and Applied Social Sciences Index and Abstracts (ASSIA) from inception up to May 2013. A quantitative systematic review of clinical effectiveness, a qualitative review to explore the acceptability, relative benefits and potential harms, and a cost–utility analysis of studies evaluating cost-effectiveness of art therapy were conducted.ResultsIn the quantitative review, 15 randomised controlled trials (RCTs) were included (n = 777). Meta-analysis was not possible because of clinical heterogeneity and insufficient comparable data on outcome measures across studies. A narrative synthesis reports that art therapy was associated with significant positive changes relative to the control group in mental health symptoms in 10 out of the 15 studies. The control groups varied between studies but included wait-list/no treatment, attention placebo controls and psychological therapy comparators. Four studies reported improvement from baseline but no significant difference between groups. One study reported that outcomes were more favourable in the control group. The quality of included RCTs was generally low. In the qualitative review, 12 cohort studies were included (n = 188 service users;n = 16 service providers). Themes relating to benefits of art therapy for service users included the relationship with the therapist, personal achievement and distraction. Areas of potential harms were related to the activation of emotions that were then unresolved, lack of skill of the art therapist and sudden termination of art therapy. The quality of included qualitative studies was generally low to moderate. In the cost-effectiveness review, a de novo model was constructed and populated with data identified from the clinical review. Scenario analyses were conducted allowing comparisons of group art therapy with wait-list control, group art therapy with group verbal therapy, and individual art therapy versus control. Art therapy appeared cost-effective compared with wait-list control with high certainty, although generalisability to the target population was unclear. Verbal therapy appeared more cost-effective than art therapy but there was considerable uncertainty and a sizeable probability that art therapy was more clinically effective. The cost-effectiveness of individual art therapy was uncertain and dependent on assumptions regarding clinical benefit and duration of benefit.ConclusionsFrom the limited available evidence, art therapy was associated with positive effects when compared with a control in a number of studies in patients with different clinical profiles, and it was reported to be an acceptable treatment and was associated with a number of benefits. Art therapy appeared to be cost-effective compared with wait-list but further studies are needed to confirm this finding as well as evidence to inform future cost-effective analyses of art therapy versus other treatments.Study registrationThe study is registered as PROSPERO CRD42013003957.FundingThe National Institute for Health Research Health Technology Assessment programme.

While it is important to treat symptoms, there is growing recognition that in order to help people with mental health problems lead meaningful and fulfilling lives, it is crucial to capture the impact of their conditions on wider aspects of their social lives. We constructed two versions of the Recovering Quality of Life (ReQoL) measure—ReQoL-10 and ReQoL-20—for use in routine settings and clinical trials from a larger pool of items by combining qualitative and quantitative evidence covering six domains. Qualitative evidence was gathered through interviews and focus groups with over 76 service users, clinicians, and a translatability assessment. Psychometric evidence generated from data from over 6200 service users was obtained from confirmatory factor models and item response theory analyses. In this paper we present an approach based on a traffic light pictorial format that was developed to present qualitative and quantitative evidence to a group of service users, clinicians, and researchers to help to make the final selection. This work provides a pragmatic yet rigorous approach to combining qualitative and quantitative evidence to ensure that ReQoL is psychometrically robust and has high relevance to service users and clinicians. This approach can be extended to the development of patient reported outcome measures in general.

Background To provide a model for Public involvement (PI) in instrument development and other research based on lessons learnt in the co-production of a recently developed mental health patient reported outcome measure called Recovering Quality of Life (ReQoL). While service users contributed to the project as research participants, this paper focuses on the role of expert service users as research partners, hence referred to as expert service users or PI. Methods At every stage of the development, service users influenced the design, content and face validity of the measure, collaborating with other researchers, clinicians and stakeholders who were central to this research. Expert service users were integral to the Scientific Group which was the main decision-making body, and also provided advice through the Expert Service User Group . Results During the theme and item generation phase (stage 1) expert service users affirmed the appropriateness of the seven domains of the Patient Reported Outcome Measure (activity, hope, belonging and relationships, self-perception, wellbeing, autonomy, and physical health). Expert service users added an extra 58 items to the pool of 180 items and commented on the results from the face and content validity testing (stage 2) of a refined pool of 88. In the item reduction and scale generation phase (stage 3), expert service users contributed to discussions concerning the ordering and clustering of the themes and items and finalised the measures. Expert service users were also involved in the implementation and dissemination of ReQoL (stage 4). Expert service users contributed to the interpretation of findings, provided inputs at every stage of the project and were key decision-makers. The challenges include additional work to make the technical materials accessible, extra time to the project timescales, including time to achieve consensus from different opinions, sometimes strongly held, and extra costs. Conclusion This study demonstrates a successful example of how PI can be embedded in research, namely in instrument development. The rewards of doing so cannot be emphasised enough but there are challenges, albeit surmountable ones. Researchers should anticipate and address those challenges during the planning stage of the project.