How should we evaluate research on counselling and the treatment of depression? A case study on how the National Institute for Health and Care Excellence's draft 2018 guideline for depression considered what counts as best evidence

Abstract

BackgroundHealth guidelines are developed to improve patient care by ensuring the most recent and ‘best available evidence’ is used to guide treatment recommendations. The National Institute for Health and Care Excellence's (NICE's ) guideline development methodology acknowledges that evidence needed to answer one question (treatment efficacy) may be different from evidence needed to answer another (cost‐effectiveness, treatment acceptability to patients). This review uses counselling in the treatment of depression as a case study, and interrogates the constructs of ‘best’ evidence and ‘best’ guideline methodologies.MethodThe review comprises six sections: (i) implications of diverse definitions of counselling in research; (ii) research findings from meta‐analyses and randomised controlled trials (RCTs); (iii) limitations to trials‐based evidence; (iv) findings from large routine outcome datasets; (v) the inclusion of qualitative research that emphasises service‐user voices; and (vi) conclusions and recommendations.ResultsResearch from meta‐analyses and RCTs contained in the draft 2018 NICE Guideline is limited but positive in relation to the effectiveness of counselling in the treatment for depression. The weight of evidence suggests little, if any, advantage to cognitive behaviour therapy (CBT) over counselling once risk of bias and researcher allegiance are taken into account. A growing body of evidence from large NHS data sets also evidences that, for depression, counselling is as effective as CBT and cost‐effective when delivered in NHS settings.ConclusionSpecifications in NICE's updated guideline procedures allow for data other than RCTs and meta‐analyses to be included. Accordingly, there is a need to include large standardised collected data sets from routine practice as well as the voice of patients via high‐quality qualitative research.

The effects of cognitive behavioural therapy on depression and quality of life in patients with maintenance haemodialysis: a systematic review

“…However, in recent years, a growing number of studies suggest that CBT and counselling have comparable effects [40,41]. Therefore, it is unknown whether the recommendations of NICE guidance would be revised based on these current studies.…”

Teaching and learning evidence‐based practices: Promoting dialogue for counsellors and psychotherapists

“…The emergence of guidelines (for instance, the National Institute for Health and Clinical Excellence) and programmes like the Improving Access to Psychological Therapies (IAPT) have left counsellors feeling their profession is under threat (Cooper & Reeves, ). With programmes offered by the NHS looking to such guidelines to determine what services to offer (Barkham, Moller, & Pybis, ), counsellors drawing on person‐centred frameworks might wonder what their role is in such a system. CP consists of multiple and constantly evolving frameworks.…”

Efficacy and effectiveness studies of depression are not well-differentiated in the literature: a systematic review

“…However, depression CPGs have been criticised for their low validity, poor generalisability and limitations in their implementation 2–4. These criticisms stem in part from over-reliance on the results of published randomised controlled trials (RCTs) 5 6. RCTs enrol highly selected patients who may not be representative of real-world clinical practice.…”