What's the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients' notes, and interviews

Abstract

Objectives To assess the extent and pattern of implementation of guidance issued by the National Institute for Clinical Excellence (NICE). Design Interrupted time series analysis, review of case notes, survey, and interviews. Setting Acute and primary care trusts in England and Wales. Participants All primary care prescribing, hospital pharmacies; a random sample of 20 acute trusts, 17 mental health trusts, and 21 primary care trusts; and senior clinicians and managers from five acute trusts. Main outcome measuresRates of prescribing and use of procedures and medical devices relative to evidence based guidance. Results 6308 usable patient audit forms were returned. Implementation of NICE guidance varied by trust and by topic. Prescribing of some taxanes for cancer (P < 0.002) and orlistat for obesity (P < 0.001) significantly increased in line with guidance. Prescribing of drugs for Alzheimer's disease and prophylactic extraction of wisdom teeth showed trends consistent with, but not obviously a consequence of, the guidance. Prescribing practice often did not accord with the details of the guidance. No change was apparent in the use of hearing aids, hip prostheses, implantable cardioverter defibrillators, laparoscopic hernia repair, and laparoscopic colorectal cancer surgery after NICE guidance had been issued. Conclusions Implementation of NICE guidance has been variable. Guidance seems more likely to be adopted when there is strong professional support, a stable and convincing evidence base, and no increased or unfunded costs, in organisations that have established good systems for tracking guidance implementation and where the professionals involved are not isolated. Guidance needs to be clear and reflect the clinical context.

Impact of the Publication of Appropriate Use Criteria on Utilization Rates of Myocardial Perfusion Imaging Studies in Ontario, Canada: A Population‐Based Study

“…In contrast, publication of the 2005 AUC was not associated with a significant change in rates. This is consistent with previous work documenting that adherence to AUC among clinicians may gradually increase over time 32, 33. We speculate that although the 2005 AUC may have introduced the concept of appropriateness to most clinicians, the 2009 iteration may have cemented the importance of these criteria, ultimately culminating in the effect that we observed.…”

Indications for and anticipated difficulty of third molar surgery: A comparison between a dental hospital and a specialist high street practice

“…2 This, in turn, has meant a reduction in the numbers of third molars removed. 3 Referrals for dentoalveolar surgery are commonly made due to the perceived difficulty of surgery, complicated medical histories and/or a lack of general anaesthetic facilities. 4 The usual referral centre is the nearest district general hospital.…”

Resource Modelling: The Missing Piece of the HTA Jigsaw?

“…Excellence (NICE) in England and Wales, the implementation of positive guidance remains disappointingly low in some circumstances [6]. Figure 1 shows how evidence generation, synthesis and decision making can be seen as forming a matrix with issues of efficacy, effectiveness and value, with the different activities that feed into HTA positioned within this matrix [7].…”