BMJ  2004;329:999 (30 October), doi:10.1136/bmj.329.7473.999

Paper

What's the evidence that NICE guidance has been implemented? Results from a national evaluation using time series analysis, audit of patients' notes, and interviews

¹ Department of Health Sciences, University of York, York YO10 5DD, ² York Health Economics Consortium, University of York, ³ Centre for Health Economics, University of York, ⁴ Bradford Royal Infirmary, Bradford, BD9 6RJ

Objectives To assess the extent and pattern of implementation of guidance issued by the National Institute for Clinical Excellence (NICE).

Design Interrupted time series analysis, review of case notes, survey, and interviews.

Setting Acute and primary care trusts in England and Wales.

Participants All primary care prescribing, hospital pharmacies; a random sample of 20 acute trusts, 17 mental health trusts, and 21 primary care trusts; and senior clinicians and managers from five acute trusts.

Main outcome measures Rates of prescribing and use of procedures and medical devices relative to evidence based guidance.

Results 6308 usable patient audit forms were returned. Implementation of NICE guidance varied by trust and by topic. Prescribing of some taxanes for cancer (P < 0.002) and orlistat for obesity (P < 0.001) significantly increased in line with guidance. Prescribing of drugs for Alzheimer's disease and prophylactic extraction of wisdom teeth showed trends consistent with, but not obviously a consequence of, the guidance. Prescribing practice often did not accord with the details of the guidance. No change was apparent in the use of hearing aids, hip prostheses, implantable cardioverter defibrillators, laparoscopic hernia repair, and laparoscopic colorectal cancer surgery after NICE guidance had been issued.

Conclusions Implementation of NICE guidance has been variable. Guidance seems more likely to be adopted when there is strong professional support, a stable and convincing evidence base, and no increased or unfunded costs, in organisations that have established good systems for tracking guidance implementation and where the professionals involved are not isolated. Guidance needs to be clear and reflect the clinical context.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Relevant Articles

Why promote the findings of single research studies?

Paul Wilson, Mark Petticrew on behalf of the Medical Research Council’s Population Health Sciences Research Network knowledge transfer project team
BMJ 2008 336: 722. [Extract] [Full Text] [PDF]

Transparency in health technology assessments

Alan Maynard
BMJ 2007 334: 594-595. [Extract] [Full Text] [PDF]

How NICE may be outflanked

R E Ferner and Sarah E McDowell
BMJ 2006 332: 1268-1271. [Full Text] [PDF]

Seven years of feast, seven years of famine: boom to bust in the NHS?

Alan Maynard and Andrew Street
BMJ 2006 332: 906-908. [Full Text] [PDF]

What's the evidence that NICE guidance has been implemented?: Analysis is subject to confounding

Colin Tilley, Fay Crawford, Jan Clarkson, Nigel Pitts, and Mary McCann
BMJ 2005 330: 1084-1085. [Extract] [Full Text]

What's the evidence that NICE guidance has been implemented?: Maybe NICE needs to do more to ensure implementation of guidelines

Rishi Mannan and Melvyn Jones
BMJ 2005 330: 1085. [Extract] [Full Text]

What's the evidence that NICE guidance has been implemented?: More recent data on NICE implementation show different picture

Michael Rawlins and Andrew Dillon
BMJ 2005 330: 1086. [Extract] [Full Text]

What's the evidence that NICE guidance has been implemented?: Author's reply

Nick Freemantle
BMJ 2005 330: 1086. [Extract] [Full Text]

NICE influences prescribing but has more to do
BMJ 2004 329: 0. [Full Text] [PDF]

From optimism to hubris

Jane Smith
BMJ 2004 329: 0. [Extract] [Full Text] [PDF]

Is NICE delivering the goods?

Nick Freemantle
BMJ 2004 329: 1003-1004. [Full Text] [PDF]

What has evidence based medicine done for us?

Sharon E Straus and Giselle Jones
BMJ 2004 329: 987-988. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

• Audit, N. P. T. (2008). Impact of NICE guidance on rates of haemorrhage after tonsillectomy: an evaluation of guidance issued during an ongoing national tonsillectomy audit. Qual Saf Health Care 17: 264-268 [Abstract] [Full text]  
• Schlander, M (2008). The use of cost-effectiveness by the National Institute for Health and Clinical Excellence (NICE): no(t yet an) exemplar of a deliberative process. J. Med. Ethics 34: 534-539 [Abstract] [Full text]  
• Wilson, P., Petticrew, M., on behalf of the Medical Research Council's Popula, (2008). Why promote the findings of single research studies?. BMJ 336: 722-722 [Full text]  
• Fenwick, E., Claxton, K., Sculpher, M. (2008). The Value of Implementation and the Value of Information: Combined and Uneven Development. Med Decis Making 28: 21-32 [Abstract]  
• Chidgey, J., Leng, G., Lacey, T. (2007). Implementing NICE guidance. JRSM 100: 448-452 [Full text]  
• Livesey, E. A., Noon, J M. (2007). Implementing guidelines: what works. EDUCATION AND PRACTICE 92: ep129-ep134 [Full text]  
• Armstrong, R., Waters, E., Crockett, B., Keleher, H. (2007). The nature of evidence resources and knowledge translation for health promotion practitioners. HEALTH PROMOT INT 22: 254-260 [Abstract] [Full text]  
• Nicholson, P J (2007). How to undertake a systematic review in an occupational setting. Occup. Environ. Med. 64: 353-358 [Full text]  
• Maynard, A. (2007). Transparency in health technology assessments. BMJ 334: 594-595 [Full text]  
• Grunfeld, E. (2007). Canadian breast cancer guidelines are as effective as possible under the circumstances. CMAJ 176: 785-786 [Full text]  
• Wright, J., Bibby, J., Eastham, J., Harrison, S., McGeorge, M., Patterson, C., Price, N., Russell, D., Russell, I., Small, N., Walsh, M., Young, J. (2007). Multifaceted implementation of stroke prevention guidelines in primary care: cluster-randomised evaluation of clinical and cost effectiveness. Qual Saf Health Care 16: 51-59 [Abstract] [Full text]  
• Drummond, M. F., Mason, A. R. (2007). European Perspective on the Costs and Cost-Effectiveness of Cancer Therapies. JCO 25: 191-195 [Abstract] [Full text]  
• Ferner, R E, McDowell, S. E (2006). How NICE may be outflanked.. BMJ 332: 1268-1271 [Full text]  
• Maynard, A., Street, A. (2006). Seven years of feast, seven years of famine: boom to bust in the NHS?. BMJ 332: 906-908 [Full text]  
• O'Loughlin, C., Darley, J. (2006). Has the referral of older adults with dementia changed since the availability of acetylcholinesterase inhibitors and the NICE guidelines?. Psychiatr. Bull. 30: 131-134 [Abstract] [Full text]  
• Rycroft-Malone, J. (2006). The politics of the evidencebased practice movements: Legacies and current challenges. Journal of Research in Nursing 11: 95-108 [Abstract]  
• Wright, J, Harrison, S, McGeorge, M, Patterson, C, Russell, I, Russell, D, Small, N, Taylor, M, Walsh, M, Warren, E, Young, J (2006). Improving the management and referral of patients with transient ischaemic attacks: a change strategy for a health community. Qual Saf Health Care 15: 9-12 [Abstract] [Full text]  
• Kapur, N. (2005). Management of self-harm in adults: which way now?. Br. J. Psychiatry 187: 497-499 [Abstract] [Full text]  
• Pearson, S. D., Rawlins, M. D. (2005). Quality, Innovation, and Value for Money: NICE and the British National Health Service. JAMA 294: 2618-2622 [Abstract] [Full text]  
• Henry, D. A., Hill, S. R., Harris, A. (2005). Drug Prices and Value for Money: The Australian Pharmaceutical Benefits Scheme. JAMA 294: 2630-2632 [Full text]  
• Lankshear, A J, Sheldon, T A, Lowson, K V, Watt, I S, Wright, J (2005). Evaluation of the implementation of the alert issued by the UK National Patient Safety Agency on the storage and handling of potassium chloride concentrate solution. Qual Saf Health Care 14: 196-201 [Abstract] [Full text]  
• Mannan, R., Jones, M. (2005). What's the evidence that NICE guidance has been implemented?: Maybe NICE needs to do more to ensure implementation of guidelines. BMJ 330: 1085-1085 [Full text]  
• Rawlins, M., Dillon, A. (2005). What's the evidence that NICE guidance has been implemented?: More recent data on NICE implementation show different picture. BMJ 330: 1086-1086 [Full text]  
• Tilley, C., Crawford, F., Clarkson, J., Pitts, N., McCann, M. (2005). What's the evidence that NICE guidance has been implemented?: Analysis is subject to confounding. BMJ 330: 1084-1085 [Full text]  
• Freemantle, N. (2005). What's the evidence that NICE guidance has been implemented?: Author's reply. BMJ 330: 1086-1086 [Full text]  
• Pennington, L., Roddam, H., Burton, C., Russell, I., Russell, D. (2005). Promoting research use in speech and language therapy: a cluster randomized controlled trial to compare the clinical effectiveness and costs of two training strategies. Clin Rehabil 19: 387-397 [Abstract]  
• Speller, V., Wimbush, E., Morgan, A. (2005). Evidence-based health promotion practice: how to make it work. Promotion & Education 12: 15-20  
• Straus, S. E, Jones, G. (2004). What has evidence based medicine done for us?. BMJ 329: 987-988 [Full text]  
• Freemantle, N. (2004). Is NICE delivering the goods?. BMJ 329: 1003-1004 [Full text]  

Rapid Responses:

Read all Rapid Responses

NICE, but too late

Paul WX Foley
bmj.com, 1 Nov 2004 [Full text]

NICE Guidance: Sometimes Inappropriate in a DGH

Christopher F. Loughran
bmj.com, 2 Nov 2004 [Full text]

NICE Guidelines that recommend complex interventions may overlook systemic barriers and resource implications

Philip B Wilkinson
bmj.com, 4 Nov 2004 [Full text]

NICE and Electronic Foetal Monitoring

S Prabha, et al.
bmj.com, 12 Nov 2004 [Full text]

NICE guidelines

Neil R Poulter, et al.
bmj.com, 15 Nov 2004 [Full text]

Being NICE has advantages

Christine E Hine
bmj.com, 18 Nov 2004 [Full text]

Nice Implementation

Rishi Mannan, et al.
bmj.com, 18 Nov 2004 [Full text]

Confounding in the analysis of NICE guideline implementation

Colin J. Tilley, et al.
bmj.com, 2 Dec 2004 [Full text]

Understanding guideline implementation: the contribution of psychology

Susan F Michie, et al.
bmj.com, 31 May 2005 [Full text]