BMJ  2005;330:765 (2 April), doi:10.1136/bmj.38398.500764.8F (published 14 March 2005)

Information in practice

Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success

¹ Division of Clinical Informatics, Department of Community and Family Medicine, Box 2914, Duke University Medical Center, Durham, NC 27710, USA, ² College of Health Sciences, Old Dominion University, Norfolk, VA 23529, USA

Objective To identify features of clinical decision support systems critical for improving clinical practice.

Design Systematic review of randomised controlled trials.

Data sources Literature searches via Medline, CINAHL, and the Cochrane Controlled Trials Register up to 2003; and searches of reference lists of included studies and relevant reviews.

Study selection Studies had to evaluate the ability of decision support systems to improve clinical practice.

Data extraction Studies were assessed for statistically and clinically significant improvement in clinical practice and for the presence of 15 decision support system features whose importance had been repeatedly suggested in the literature.

Results Seventy studies were included. Decision support systems significantly improved clinical practice in 68% of trials. Univariate analyses revealed that, for five of the system features, interventions possessing the feature were significantly more likely to improve clinical practice than interventions lacking the feature. Multiple logistic regression analysis identified four features as independent predictors of improved clinical practice: automatic provision of decision support as part of clinician workflow (P < 0.00001), provision of recommendations rather than just assessments (P = 0.0187), provision of decision support at the time and location of decision making (P = 0.0263), and computer based decision support (P = 0.0294). Of 32 systems possessing all four features, 30 (94%) significantly improved clinical practice. Furthermore, direct experimental justification was found for providing periodic performance feedback, sharing recommendations with patients, and requesting documentation of reasons for not following recommendations.

Conclusions Several features were closely correlated with decision support systems' ability to improve patient care significantly. Clinicians and other stakeholders should implement clinical decision support systems that incorporate these features whenever feasible and appropriate.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Related Article

What makes a good clinical decision support system

Gretchen P Purcell
BMJ 2005 330: 740-741. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

• Kilbridge, P. M., Classen, D. C. (2008). The Informatics Opportunities at the Intersection of Patient Safety and Clinical Informatics. J. Am. Med. Inform. Assoc. 15: 397-407 [Abstract] [Full text]  
• Varonen, H., Kortteisto, T., Kaila, M., for the EBMeDS Study Group, (2008). What may help or hinder the implementation of computerized decision support systems (CDSSs): a focus group study with physicians. Fam Pract 25: 162-167 [Abstract] [Full text]  
• van Wyk, J. T., van Wijk, M. A.M., Sturkenboom, M. C.J.M., Mosseveld, M., Moorman, P. W., van der Lei, J. (2008). Electronic Alerts Versus On-Demand Decision Support to Improve Dyslipidemia Treatment: A Cluster Randomized Controlled Trial. Circulation 117: 371-378 [Abstract] [Full text]  
• Roukema, J., Steyerberg, E. W., van der Lei, J., Moll, H. A. (2008). Randomized Trial of a Clinical Decision Support System: Impact on the Management of Children with Fever without Apparent Source. J. Am. Med. Inform. Assoc. 15: 107-113 [Abstract] [Full text]  
• Fiks, A. G., Grundmeier, R. W., Biggs, L. M., Localio, A. R., Alessandrini, E. A. (2007). Impact of Clinical Alerts Within an Electronic Health Record on Routine Childhood Immunization in an Urban Pediatric Population. Pediatrics 120: 707-714 [Abstract] [Full text]  
• Harrison, M. I., Koppel, R., Bar-Lev, S. (2007). Unintended Consequences of Information Technologies in Health Care An Interactive Sociotechnical Analysis. J. Am. Med. Inform. Assoc. 14: 542-549 [Abstract] [Full text]  
• Vermeulen, L. C., Rough, S. S., Thielke, T. S., Shane, R. R., Ivey, M. F., Woodward, B. W., Pierpaoli, P. G., Thomley, S. M., Borr, C. A., Zilz, D. A. (2007). Strategic approach for improving the medication-use process in health systems: The high-performance pharmacy practice framework. Am J Health Syst Pharm 64: 1699-1710 [Abstract] [Full text]  
• Charney, P. (2007). Computer Technology and the Nutrition Support Professional: Make It Work For You!. Nutr Clin Pract 22: 421-427 [Abstract] [Full text]  
• Klebe, B., Farmer, C., Cooley, R., de Lusignan, S., Middleton, R., O'Donoghue, D., New, J., Stevens, P. (2007). Kidney disease management in UK primary care: guidelines, incentives and Information Technology. Fam Pract 24: 330-335 [Abstract] [Full text]  
• Wright, A., Goldberg, H., Hongsermeier, T., Middleton, B. (2007). A Description and Functional Taxonomy of Rule-based Decision Support Content at a Large Integrated Delivery Network. J. Am. Med. Inform. Assoc. 14: 489-496 [Abstract] [Full text]  
• Crosson, J. C., Ohman-Strickland, P. A., Hahn, K. A., DiCicco-Bloom, B., Shaw, E., Orzano, A. J., Crabtree, B. F. (2007). Electronic Medical Records and Diabetes Quality of Care: Results From a Sample of Family Medicine Practices. Ann Fam Med 5: 209-215 [Abstract] [Full text]  
• Voorham, J., Denig, P., Groningen Initiative to Analyse Type 2 Diabetes Tr, (2007). Computerized Extraction of Information on the Quality of Diabetes Care from Free Text in Electronic Patient Records of General Practitioners. J. Am. Med. Inform. Assoc. 14: 349-354 [Abstract] [Full text]  
• Boord, J. B., Sharifi, M., Greevy, R. A., Griffin, M. R., Lee, V. K., Webb, T. A., May, M. E., Waitman, L. R., May, A. K., Miller, R. A. (2007). Computer-based Insulin Infusion Protocol Improves Glycemia Control over Manual Protocol. J. Am. Med. Inform. Assoc. 14: 278-287 [Abstract] [Full text]  
• Chauhan, U. (2007). Cardiovascular disease prevention in primary care. Br Med Bull 0: ldm002v1-15 [Abstract] [Full text]  
• Dorr, D., Bonner, L. M., Cohen, A. N., Shoai, R. S., Perrin, R., Chaney, E., Young, A. S. (2007). Informatics Systems to Promote Improved Care for Chronic Illness: A Literature Review. J. Am. Med. Inform. Assoc. 14: 156-163 [Abstract] [Full text]  
• Kawamoto, K., Lobach, D. F. (2007). Proposal for Fulfilling Strategic Objectives of the U.S. Roadmap for National Action on Decision Support through a Service-oriented Architecture Leveraging HL7 Services. J. Am. Med. Inform. Assoc. 14: 146-155 [Abstract] [Full text]  
• Osheroff, J. A., Teich, J. M., Middleton, B., Steen, E. B., Wright, A., Detmer, D. E. (2007). A Roadmap for National Action on Clinical Decision Support. J. Am. Med. Inform. Assoc. 14: 141-145 [Abstract] [Full text]  
• Rubin, M. A., Bateman, K., Donnelly, S., Stoddard, G. J., Stevenson, K., Gardner, R. M., Samore, M. H. (2006). Use of a Personal Digital Assistant for Managing Antibiotic Prescribing for Outpatient Respiratory Tract Infections in Rural Communities. J. Am. Med. Inform. Assoc. 13: 627-634 [Abstract] [Full text]  
• Gandhi, T. K., Kachalia, A., Thomas, E. J., Puopolo, A. L., Yoon, C., Brennan, T. A., Studdert, D. M. (2006). Missed and delayed diagnoses in the ambulatory setting: a study of closed malpractice claims.. ANN INTERN MED 145: 488-496 [Abstract] [Full text]  
• Wachter, R. M. (2006). Is ambulatory patient safety just like hospital safety, only without the "stat"?. ANN INTERN MED 145: 547-549 [Full text]  
• Grindrod, K. A, Patel, P., Martin, J. E (2006). What Interventions Should Pharmacists Employ to Impact Health Practitioners' Prescribing Practices?. The Annals of Pharmacotherapy 40: 1546-1557 [Abstract] [Full text]  
• Glazier, R. H., Bajcar, J., Kennie, N. R., Willson, K. (2006). A Systematic Review of Interventions to Improve Diabetes Care in Socially Disadvantaged Populations. Diabetes Care 29: 1675-1688 [Abstract] [Full text]  
• Drew, R. H., Kawamoto, K., Adams, M. B. (2006). Information technology for optimizing the management of infectious diseases. Am J Health Syst Pharm 63: 957-965 [Full text]  
• Morrison, R. S., Meier, D. E., Fischberg, D., Moore, C., Degenholtz, H., Litke, A., Maroney-Galin, C., Siu, A. L. (2006). Improving the management of pain in hospitalized adults.. Arch Intern Med 166: 1033-1039 [Abstract] [Full text]  
• Berner, E. S., Houston, T. K., Ray, M. N., Allison, J. J., Heudebert, G. R., Chatham, W. W., Kennedy, J. I. Jr., Glandon, G. L., Norton, P. A., Crawford, M. A., Maisiak, R. S. (2006). Improving Ambulatory Prescribing Safety with a Handheld Decision Support System: A Randomized Controlled Trial. J. Am. Med. Inform. Assoc. 13: 171-179 [Abstract] [Full text]  
• Reilly, B. M., Evans, A. T. (2006). Translating Clinical Research into Clinical Practice: Impact of Using Prediction Rules To Make Decisions. ANN INTERN MED 144: 201-209 [Abstract] [Full text]  
• Jimbo, M., Nease, D. E. Jr, Ruffin, M. T. IV, Rana, G. K. (2006). Information Technology and Cancer Prevention. CA Cancer J Clin 56: 26-36 [Abstract] [Full text]  
• Samore, M. H., Bateman, K., Alder, S. C., Hannah, E., Donnelly, S., Stoddard, G. J., Haddadin, B., Rubin, M. A., Williamson, J., Stults, B., Rupper, R., Stevenson, K. (2005). Clinical Decision Support and Appropriateness of Antimicrobial Prescribing: A Randomized Trial. JAMA 294: 2305-2314 [Abstract] [Full text]  
• Purcell, G. P (2005). What makes a good clinical decision support system. BMJ 330: 740-741 [Full text]  

Rapid Responses:

Read all Rapid Responses

Decision support systems are beneficial for interventions on specific populations.

Elizabeth A Garthwaite, et al.
bmj.com, 7 Apr 2005 [Full text]