BMJ, doi: 10.1136/bmj.39512.529120.BE, (Published 26 March 2008)

Research

Cumulative funnel plots for the early detection of interoperator variation: retrospective database analysis of observed versus predicted results of percutaneous coronary intervention

¹ Department of Cardiology, James Cook University Hospital, Middlesbrough TS4 3BW

Objective To use funnel plots and cumulative funnel plots to compare in-hospital outcome data for operators undertaking percutaneous coronary interventions with predicted results derived from a validated risk score to allow for early detection of variation in performance.

Design Analysis of prospectively collected data.

Setting Tertiary centre NHS hospital in the north east of England.

Participants Five cardiologists carrying out percutaneous coronary interventions between January 2003 and December 2006.

Main outcome measures In-hospital major adverse cardiovascular and cerebrovascular events (in-hospital death, Q wave myocardial infarction, emergency coronary artery bypass graft surgery, and cerebrovascular accident) analysed against the logistic north west quality improvement programme predicted risk, for each operator. Results are displayed as funnel plots summarising overall performance for each operator and cumulative funnel plots for an individual operator’s performance on a case series basis.

Results The funnel plots for 5198 patients undergoing percutaneous coronary interventions showed an average observed rate for major adverse cardiovascular and cerebrovascular events of 1.96% overall. This was below the predicted risk of 2.06% by the logistic north west quality improvement programme risk score. Rates of in-hospital major adverse cardiovascular and cerebrovascular events for all operators were within the 3 upper control limit of 2.75% and 2 upper warning limit of 2.49%.

Conclusion The overall in-hospital major adverse cardiovascular and cerebrovascular events rates were under the predicted event rate. In-hospital rates after percutaneous coronary intervention procedure can be monitored successfully using funnel and cumulative funnel plots with 3 control limits to display and publish each operator’s outcomes. The upper warning limit (2 control limit) could be used for internal monitoring. The main advantage of these charts is their transparency, as they show observed and predicted events separately. By this approach individual operators can monitor their own performance, using the predicted risk for their patients but in a way that is compatible with benchmarking to colleagues, encapsulated by the funnel plot. This methodology is applicable regardless of variations in individual operator case volume and case mix.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    StumbleUpon    Technorati    What's this?

Relevant Articles

How to improve surgical outcomes

Peter J E Holt, Jan D Poloniecki, and Matt M Thompson
BMJ 2008 336: 900-901. [Extract] [Full Text] [PDF]

Mortality data in adult cardiac surgery for named surgeons: retrospective examination of prospectively collected data on coronary artery surgery and aortic valve replacement

Ben Bridgewater on behalf of the adult cardiac surgeons of north west England
BMJ 2005 330: 506-510. [Abstract] [Full Text] [PDF]

Surgeon specific mortality in adult cardiac surgery: comparison between crude and risk stratified data

Ben Bridgewater, Anthony D Grayson, Mark Jackson, Nicholas Brooks, Geir J Grotte, Daniel J M Keenan, Russell Millner, Brian M Fabri, and Mark Jones
BMJ 2003 327: 13-17. [Abstract] [Full Text] [PDF]

This article has been cited by other articles:

• Rakow, T., Miler, K. (2009). Doomed to repeat the successes of the past: History is best forgotten for repeated choices with nonstationary payoffs. Mem Cognit 37: 985-1000 [Abstract]  
• Noyez, L. (2009). Control charts, Cusum techniques and funnel plots. A review of methods for monitoring performance in healthcare. ICVTS 9: 494-499 [Abstract] [Full text]  
• Noyez, L. (2009). Editorial comment: Quality measurement in adult cardiac surgery: a challenge. Eur. J. Cardiothorac. Surg. 35: 758-759 [Full text]  

Online poll

Find out more>>