BMJ  2004;328:199 (24 January), doi:10.1136/bmj.328.7433.199

Paper

Comparison of three methods for estimating rates of adverse events and rates of preventable adverse events in acute care hospitals

¹ Comité de Coordination de l'Evaluation Clinique et de la Qualité en Aquitaine, Hôpital Xavier Arnozan, 33604 Pessac, France

Objectives To compare the effectiveness, reliability, and acceptability of estimating rates of adverse events and rates of preventable adverse events using three methods: cross sectional (data gathered in one day), prospective (data gathered during hospital stay), and retrospective (review of medical records).

Design Independent assessment of three methods applied to one sample.

Setting 37 wards in seven hospitals (three public, four private) in southwestern France.

Participants 778 patients: medical (n = 278), surgical (n = 263), and obstetric (n = 237).

Main outcome measures The main outcome measures were the proportion of cases (patients with at least one adverse event) identified by each method compared with a reference list of cases confirmed by ward staff and the proportion of preventable cases (patients with at least one preventable adverse event). Secondary outcome measures were inter-rater reliability of screening and identification, perceived workload, and face validity of results.

Results The prospective and retrospective methods identified similar numbers of medical and surgical cases (70% and 66% of the total, respectively) but the prospective method identified more preventable cases (64% and 40%, respectively), had good reliability for identification ( = 0.83), represented an acceptable workload, and had higher face validity. The cross sectional method showed a large number of false positives and identified none of the most serious adverse events. None of the methods was appropriate for obstetrics.

Conclusion The prospective method of data collection may be more appropriate for epidemiological studies that aim to convince clinical teams that their errors contribute significantly to adverse events, to study organisational and human factors, and to assess the impact of risk reduction programmes.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    StumbleUpon    Technorati    What's this?

Relevant Articles

Rate of undesirable events at beginning of academic year: retrospective cohort study

Guy Haller, Paul S Myles, Patrick Taffé, Thomas V Perneger, and Christopher L Wu
BMJ 2009 339: b3974. [Abstract] [Full Text] [PDF]

Clinical leadership in the provision of hospital care

Sisse Olsen and Graham Neale
BMJ 2005 330: 1219-1220. [Extract] [Full Text] [PDF]

Prospective collection of data provides better assessment of risk
BMJ 2004 328: 0. [Full Text] [PDF]

This article has been cited by other articles:

• Haller, G., Myles, P. S, Taffe, P., Perneger, T. V, Wu, C. L (2009). Rate of undesirable events at beginning of academic year: retrospective cohort study. BMJ 339: b3974-b3974 [Abstract] [Full text]  
• Smits, M, Wagner, C, Spreeuwenberg, P, van der Wal, G, Groenewegen, P P (2009). Measuring patient safety culture: an assessment of the clustering of responses at unit level and hospital level. Qual Saf Health Care 18: 292-296 [Abstract] [Full text]  
• Zegers, M, de Bruijne, M C, Wagner, C, Hoonhout, L H F, Waaijman, R, Smits, M, Hout, F A G, Zwaan, L, Christiaans-Dingelhoff, I, Timmermans, D R M, Groenewegen, P P, van der Wal, G (2009). Adverse events and potentially preventable deaths in Dutch hospitals: results of a retrospective patient record review study. Qual Saf Health Care 18: 297-302 [Abstract] [Full text]  
• Smits, M., Janssen, J., de Vet, R., Zwaan, L., Timmermans, D., Groenewegen, P., Wagner, C. (2009). Analysis of unintended events in hospitals: inter-rater reliability of constructing causal trees and classifying root causes. Int J Qual Health Care 21: 292-300 [Abstract] [Full text]  
• Mendes, W., Martins, M., Rozenfeld, S., Travassos, C. (2009). The assessment of adverse events in hospitals in Brazil. Int J Qual Health Care 21: 279-284 [Abstract] [Full text]  
• Soop, M., Fryksmark, U., Koster, M., Haglund, B. (2009). The incidence of adverse events in Swedish hospitals: a retrospective medical record review study. Int J Qual Health Care 21: 285-291 [Abstract] [Full text]  
• Camire, E., Moyen, E., Stelfox, H. T. (2009). Medication errors in critical care: risk factors, prevention and disclosure. CMAJ 180: 936-943 [Full text]  
• Aranaz-Andres, J M, Aibar-Remon, C, Vitaller-Murillo, J, Ruiz-Lopez, P, Limon-Ramirez, R, Terol-Garcia, E, the ENEAS work group, (2008). Incidence of adverse events related to health care in Spain: results of the Spanish National Study of Adverse Events. J. Epidemiol. Community Health 62: 1022-1029 [Abstract] [Full text]  
• Brown, C, Hofer, T, Johal, A, Thomson, R, Nicholl, J, Franklin, B D, Lilford, R J (2008). An epistemology of patient safety research: a framework for study design and interpretation. Part 3. End points and measurement. Qual Saf Health Care 17: 170-177 [Abstract] [Full text]  
• Hogan, H, Olsen, S, Scobie, S, Chapman, E, Sachs, R, McKee, M, Vincent, C, Thomson, R (2008). What can we learn about patient safety from information sources within an acute hospital: a step on the ladder of integrated risk management?. Qual Saf Health Care 17: 209-215 [Abstract] [Full text]  
• de Vries, E N, Ramrattan, M A, Smorenburg, S M, Gouma, D J, Boermeester, M A (2008). The incidence and nature of in-hospital adverse events: a systematic review. Qual Saf Health Care 17: 216-223 [Abstract] [Full text]  
• Sari, A. B.-A., Sheldon, T. A, Cracknell, A., Turnbull, A., Dobson, Y., Grant, C., Gray, W., Richardson, A. (2007). Extent, nature and consequences of adverse events: results of a retrospective casenote review in a large NHS hospital. Qual Saf Health Care 16: 434-439 [Abstract] [Full text]  
• Marang-van de Mheen, P. J., Hollander, E.-J. F., Kievit, J. (2007). Effects of study methodology on adverse outcome occurrence and mortality. Int J Qual Health Care 19: 399-406 [Abstract] [Full text]  
• Michel, P., Quenon, J. L., Djihoud, A., Tricaud-Vialle, S., de Sarasqueta, A. M. (2007). French national survey of inpatient adverse events prospectively assessed with ward staff. Qual Saf Health Care 16: 369-377 [Abstract] [Full text]  
• Wasson, J. H, MacKenzie, T. A, Hall, M. (2007). Patients use an internet technology to report when things go wrong. Qual Saf Health Care 16: 213-215 [Abstract] [Full text]  
• Olsen, S., Neale, G., Schwab, K., Psaila, B., Patel, T., Chapman, E J., Vincent, C. (2007). Hospital staff should use more than one method to detect adverse events and potential adverse events: incident reporting, pharmacist surveillance and local real-time record review may all have a place. Qual Saf Health Care 16: 40-44 [Abstract] [Full text]  
• Szekendi, M K, Sullivan, C, Bobb, A, Feinglass, J, Rooney, D, Barnard, C, Noskin, G A (2006). Active surveillance using electronic triggers to detect adverse events in hospitalized patients.. Qual Saf Health Care 15: 184-190 [Abstract] [Full text]  
• Marang-van de Mheen, P J, van Hanegem, N, Kievit, J (2005). Effectiveness of routine reporting to identify minor and serious adverse outcomes in surgical patients. Qual Saf Health Care 14: 378-382 [Abstract] [Full text]  
• Walsh, K E, Kaushal, R, Chessare, J B (2005). How to avoid paediatric medication errors: a user's guide to the literature. Arch. Dis. Child. 90: 698-702 [Abstract] [Full text]  
• Olsen, S., Neale, G. (2005). Clinical leadership in the provision of hospital care. BMJ 330: 1219-1220 [Full text]  
• Amalberti, R., Auroy, Y., Berwick, D., Barach, P. (2005). Five System Barriers to Achieving Ultrasafe Health Care. ANN INTERN MED 142: 756-764 [Abstract] [Full text]  
• Baker, G R (2004). HARVARD MEDICAL PRACTICE STUDY. Qual Saf Health Care 13: 151-152 [Full text]  

Rapid Responses:

Read all Rapid Responses

Issues on prospective method for estimating rates of adverse events

Dr Ali Baba-Akbari Sari
bmj.com, 26 Jan 2004 [Full text]

Prevention : the next step in the measurement of adverse events

Guy Haller, et al.
bmj.com, 5 Feb 2004 [Full text]

Other methods for rates of adverse events?

Roberto Natangelo
bmj.com, 20 Feb 2004 [Full text]

Comparison of Paired Proportions

Sanjeev Sarmukaddam, et al.
bmj.com, 1 Feb 2009 [Full text]

Online poll

Find out more >>