Variation in reoperation after colorectal surgery in England as an indicator of surgical performance: retrospective analysis of Hospital Episode StatisticsBMJ 2011; 343 doi: http://dx.doi.org/10.1136/bmj.d4836 (Published 16 August 2011) Cite this as: BMJ 2011;343:d4836
- Elaine M Burns, clinical research fellow1,
- Alex Bottle, lecturer in medical statistics2,
- Paul Aylin, clinical reader in epidemiology and public heath2,
- Ara Darzi, professor of surgery1,
- R John Nicholls, professor of surgery1,
- Omar Faiz, senior lecturer and honorary consultant colorectal surgeon1
- 1Department of Surgery, Imperial College, St Mary’s Hospital, London W21NY, UK
- 2Dr Foster Unit, Department of Primary Care and Public Health, School of Public Health, Imperial College, London EC1A 9LA
- Correspondence to: O Faiz
- Accepted 15 June 2011
Objective To describe national reoperation rates after elective and emergency colorectal resection and to assess the feasibility of using reoperation as a quality indicator derived from routinely collected data in England.
Design Retrospective observational study of Hospital Episode Statistics (HES) data.
Setting HES dataset, an administrative dataset covering the entire English National Health Service.
Participants All patients undergoing a primary colorectal resection in England between 2000 and 2008.
Main outcome measures Reoperation after colorectal resection, defined as any reoperation for an intra-abdominal procedure or wound complication within 28 days of surgery on the index or subsequent admission to hospital.
Results The national reoperation rate was 6.5% (15 986/246 469). A large degree of variation was identified among institutions and surgeons. Even among institutions and surgical teams with high caseloads, threefold and fivefold differences in reoperation rates were observed between the highest and lowest performing trusts and surgeons. Of the NHS trusts studied, 14.1% (22/156) had adjusted reoperation rates above the upper 99.8% control limit. Factors independently associated with higher risk of reoperation were diagnosis of inflammatory bowel disease (odds ratio 1.33 (95% CI 1.24 to 1.42), P<0.001), presence of multiple comorbidity (odds ratio 1.34 (1.29 to 1.39), P<0.001), social deprivation (1.14 (1.08 to 1.20) for most deprived, P<0.001), male sex (1.33 (1.29 to 1.38), P<0.001), rectal resection (1.63 (1.56 to 1.71), P<0.001), laparoscopic surgery (1.11 (1.03 to 1.20), P=0.006), and emergency admission (1.21 (1.17 to 1.26), P<0.001).
Conclusions There is large variation in reoperation after colorectal surgery between hospitals and surgeons in England. If data accuracy can be assured, reoperation may allow performance to be checked against national standards from current routinely collected data, alongside other indicators such as mortality.
Colorectal surgery is associated with sizeable morbidity1 and, for emergency surgery, considerable mortality.2 There is considerable variation between individuals and institutions in colorectal surgical practice and outcome.3 4 5 Such variability is increasingly unacceptable to clinicians, healthcare managers, commissioners, and patients. Describing this variation in performance is an important first step to allow quality assessment and subsequent improvement. If we want to eliminate variation in surgical practice and improve standards we need specific indicators that reflect discrete parts of the patient journey. Postoperative mortality is currently one of the most widely recognised indicators of quality.5 However, in isolation, the use of mortality as a quality marker is limited. For elective surgery, postoperative death is rare, making it an insensitive alert to poor performance and requiring many cases before meaningful outliers can be identified. Furthermore, common definitions do not discriminate between all deaths and those that are potentially preventable. Finally, many failures in care do not always lead to death. Therefore, in addition to mortality, a range of indicators that offer an insight into genuine quality deficiencies among providers is required.
Postoperative reoperation has been suggested as a useful quality marker in the United States for general surgery6 and more recently for colorectal surgery.7 8 Reoperations after colorectal surgery are undertaken mostly for surgical morbidity such as postoperative bleeding or anastomotic leaks. Reoperation is associated with poor clinical outcome, including higher risk of early death and local recurrence as well as poorer overall survival.9 Reoperation, when taken alongside other accepted indicators such as mortality, potentially offers a sensitive and relevant marker of surgical quality. For a quality indicator to be usable there must be data available from which it can be measured. In the United Kingdom, nationwide administrative data that include all patients admitted to National Health Service (NHS) hospitals are collected. The availability and comprehensive coverage of these datasets make them an attractive potential source for measuring performance.
This study aims to describe national reoperation rates after colorectal resection and to investigate the feasibility of using reoperation rate as a quality indicator derived from routinely collected data.
Hospital Episode Statistics
A description of the Hospital Episode Statistics (HES) database has been published previously.10 It is an administrative dataset that collates information on all NHS and private patients admitted to NHS hospitals in England. Each admission contains a primary diagnosis and now up to 19 secondary diagnoses, categorised according to ICD-10 (international classification of diseases, 10th revision), and up to 24 procedure fields coded using OPCS-4 (Office of Population Censuses and Surveys Classification of Surgical Operations and Procedures 4th revision). The Charlson comorbidity index derived from the secondary diagnosis codes is a marker of comorbidity and was originally formulated to predict mortality.11 The Carstairs index of deprivation is derived from the patient’s postcode.12 Deaths within 365 days are derived through linkage between HES records and the Office of National Statistics and are available in this dataset for patients admitted to hospital between 1 April 2000 and 31 March 2005 because of a delay in linkage.13
Database inclusions and variable coding
All adult patients undergoing primary colorectal resections were included from 1 April 2000 to 31 March 2008. Any of these patients who had undergone a previous colorectal resection between 1996 and 2000 was excluded from the analysis. The first resection that the patient underwent between 2000 and 2008 was considered as the primary resection.
They were categorised according to the site of resection (OPCS-4 coding) as shown in table 1⇓. A laparoscopic procedure was considered to be any procedure associated with OPCS-4 codes Y50.8, Y75, or Y71.4 (Y71.4 (failed minimal access) was introduced in 2006). Procedures coded to failed minimal access were considered in the laparoscopic group for analysis.
Individual diagnoses were recoded into major diagnostic categories according to ICD-10 code as follows: C18, C19, C20, C21, and C26 for malignant disease; K51 for ulcerative colitis; K50 for Crohn’s disease; and K57 for diverticular disease. The remaining codes were classified as “other.” Patients were grouped into four age cohorts: 17–54, 55–69, 70–79, and >79 years according to age at time of surgery. The Charlson comorbidity score was considered in three categories: 0, 1–4, and ≥5. A hospital trust may comprise several sites. Because of mergers, hospital trust codes were unified to reflect their status as of April 2008.
Reoperation was defined as any reoperation for an intra-abdominal procedure or wound complication on the index admission or on a subsequent admission to hospital within 28 days of the initial resection. Reoperation rates were classified according to type of operation. These were divided into laparotomy (considered as a reopening of abdomen, washout of abdomen, small bowel resection, further colorectal resection, open procedure for intra-abdominal abscess, division of adhesions, and formation of stoma), stoma complications (considered as an operation on a stoma, excluding closure of stoma and stoma formation), wound complications requiring reoperation, and “other” (for other reasons for reoperation).
We ascertained 30 day mortality in hospital and 365 day total postoperative mortality (for all causes in both cases). Patients from the study years after March 2005 were excluded from the analysis of 365 day mortality.
Length of stay is the time (in days) spent in hospital during the primary admission for colorectal resection. Median length of stay (with interquartile range) is referred to in unadjusted analyses.
Readmission refers to emergency (unplanned) readmission to hospital within 28 days of the index admission for any reason.
To reduce the potential impact of coding errors and capture the true caseload of the hospital trusts and consultant teams for the construction of the funnel plots, we included only those trusts that performed >10 resections over the period and consultant teams that performed ≥5 resections over the period. Anonymised identifiers were used to calculate readmission rates for individual consultant teams and hospital trusts. Patients were coded according to the consultant team and trust assigned to the episode with the index procedure.
Categorical variables were investigated with the χ2 test. Logistic regression analysis was used to investigate postoperative reoperation rate. Factors with a significance level of ≤0.1 on bivariate analysis were included in the regression analyses.
Statistical analyses were carried out with SPSS version 18.0 (SPSS, Chicago, Illinois, USA). For tests of significance, P values <0.05 was considered significant. For non-normal variables, the median and interquartile range are given. We constructed funnel plots using exact Poisson control limits by means of the web tool available at www.erpho.org.uk/topics/tools/funnel.aspx.
Between 1 April 2000 and 31 March 2008, 246 469 patients who underwent a primary colorectal resection in 175 English hospital trusts were included. Of these, 158 847 (64.4%) patients underwent resection during an elective admission, 87 472 (35.5%) were emergency admissions, and 150 had no record of their admission status. Table 2⇓ summarises the characteristics of elective and emergency patients undergoing resection included in this study and the relative numbers of elective patients undergoing open and laparoscopic procedures.
The overall postoperative reoperation rate for all patients undergoing colorectal resection irrespective of admission status was 6.5% (15 986/246 469). Of these, 13 227 (82.7%) required a reoperation on their primary admission. The remaining 2759 patients underwent a subsequent admission that included a reoperation. Emergency patients experienced slightly higher rates of reoperation than elective patients (7.0% (6156/87 472) v 6.2% (9819/158 847), P<0.001). A total of 11 536 (4.7%) underwent re-laparotomy after colorectal resection, 1560 (0.6%) experienced a subsequent stoma related complication requiring surgery, and 3861 (1.6%) had a wound complication requiring reoperation. Overall, for both elective and emergency patients, those who had a resection attempted by a minimal access approach had a marginally higher rate of reoperation than those who had undergone an open approach (laparoscopic 7.0% (799/11 359) v open 6.5% (15 187/235 110), P=0.015). Table 3⇓ shows the reasons for reoperation, and table 4⇓ lists the characteristics of the patients who required reoperation.
Patient characteristics and reoperation
Table 5⇓ describes the predictors of reoperation in patients who underwent colorectal resection, including multiple regression analyses for patients undergoing reoperation for laparotomy specifically. On multiple regression analysis, younger age, a diagnosis of inflammatory bowel disease, increasing comorbidity, male sex, rectal and total resection, a laparoscopic approach, and emergency admission were independent predictors of both reoperation and laparotomy after surgery (table 5⇓). Increasing social deprivation predicted a higher reoperation rate but was not significant for laparotomy.
Correlation with other outcome measures
Elective and emergency patients who experienced a complication requiring reoperation during their initial admission had a prolonged median length of stay (for elective patients, length of stay 27 (interquartile range 17–43) days with reoperation (n=7873) v 11 (9–16) days with no reoperation (n=150 974), P<0.001; for emergency patients, length of stay 34 (21–55) days with reoperation (n=5401) v 17 (11–28) days with no reoperation (n=82 071), P<0.001). They also had a higher rate of postoperative mortality (elective patients, 938/7873 (11.9%) with reoperation v 4399/150 974 (2.9%) with no reoperation, P<0.001; emergency patients, 1251/5346 (23.4%) with reoperation v 12 511/82 126 (15.2%) with no reoperation, P<0.001).
The increased mortality after reoperation persisted in multiple regression analysis (table 6⇓). One year mortality was available from April 2000 to March 2004. Patients who experienced a complication requiring reoperation either on the index admission or a subsequent admission within 28 days of surgery had an increased one year mortality (for elective patients, mortality 1353/57 546 (23.9%) with reoperation v 10 162/89 800 (11.3%) with no reoperation, P<0.001; for emergency patients, mortality 1477/3693 (40.0%) with reoperation v 15 030/50 822 (29.6%) with no reoperation, P<0.001). Elective patients who required a reoperation on the index admission had a higher emergency readmission rate within 28 days of discharge after this index admission (947/7873 (12.0%) with reoperation v 13 777/150 974 (9.1%) with no reoperation, P<0.001).
Variation in reoperation between surgeons and hospital trusts
Exclusion of trust and surgeon codes that failed to meet the minimum volume inclusion criteria equated to 19 trusts (37 patients (0.02%)) and 4185 consultant codes (6853 patients (2.8%)). Of the patients excluded in the analysis of surgeon codes, 72.2% were assigned to an emergency admission.
For included consultant teams, reoperation rates after elective procedures varied between none and 50%. Variation between trusts for all procedures was between none and 17%. Figures 1⇓ and 2⇓ show funnel plots of the adjusted reoperation rates among consultant teams and NHS trusts. Wide variation in reoperation rates can be observed across all caseloads.
Of the 156 included trusts, 22 had adjusted reoperation rates outside (that is, above) the 99.8% control limit, which corresponds to 3 standard deviations above the mean. For 156 trusts, 0.16 trust outliers at this threshold could be expected to arise through chance alone, assuming a purely binomial distribution for the reoperations. Eleven (0.7%) of the 1557 included consultant teams had elective reoperation rates above the 99.8% control limit, while 1.6 consultant team outliers at this threshold would be expected through chance alone.
Even at a high caseload, however, there was substantial variation in both the trust and surgeon team reoperation rates. There was a fivefold difference in highest and lowest reoperation rates after elective surgery (14.9% v 2.8%) among the surgical teams performing >500 procedures. There was a threefold difference in reoperation rates in trusts performing >2500 procedures during the study period (11.5% v 3.7%).
We report national reoperation rates after major colorectal resection in England. Reoperation represents a possible performance indicator that could be derived from existing data sources. Moreover, we have shown the feasibility of using routinely collected data to measure institutional and surgeon reoperation rates on a national scale and demonstrated substantial variation in reoperation rates between providers of colorectal services. The methodology underpinning this indicator is widely applicable to other surgical specialties. If coding accuracy can be assured, we suggest that reoperation rates, along with existing quality indicators such as mortality, could offer a powerful means of checking quality of surgical care.
Comparison with other studies
The reoperation rates described in this study are consistent with those found by studies from the American Surveillance, Epidemiology and End Results (SEER) and the National Surgical Quality Improvement Programme data.7 14 15 We feel that our method of deriving reoperation rates from the UK administrative dataset used in this study is a valid way of investigating postoperative outcome. Data from individual hospitals are submitted centrally from local institution administrative computer systems. Thus, these systems could potentially be used for real time monitoring of postoperative outcome in a reproducible way through existing institution databases. Since clinical coders enter the data rather than the clinical teams caring for patients, the data have a degree of objectivity. Moreover, the data represent an opportunity to report the outcome of all resections performed by all surgeons in the entire country.
Outliers existed throughout the spectrum of institutional and surgical team caseload, suggesting that increasing caseload may not necessarily lead to an improvement in outcome. Increasing caseload among those providers who have good outcomes rather than increasing volume indiscriminately may lead to greater quality improvements. The uses of an indicator such as reoperation are not limited to colorectal surgery. The longitudinal methodology used in this study is easily applicable across a range of surgical specialties that are associated with high morbidity such as upper gastrointestinal or vascular surgery.
For a quality indicator to be valid, it must be reliable. We consider the methodology used in this study to be reliable. Although clinical registry and administrative datasets are incomplete and contain a degree of error, administrative data in England include all patients admitted to hospital. In addition, a systematic review suggested that the accuracy of procedure coding of UK administrative data was 97%.16 Moreover, Hospital Episode Statistics data have compared favourably with clinical registry data,17 18 19 20 and it is widely accepted that the accuracy of data recording is improving.
For a quality marker to be useable, it needs to reflect adequately the likely variation due to patient factors. In the current study, elective patients selected for a laparoscopic approach experienced relatively high reoperation rates, with 7.1% of elective laparoscopic patients requiring reoperation after the primary resection. A study of National Surgical Quality Improvement Programme data by Bilimoria and colleagues found equivalent reoperation rates in patients having laparoscopic or open surgery (5.5% v 5.8%, P=0.79),15 but this study was limited to elective cancer patients undergoing colectomy. A further study using National Surgical Quality Improvement Programme data, examining outcome following colectomy for all diagnoses, found a similar small increase in the adjusted reoperation rate following laparoscopic resection when compared with the open approach (OR=1.78, p=0.002).21 Further studies are required to see if this increase in reoperation rate is a result of laparoscopy itself or temporal factors. Laparoscopy has been shown to correlate with improved mortality, morbidity, and length of stay following colectomy.10 These data concerning the possible risk of reoperation will allow surgeons and patients to make more informed decisions about management options.
Increasing socioeconomic deprivation is associated with higher reoperation rates and has been shown to be a factor in determining the type of surgery that patients undergo. Patients from areas of increased social deprivation are more likely to undergo an abdominoperineal resection than others.3 22 Poorer survival after treatment of colorectal cancer, especially after surgical resection, has been found.10 23 The disparity in outcome seen in this study may reflect severity of disease at presentation or other unquantified characteristics. The increase in reoperation rates with increasing socioeconomic deprivation suggests that work is required to redress this inequality through quality improvement and early detection of disease.
Although older patients have been shown to have poorer postoperative mortality24 and increased morbidity such as postoperative medical complications, older patients have not been found to have higher reoperation rates.25 This may reflect a reluctance of surgeons to take older patients back to theatre after surgery. Older patients may not be fit for a further procedure or may die before returning to theatre after a complication. Further research is required to target decision making among surgeons treating older patients.
Other indicators of quality have been suggested in colorectal surgery, including structural indicators such as operative caseload and process indicators such as abdominoperineal excision rate for rectal cancer, quality of mesorectal excision and circumferential resection margin positivity rate, lymph node yield, and preoperative use of neoadjuvant therapy.26 In addition to mortality, proposed outcome indicators include readmission rates, duration of hospital stay, and long term markers of oncological success (local recurrence and survival). It is necessary to ensure that quality indicators reflect the proficiency of appropriate professional groups within a multidisciplinary team. To improve performance among surgeons, measurement of factors that are within surgeons’ remit (such as reoperation rate, intraoperative blood loss, and abdominoperineal excision rate) is relevant. It is important to recognise, however, that some indicators (such as lymph node harvest, adjuvant chemotherapy rate) also reflect the performance of affiliated professionals. Quality improvement in these domains therefore demands a multiprofessional approach.
Reoperation potentially reflects an important aspect of quality of perioperative surgical care. Reoperation often occurs for reasons of surgical morbidity, such as postoperative bleeding and anastomotic leaks. The need for reoperation significantly increases postoperative mortality in the short term (table 5⇑). Reoperation is also associated with poor long term outcome, including higher risk of local recurrence and poorer overall survival where resection has been undertaken for cancer. There are, however, many possible reasons why a surgeon or hospital trust may erroneously achieve outlier status, including data quality or operative case mix. Genuine outlier status must therefore be confirmed by excluding easily explainable sources of variance.
Strengths and limitations of the study
The advantage of this administrative dataset is that it provides a comprehensive overview of current colorectal practice in England. By including all patients admitted to NHS hospitals in England, any submission bias is avoided. The dataset, although prospectively collected, includes all patients undergoing surgery without standardisation of treatment, and selection bias of procedure or management by individual surgeons or trusts cannot be excluded. The dataset lacks clinical information such as disease severity that would allow a more refined risk adjustment for comparison of institutions or surgeons. Information such as cancer stage, which has been suggested to affect the risk of poor outcome such as anastomotic leakage, is not available on this dataset.27 It is, however, feasible to link the Hospital Episode Statistics database with cancer registry data.5 This approach would enable application of our proposed methodology to a linked dataset that offered improved adjustment for case mix in cancer cases.
The primary explanatory variables that predicted for surgical outcome included comorbidity, diagnosis, and age. We did not include training centre as a confounder. It could be argued that service quality should be maintained by an institution irrespective of training status in a public system such as the NHS.
Derivation of the reoperation rates in this study relied on the secondary procedure codes. The accuracy of secondary codes may be less than that of the primary codes. The Charlson score, which is also based on secondary diagnosis coding, was used to adjust for comorbidity in the population. Although originally derived to predict mortality, the Charlson index has been shown to be valid for comorbidity adjustment in patients with colorectal cancer.28 The Charlson score has also been used to adjust for comorbidity in predicting surgical complications in the United States.29
Datasets that contain physiological data, such as the National Surgical Quality Improvement Programme data, may provide superior risk adjustment. A bespoke dataset in the United Kingdom would, however, be required to link Hospital Episode Statistics data with this information along with other factors such as disease severity. Linkage of routinely collected data to other datasets, such as the cancer registry, has been done previously.3 5 Future linkage with other data sources will permit improved adjustment for case mix. It is not possible to ascertain, however, whether this refinement in risk adjustment would alter the adjusted reoperation rates to the extent that different outliers would be identified.
Trusts may vary in the accuracy to which they record secondary procedures or diagnosis codes. Some of the variability between trusts seen in this study may reflect differences in local coding practices.
The OPCS-4 code for conversion of a minimal access to an open procedure was introduced in 2006. Any such cases before the introduction of this code will not have been captured as conversions, and they may have been included in the open surgery group of patients before 2006. For the purposes of this analysis, cases converted to open procedure and those coded to the laparoscopic code were considered together as the laparoscopic group.
For this analysis, given the inclusion of emergency patients, patients coded to a Hartmann’s procedure (H33.5) were included in the group who underwent left sided resection. Most of these cases had a diagnosis of diverticular disease, and we therefore thought these resections were more likely to be sigmoid resections rather than true rectal resections.
Surgical complications that do not require reoperation, such as wound infection treated by antibiotics, are not included in this study. Interventional radiological procedures such as image guided drain insertion are also not included. Thus the total surgical morbidity that may have an impact on outcome, including length of stay and mortality, will be underestimated in this study.
Surgeons may differ in their threshold for taking patients back to theatre, reflecting differences in surgeon level reoperation rates. Furthermore, in this study all reoperations were included as it was not possible to differentiate between those that were planned and those that were unplanned. A small minority of the reoperations will represent a planned “second look” procedure.
Conclusion and policy implications
This study supports the feasibility of using reoperation rate as a quality indicator derived from routinely collected data. If data accuracy can be assured, this methodology may permit national performance assessment using reoperation alongside other indicators such as mortality and will be easily transferable across a range of surgical specialties. Initiatives to improve surgical performance should be focused on reducing inexplicable observed variation in reoperation after major resectional colorectal surgery.
What is already known on this topic
Reoperation rate has been suggested as a quality indicator of surgery in the United States
To check performance and quality in colorectal surgery, other quality indicators are needed in addition to mortality and need to be evidence based
What this study adds
This study of Hospital Episode Statistics data for reoperation after colorectal resection showed considerable variation in reoperation rates in English NHS hospitals
Inflammatory bowel disease, multiple other comorbidity, increasing social deprivation, male sex, rectal resection, use of laparoscopic surgery, and emergency admission were independently associated with higher risk of reoperation
Reoperation after colorectal surgery is a possible quality indicator to be used alongside existing indicators such as mortality
Cite this as: BMJ 2011;343:d4836
A portion of this work based on the same dataset has been presented at the European Society of Coloproctology meeting, Sorrento, September 2010; the Association of Coloproctology of Great Britain and Ireland meeting, Birmingham, June 2011; and the Tripartite Colorectal meeting, Cairns, July 2011.
Contributors: EMB performed all analyses, developed the concept, and produced the manuscript. AB developed the concept, provided statistical advice, and edited the manuscript. PA developed the concept, provided statistical advice, and edited the manuscript. AD developed the concept and edited the manuscript. RJN developed the concept and edited the manuscript. OF developed the concept, advised on analyses, provided statistical advice, and edited the manuscript. OF and EB act as guarantors of the data.
Funding: The Dr Foster Unit at Imperial is largely funded by a research grant from Dr Foster Intelligence (an independent health service research organisation). The unit is affiliated with the Centre for Patient Safety and Service Quality at Imperial College Healthcare NHS Trust, which is funded by the National Institute of Health Research (NIHR). We are grateful for support from the NIHR Biomedical Research Centre funding scheme. This research is independent of any bodies funding the authors of this research.
Competing interests: All authors have completed the Unified Competing Interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: This work was approved under Section 251 (formerly Section 60) granted by the National Information Governance Board for Health and Social Care (formerly the Patient Information Advisory Group), and approved by the South East Research Ethics Committee.
Data sharing: No additional data available.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.