Effect of the critical care outreach team on patient survival to discharge from hospital and readmission to critical care: non-randomised population based study
BMJ 2003; 327 doi: https://doi.org/10.1136/bmj.327.7422.1014 (Published 30 October 2003) Cite this as: BMJ 2003;327:1014
- Carol Ball (carol.ball{at}royalfree.nhs.uk), consultant nurse1,
- Margaret Kirkby, senior sister critical care outreach team1,
- Susan Williams, clinical audit manager1
- Correspondence to: C Ball
- Accepted 15 September 2003
Abstract
Objectives To determine the effect of the critical care outreach team on patient survival to discharge from hospital after discharge from critical care and readmission to critical care.
Design Non-randomised population based study.
Setting Tertiary referral teaching hospital with 1200 beds.
Participants Patients discharged from the critical care unit after their first or only admission for two study periods, 26 February 2000 to 25 February 2001 and 26 February 2001 to 25 February 2002.
Main outcome measures Survival to discharge from hospital after discharge from critical care and readmission to critical care.
Results The introduction of a critical care outreach team improved survival to discharge from hospital after discharge from critical care by 6.8% (risk ratio 1.08). Readmission to critical care decreased by 6.4% (0.48).
Conclusions The activity of the critical care outreach team seems to improve patient survival to discharge from hospital and may reduce the number of readmissions to critical care.
Introduction
The report Comprehensive Critical Care identified a strategy for change that has begun to transform the delivery of critical care services in England and Wales.1 Many of the recommendations in the report are subsumed under the broad remit of critical care outreach teams. Perhaps the most important of these recommendations was the development of patient at risk teams and follow up services to complement critical care while improving the speed and quality of patient recovery to discharge from hospital. The need for this service was based on several reports, which indicated suboptimal management of both patients discharged from intensive care and patients at risk of deterioration on hospital wards.2–5 The same year a report published by the Scottish Executive concluded that outreach teams and follow up would not significantly optimise patient care or affect the workload of intensive care units.6
More recently, critical care outreach teams have been challenged to produce robust evidence of effectiveness to justify the substantial investment in them made by the government.7 Evidence is emerging from Australia that the activity of medical emergency teams, introduced in the early 1990s, may substantially reduce the incidence of cardiac arrest and unanticipated admission to intensive care.8 9 Such teams, however, differ from patient at risk teams that have developed in England and Wales. Medical emergency teams are usually a medical team, including a senior nurse, trained and experienced in acute hospital medicine. Patient at risk teams tend to be nurse led.10 Therefore the results from Australia cannot be extrapolated to England and Wales, despite both teams responding to early physiological warnings (box). We aimed to determine the effectiveness of follow up services during the period between discharge from critical care to discharge from hospital and on readmission to critical care.
Participants and methods
The critical care outreach team of the Royal Free Hampstead NHS Trust was established in February 2001. The team of five senior critical care nurses is led by a consultant nurse. The service is available for 12 hours daily. The trust has 1200 beds, including 20 critical care beds. Data collection during the study was limited to a site with 13 beds owing to the ongoing expansion of the critical care clinical audit team.
Early warning triggers for patient at risk teams (triggers may be modified)
Respiratory rate < 8 breaths/min or > 25 breaths/min
Pulse oximetry < 90% on > 35% fractional inspired oxygen
Pulse < 50 beats/min or > 125 beats/min
Systolic blood pressure < 90 mm Hg, > 200 mm Hg, or > 40 mm Hg; less than patient's normal values
Urine output < 30 ml/h for more than two hours; unless normal for patient
Sustained alteration in level of consciousness or fall in Glasgow coma scale score of > 2 in past hour
Concerns about the patient
Operational policy of team
Patients discharged from critical care are assessed by the critical care outreach team at least once daily. Any interventions required are performed by the outreach team or by nursing and medical staff on the ward, depending on the skill required. The outreach team alert staff to patients showing deterioration. The emphasis of the follow up service is rehabilitative. Table 1 outlines the most common interventions performed by the outreach team. Table 2 shows the types of referrals to specialists recommended by the outreach team. Patients are discharged from the follow up service once they are making satisfactory progress—no longer require continuous positive airways pressure or a tracheostomy and are not showing warning criteria (see box). Ward staff are encouraged to re-refer patients to the outreach team who are showing any of these criteria. The outreach team uses clinical judgment to assess progress as standardised objective criteria for satisfactory progress have not yet been derived.
Most common interventions performed by critical care outreach team
Most common referrals to specialists by critical care outreach team
Data collection
We undertook a before and after study using historical controls to determine patient survival to discharge from hospital after discharge from critical care and readmission to critical care. All data were routinely collected as part of the Intensive Care National Audit Research Centre case mix programme.11 Data were taken from patient charts, and input was the responsibility of an auditor.
Data were analysed from patients admitted during 26 February 2000 to 25 February 2001 (period 1) and 26 February 2001 to 25 February 2002 (period 2). These represent the periods before and after the introduction of the outreach team. A dataset was prepared from the patient's first or only admission to critical care during these periods. We excluded patients who died in critical care. Patients were excluded from period 1 if they were admitted during this period but discharged in period 2, as the outreach team could have influenced survival to hospital discharge or readmission. For the same reason patients were excluded if they were firstly admitted and discharged in period 1, then readmitted and discharged in period 2. To ascertain equivalence between the two groups, risk factors were chosen for their presumed association with mortality based on local audit data—for example, male, aged over 65, acute physiological and chronic health evaluation II (APACHE II) chronic health points, and probability of inhospital mortality—and those associated with readmission—for example, length of stay in critical care and medical or surgical diagnosis.12–14
To assess data reliability a 5% sample of the patients included in the study groups was selected using a computer generated random number sequence. Computerised data were checked against the original records. This was undertaken by staff who had received training in data collection for the Intensive Care National Audit Research Centre case mix programme but had not been involved in the original data entry.
Statistical analysis
The patient was the sampling unit. The Mann-Whitney U test and χ2 and t tests were used to evaluate the uniformity of the patient populations for both periods for age, sex, medical or surgical diagnosis, length of stay in critical care, severity of illness in the first 24 hours of admission, and comorbid conditions. Risk ratios and 95% confidence intervals were calculated for the effect of the outreach team on patient survival to hospital discharge and readmission to critical care. Analyses were performed with intercooled Stata 7.0 for Windows.
A 5% random sample (24 patients) was taken from the dataset to check the reliability of the data. Overall, 98.7% (3529/3576) of the computerised items for these patients agreed with the original written records (95% confidence interval 98.3% to 99.1%).
Results
We found no significant differences between the populations of critical care survivors before and after the introduction of the outreach team for age, sex, medical or surgical diagnosis, length of stay in critical care, severity of illness in the first 24 hours of admission to critical care, or comorbidities (table 3). After the introduction of the outreach team, there was a significant increase in survival to hospital discharge and a significant decrease in number of readmissions to critical care (risk ratios 1.08 and 0.48, respectively; table 4).
Characteristics of critical care survivors for first or only admission to intensive care unit before and after introduction of critical care outreach team
Risk ratios for effect of introducing critical care outreach team on patient survival to hospital discharge and subsequent readmission to critical care
Discussion
Critical care outreach teams seem to improve survival to discharge from hospital after discharge from critical care and may reduce the number of readmissions to a significant extent. The activity of the outreach team differs from that of medical emergency teams and patient at risk teams. Critical care outreach teams have developed on an ad hoc basis in England and Wales. They differ widely in composition, ranging from lone consultant nurses to multiprofessional teams, and in their working patterns and activity.10 Some outreach teams follow up patients as described in our study, whereas others attend once patients show early warning criteria (see box). The results of our study are therefore not transferable.
Patients are at increased risk of deterioration during the recovery period after discharge from critical care, attributable to early discharge and residual organ dysfunction.12 13 Both often lead to readmission, which in turn is associated with higher inhospital mortality.13 15 Although we present only a preliminary examination of what can be achieved through fundamental interventions and referrals made by experienced critical care nurses during the recovery period, our findings do provide some evidence that this type of innovation is worth while for patient survival and readmission.
A recent study could detect no change in patterns of readmission after the introduction of a critical care outreach team.16 It is difficult to extrapolate from the report if the operational policy was similar to that described in our study, and although the setting seems similar, a far larger sample was examined. The readmission rate for both study periods was 4.0%, unlike our study, which found a reduction of 12.4% compared with 6.0% after the introduction of the outreach team. A readmission rate of 4.0% is below the national average of 6.3% reported by the Intensive Care National Audit Research Centre, indicating that there was little room for the effect of the outreach team to be shown in terms of readmission.
Survival to discharge from hospital has been determined in medical patients after discharge from critical care.14 These patients were chosen because of the high mortality associated with critical illness. Survival was thought to have been affected by a change in resuscitation status, where seven of the 12 patients who survived critical care had their resuscitation status altered to do not resuscitate. It is unlikely that this applied to our study because survival to discharge improved and it is unlikely that this would have occurred if patients had had their resuscitation status altered. A more unlikely reason is that decisions about not resuscitating were made but that patients then survived to discharge from hospital. Alternatively, the proportion of medical patients differed between the two periods under study, but this was not the case.
Strengths and limitations
Our study design could have confounded the results; before and after studies are retrospective, therefore variables cannot be controlled. In our study a concomitant innovation in the hospital could have produced the same results. Patients were, however, discharged from critical care to different areas of the hospital, and at the time of the study there was no other innovation that could have had an effect on patients. The median predicted probability of mortality was 16.1% compared with 20.4% in the historical cohort. Although this was not statistically significant, part or all of the effect seen might be explained by this difference. Several authors have, however, questioned the ability of the tool to predict mortality and it is currently the subject of further investigation by the Intensive Care National Audit Research Centre. The tool therefore might explain some of the variation in outcome but not all of it.17 18
Before and after studies may also show a lack of equivalence between comparators, and interventions may vary. Both our groups had similar risk factors. These were chosen for their association with mortality and readmission and seemed to be appropriate for the purposes of our study. The interventions undertaken by team members did vary, possibly owing to length of time available for the intervention or the manner in which the intervention was undertaken by the individual and on a particular day. It is unlikely, however, that one individual or one intervention can be associated with the findings. Rather, the combined effect of the interventions seems to have had a beneficial effect on outcomes.
The use of routine audit data, rather than specific data collected for research purposes, may also have produced erroneous results. The database was examined on a random basis for reliability and seemed sound.
Our small sample size increased the risk of a type 2 error, which is much smaller than those used to test the effectiveness of medical emergency teams or the effect on readmission rates.8 9 16 If the innovation described here had not been introduced so hastily, owing to political imperative, we could have conducted a prospective randomised controlled trial. Evidence for innovation in service delivery will always be prone to limitations where evaluation is not undertaken before wholesale application. Policy makers should consider testing health service innovation using cluster randomised controlled trials with the hospital as the sampling unit. An example of this is the medical early response intervention and therapy study currently being undertaken in Australia to assess medical emergency teams.19
What is already known on this topic
The management of patients on the ward at risk of critical illness is suboptimal
Substantial sums have been invested in the development of critical care outreach teams
Outreach teams were hastily created and their effect on readmission to critical care or survival to hospital discharge was unclear
What this study adds
Critical care outreach teams seem to improve survival to discharge from hospital and may reduce readmission rates to critical care
Footnotes
-
Contributors Heather Byers, Mary Fogarty, Joanna Hoyland, and Richard Ward (members of the critical care outreach team) participated in data collection and analysis. Dominic Cox (clinical scientist) and Demissie Tulu (auditor, Critical Care Audit Team) checked the reliability of the dataset. Steve Shaw (lead consultant for critical care) and Julian Howard (consultant critical care) critically reviewed drafts of the manuscript. John Emberson (statistician, British regional heart study) provided advice on the analysis and interpretation of data. SW compiled and analysed the database. CB and MK contributed to the concept, design, and implementation of the study, drafted the manuscript, and read and approved the final version. All authors will act as guarantors for the paper.
-
Funding None.
-
Competing interests None declared.
-
Ethical approval Permission from the local ethics committee was not sought as the study involved secondary analysis of audit data collected on a routine basis.