Prognostic indicators of early and late death in children admitted to district hospital in Kenya: cohort studyBMJ 2003; 326 doi: http://dx.doi.org/10.1136/bmj.326.7385.361 (Published 15 February 2003) Cite this as: BMJ 2003;326:361
- J A Berkley (), clinical research fellow,
- A Ross, statistician,
- I Mwangi, clinical researcher,
- F H A Osier, clinical researcher,
- M Mohammed, research clinical officer,
- M Shebbe, research clinical officer,
- B S Lowe, laboratory manager,
- K Marsh, professor,
- C R J C Newton, senior clinical research fellow
- Correspondence to: J A Berkley
- Accepted 7 November 2002
Objectives: To identify clinical indicators of immediate, early, and late mortality in children at admission to a sub-Saharan district hospital and to develop prognostic scores.
Design: Prospective cohort study.
Setting: One district hospital in Kenya.
Participants: Children aged over 90 days admitted to hospital from 1 July 1998 to 30 June 2001.
Main outcome measures: Prognostic indicators of mortality.
Results: Of 8091 children admitted up to 1 June 2000, 436 (5%) died. Sixty (14%) died within four hours after admission (immediate), 193 (44%) after 4-48 hours (early), and 183 (42%) after 48 hours (late). There were marked differences in the clinical features associated with immediate, early, and late death. Seven indicators (neurological status, respiratory distress (subcostal indrawing or deep breathing), nutritional status (wasting or kwashiorkor), severe anaemia, jaundice, axillary temperature, and length of history) were included in simplified prognostic scores. Data from 4802 children admitted from 1 July 2000 to 30 June 2001 were used to validate the scores. For simplified prognostic scores the areas under the receiver operating characteristic curves were 0.93 (95% confidence interval 0.92 to 0.94), 0.82 (0.80 to 0.83), and 0.82 (0.81 to 0.84) for immediate, early, and late death, respectively.
Conclusion: In children admitted to a sub-Saharan hospital, the prognostic indicators of early and late deaths differ but a small number of simple clinical signs predict outcome well.
What is already known on this topic
Prognostic indicators have been described for individual diseases—including malaria, lower respiratory tract infection, diarrhoea, and malnutrition—in African children
Making a single diagnosis is often difficult or inappropriate as many children are admitted with several coexisting problems, the clinical features of common illnesses may be indistinguishable, and laboratory facilities are often inadequate
What this study adds
The signs that are prognostic of immediate, early, and late deaths in children admitted to hospital in Africa differ
A small number of simple clinical signs have good sensitivity and specificity for predicting outcome and could be used for risk assessment in individuals or groups
One in six African children dies before the age of 5 years.1 District hospitals have an important role in reducing mortality2 but resources are often limited and care may be of limited quality.3 The implementation of simple guidelines 4 5 for common childhood illnesses may lead to improvements, but tools are needed to evaluate the quality of care between hospitals and over time. 3 6
Scores designed to predict mortality enable adjustment for severity of illness.7 For example, the PRISM score has recently been used to standardise and evaluate outcome in paediatric meningococcal disease in the United Kingdom. 8 9 An appropriately developed score might be useful in audit, research, and clinical practice in sub-Saharan Africa.
Although prognostic indicators have been described for specific diseases—including malaria, 10 11 lower respiratory tract infection, 12 13 gastroenteritis, 14 15 and malnutrition 16 17 —children commonly present with multiple problems. These typically include malnutrition, anaemia, malaria parasitaemia, or HIV infection. Malnutrition increases the risk of death in children admitted to hospital, and presents with almost every illness.18 Additionally, without adequate laboratory facilities clinical features of malaria may be indistinguishable from lower respiratory tract infection19 or meningitis.20
We identified prognostic indicators in children admitted to a rural district hospital in Kenya, irrespective of diagnosis, to produce practical prognostic scores.
Kilifi district hospital is located on the Kenyan coast. It serves a mainly rural population of about 200 000 people. A Kenya Medical Research Institute (KEMRI) research centre is situated within the hospital. The outpatient department is staffed by government employed clinical officers who refer admissions to the paediatric ward (35 beds) or the high dependency ward (six beds). Research clinicians provide inpatient paediatric clinical cover.
The KEMRI Scientific Steering Committee and National Ethical Review Committee approved the study.
Participants and clinical methods
Data were prospectively collected on admission and at death or discharge for all 8477 admissions of children age over 90 days who were admitted from 1 July 1998 to 30 June 2001. We excluded children who were admitted for trauma or elective procedures. Trained clinical assistants collected demographic data, and research clinical officers and doctors from Kenya and Europe with 2-12 years' paediatric experience collected clinical data. Training was given in the recognition of clinical signs, including videos for respiratory signs.21 Data were recorded on standardised proforma that also served as the clinical notes. Table 1 gives definitions of clinical signs.
Sampling and laboratory methods
After we obtained consent from the carers in their own languages a blood sample was taken from all children admitted. For diagnosis of malaria thick and thin blood smears were examined at ×1000. A full blood count was performed with a Coulter MDII-18 counter (Beckman-Coulter, USA). Results were available immediately to clinicians. We investigated the association between HIV infection and mortality in a nested case-control study using stored plasma samples from all children who died during a six month period. We used a random number table to select four times as many controls as cases, stratified by age (<18 months and ≥18 months). Anonymous HIV testing was performed using enzyme linked immunosorbent assay (ELISA, Vironostika, Organon Teknika, USA) and by an IgG antibody capture particle agglutination test (Central Public Health Laboratory, London). Samples from children age <18 months in which results were positive were confirmed by polymerase chain reaction (PCR) for proviral DNA.22 All laboratory procedures were monitored through internal and external quality assessment protocols.
Immediate, early, and late deaths
We had observed differences in presentation between children who died soon after admission and those who died later. Furthermore, there seemed to be a bimodal distribution of deaths. For example, most deaths in children with a clinical syndrome similar to acute severe malaria occurred within 48 hours after admission, while other deaths generally occurred later. We therefore hypothesised that the predictors of early and late mortality differed and developed these as separate models. We also wanted to distinguish children close to death on admission, in whom a model might be the diagnosis of the process of dying rather than prediction. Thus we divided deaths into immediate (within four hours after admission), early (4-48 hours), and late (>48 hours).
We double entered and verified data using FoxPro for Windows. We used EpiInfo 6.04b and Stata 6.0 for statistical analysis.
We used data from children admitted in the first two years to investigate the prognostic ability of clinical features and to derive prognostic models. The positive and negative likelihood ratios were calculated for immediate, early, and late deaths. We selected variables that were univariately predictive, with a likelihood ratio ≥2 or ≤0.5, and adjusted them for potential confounding of related variables in a multivariate analysis according to the method of Spiegelhalter and Knill-Jones. 23 24 The final indicators were chosen by further excluding any variables with an adjusted likelihood of ≤1.5 and ≥0.67, suggesting they were of little independent predictive value. Simplified prognostic scores were constructed by assigning points approximating to the natural logarithm of the adjusted likelihood ratio for each indicator. When potential for a negative score existed we added a constant.
We prospectively validated the prognostic scores using data collected from children in the third year of the study. We used receiver operating curve characteristic analysis and calculated the area under the curve.
From 1 July 1998 to 30 June 2000, 8477 children (47% girls) aged 90 days to 13 years were admitted. Of these, we excluded 386 who were admitted electively or after trauma. Of the 8091 included children, 4314 (53%) were <2 years of age, 2687 (33%) were 2-5 years, and 1090 (14%) were >5 years old. The mean z scores for weight for age and height for age were −1.95 (SD 1.41) and −1.32 (SD 1.21), respectively. Carers of 2031 (25%) children reported that the child had had convulsions, 974 (12%) children were prostrate, 572 (7%) had impaired consciousness, and 1853 (23%) had respiratory distress (deep breathing or subcostal indrawing). In 4537 (56%) children test results for malaria were positive, and 1264 (16%) were severely anaemic.
Four hundred and thirty six children (5%) died while in hospital. Sixty (14%) deaths were classified as immediate, 193 (44%) as early, and 183 (42%) as late. HIV infection was detected in 17/79 (22%) children who died between 1 October 1999 and 31 March 2000 and in 13/311 (4%) children who were discharged alive (odds ratio 6.29, 2.71 to 14.7). The proportion was similar in children who died before and after 48 hours after admission.
Clinical prognostic indicators
For immediate deaths, severe anaemia, jaundice, subcostal indrawing, deep breathing, neurological status, and axillary temperature were univariately predictive (table 2). When we included these features in a multivariate analysis they all remained predictive (table 2).
Jaundice, subcostal indrawing, deep breathing, neurological status, axillary temperature, wasting, and kwashiorkor were univariately predictive for early deaths (table 2). When we included these features in the multivariate model, the likelihood ratios for deep breathing and axillary temperature were poorly predictive and were excluded (table 3).
For late deaths, neurological status, axillary temperature, wasting, kwashiorkor, history >7 days, seizures, fever, and diarrhoea were univariately predictive and were included in the multivariate analysis (table 2). The adjusted likelihood ratios for a history of fever, seizures, and diarrhoea had reduced prognostic ability so we excluded these variables from the late score (table 3). The resulting prognostic scores ranged from 0 to 10 for immediate deaths and from 0 to 7 for early and late deaths.
Validation of prognostic scores
Between 1 July 2000 and 30 June 2001, 4995 children age >90 days were admitted. We excluded 193 who were admitted for trauma or elective admissions. This left 4802 children, of whom 222 (4.6%) died: 26 (12%) immediate, 88 (40%) early, and 108 (48%) late. Table 4 shows the distributions of immediate, early, and late prognostic scores. The areas under the receiver operating characteristic curves for the scores were 0.93 (95% confidence interval 0.92 to 0.94) for immediate, 0.82 (0.80 to 0.83) for early, and 0.82 (0.81 to 0.84) for late deaths (fig).
Our prognostic scores showed good predictive ability despite being based on simple clinical signs. None of the indicators was specific for aetiology, which suggests that they could be applicable throughout the region. Our results need to be externally validated, ideally, in areas of differing HIV prevalence and malaria transmission. About half of the children admitted and a third of those who died had a malaria parasitaemia, and the overall rate of HIV infection was about 6%. However, nearly a quarter of children who died and were tested were infected with HIV.
Our findings overlap with those of some studies of disease specific prognostic indicators. The principal indicators of immediate and early death are similar to those for malaria 10 11 and severe lower respiratory tract infection,12 particularly with respect to the increased risk in afebrile, malnourished children. Importantly, diarrhoea or seizures (other than in prostrate children or those with impaired consciousness) were not significant independent predictors of death. Among prostrate children or those with impaired consciousness, a history of seizures was associated with a better outcome, suggesting a postictal state in many of these children. We did not include biochemical or microbiological variables in our models as laboratory facilities are not widely available.
Our treatment practices did not differ significantly from those recommended by WHO4 or in other well established guidelines for common illnesses. In common with other African hospitals, the paediatric ward was often overcrowded. Close monitoring was possible only in the high dependency unit. Basic drugs were available throughout the study period but affordable antibiotics—for example, such as penicillin, chloramphenicol, and gentamicin—were normally used. While laboratory services were good, radiography was not always available. The presence of the research unit may have reduced inpatient mortality, though the level of care was not beyond that possible at a district hospital.2
Prognostic scoring systems are usually developed from patients given treatment, which may influence their outcome. “False positives” are therefore expected as many children are admitted in extremis but receive prompt lifesaving treatments such as fluid resuscitation. In practice, although some patients inevitably die despite treatment, prognostic models derived from treated cohorts remain valuable in identifying areas for improvement and in identifying individuals at high risk.7 “False negatives” may also occur when the condition of a child deteriorates after admission. This was seen in the early score, where 11 children in the validation year died early despite having had an early score of zero at admission. The use of negative likelihood ratios allowed the possibility of the inclusion of the prognostic value of the absence of a clinical sign.
The WHO/Unicef integrated management of childhood illness (IMCI) strategy is aimed at improving community based care and referral. Current efforts to improve health care at the first referral level include an algorithm for emergency assessment and triage (ETAT). It is aimed at prioritising children who need admission or urgent resuscitation. Our prognostic scores differ in that the main outcome is inpatient mortality. Mortality varies considerably between hospitals, with patterns of use depending on location and availability of other healthcare options. By adjusting for risk of death, outcomes could be compared either between centres or over time.
We have shown that a small number of important clinical indicators are prognostic for death in children admitted to a rural Kenyan district hospital, irrespective of clinical diagnosis. If these scores can be suitably validated elsewhere in the region, we believe they could be valuable in assessing the clinical care at district hospitals, standardising clinical studies, and identifying children “at risk.”
We thank the medical officer of health, the medical superintendent, and the staff of Kilifi District Hospital for their support, and N Peshu, director of the centre. This paper is published with the permission of the director of KEMRI (Kenyan Medical Research Institute).
Contributions: JAB designed and performed the study, participated in patient care, and is guarantor. IM, FHAO, MM, MS, and KM contributed to the design and participated in patient care and data collection. AR and JAB did the statistical analysis and wrote the first draft of the manuscript. BSL was responsible for laboratory investigations. CRJCN contributed to the design and participated in patient care, data collection, and analysis. All authors contributed to the final manuscript.
Conflict of interest None declared.
Funding This study was supported by KEMRI and the Wellcome Trust. JAB is a Wellcome Trust research training fellow in clinical tropical medicine (053439) and KM (031342) and CRJCN (050533) are Wellcome Trust senior clinical fellows.