Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Monica Ausejo a Thomas C Chalmer's Center for Systematic
Reviews, Children's Hospital of Eastern Ontario Research Institute,
401 Smyth Road, Ottawa, Ontario K1H 8LI, Canada, b Department
of Pediatrics, University of Calgary, Alberta Children's Hospital,
1820 Richmond Road, Calgary, Alberta T2T 5C7, Canada
Correspondence to: TP
Klassen Department of Pediatrics, University of Alberta, 2C3.67
Walter C Mackenzie Health Sciences Center, Edmonton, Alberta T6G
2R7 terry.klassen{at}sympatico.ca
| |
Abstract |
|---|
|
|
|---|
Objective:
To determine the effectiveness of
glucocorticoid treatment in children with croup.
Design:
Meta-analysis of randomised controlled trials that examine the effectiveness of glucocorticoid treatment in children
with croup.
Main outcome measures:
Score on scale measuring
severity of croup, use of cointerventions (adrenaline (epinephrine),
antibiotics, or supplemental glucocorticoids), length of stay in
accident and emergency or in hospital, and rate of hospitalisation.
Results:
Twenty four studies met the inclusion
criteria. Glucocorticoid treatment was associated with an improvement
in the croup severity score at 6 hours with an effect size of
1.0 (95% confidence interval
1.5 to
0.6) and at 12 hours
1.0
(
1.6 to
0.4); at 24 hours this improvement was no longer
significant (
1.0,
2.0 to 0.1). There was a decrease in the number
of adrenaline treatments needed in children treated with
glucocorticoids: a decrease of 9% (95% confidence interval 2% to
16%) among those treated with budesonide and of 12% (4% to 20%)
among those treated with dexamethasone. There was also a decrease in
the length of time spent in accident and emergency (
11 hours, 95%
confidence interval
18 to 4 hours), and for inpatients hospital stay
was reduced by 16 hours (
31 to 1 hour). Publication bias seems to play a part in these results.
Conclusions:
Dexamethasone and budesonide are
effective in relieving the symptoms of croup as early as 6 hours after
treatment. Fewer cointerventions are used and the length of time spent
in hospital is decreased in patients treated with glucocorticoids.
|
Key messages
|
| |
Introduction |
|---|
|
|
|---|
Croup (laryngotracheobronchitis) is a common cause of upper airway obstruction in children and is characterised by hoarseness, a barking cough, and inspiratory stridor. These symptoms are thought to occur as a result of oedema of the larynx and trachea which has been triggered by a recent viral infection. Parainfluenza virus type 1 is the agent most commonly identified in cases of croup.1
Although croup is a self limiting illness, it is a large burden on healthcare systems because of the frequent visits made to doctors and accident and emergency departments and, when necessary, hospitalisations. The annual incidence of croup in children younger than 6 years ranges from 1.5% to 6%.2 Admission rates for croup in children seen in outpatient settings range from 1.5% to 31% of cases seen; these figures vary widely, depending on hospital admission practices and the severity of the disease in the population being assessed. 3 4
The standard management of croup includes mist treatment (that is,
treatment with humidified air), although there is little evidence that
this is effective. 5 Racemic adrenaline (epinephrine), or
L-adrenaline, has been shown to provide temporary relief to patients with croup but is not thought to have longer term
benefits.6 Since the late 1980s it has been recognised
that glucocorticoids provide some clinical benefit in children with
croup. In 1989, Kairys et al published a meta-analysis of clinical
trials examining the benefit of glucocorticoids.7 However,
since then a number of randomised trials have been published, and there
has been increasing interest in the use of glucocorticoids to treat
outpatients with croup. The objective of this meta-analysis was to
provide evidence to guide clinicians in their treatment of patients
with croup, to examine the effectiveness of glucocorticoids in these
patients, and to identify areas of uncertainty for future research.
| |
Methods |
|---|
|
|
|---|
Study identification
We searched Medline from January 1966 to August 1997, exploding
glucocorticoid treatment (and each of the terms for corticosteroids)
and croup; we restricted the search to randomised controlled trials
using a previously validated strategy (see appendix 1 on the
BMJ's website). We searched Excerpta Medica and
Embase from January 1974 to August 1997 (appendix 1). The Controlled Trials Register of the Cochrane Library was also searched;
it includes studies identified by the Acute Respiratory Infection Review Group through the hand searching of key journals. We also sent
letters to the authors of trials published in the past five years to
enquire whether they knew of any other published or unpublished trials.
Two researchers (TPK, MA) then selected studies as being
potentially relevant based on a review of the titles and abstracts, if
available. The complete text of these studies was then retrieved.
score was used to measure interrater agreement.
Differences over which studies should be included were resolved by
consensus reached after discussion.
Data extraction
Once we identified studies as being relevant for review, they were
masked by obscuring the authors' names and institutions, the location
of the study, reference lists, and any other potential identifiers;
this was done by an independent research assistant who was not involved
with the abstraction of data. Data were extracted using a structured
form that captured patient status (inpatient or outpatient), the
intervention and its control, the name of drug, the route of
administration, and the dose. Additionally, data were collected on the
primary outcome measure; clinical croup score at baseline and at any
subsequent assessment times; length of stay in hospital or accident and
emergency in hours; whether the patient had improved (coded
yes or no); and the use of additional interventions such as adrenaline, supplemental glucocorticoids, mist treatment, intubation, or antibiotic treatment. Data were extracted by one reviewer (MA) and checked for
accuracy by a second reviewer (TPK).
Quality assessment of trials
We assessed quality using empirically derived items. We used the
previously validated Jadad 5 point scale to assess randomisation (0-2 points), double blinding (0-2 points), and withdrawals and dropouts
(0-1 point).8 For component assessment, concealment of
allocation was described either as adequate, inadequate, or
unclear.9 Sponsorship of studies was coded as either
pharmaceutical company, other sources, or not mentioned.10
Two observers independently assessed quality (MA, JK), and interrater
agreement was measured by the intraclass
correlation.11 Differences were resolved by consensus.
Data analysis
All comparisons were performed between treatment and control
groups thus preserving randomisation. The main outcome measure was the
difference between treatment groups in the mean change from croup score
at baseline. We derived the outcome measures from cross sectional
summaries (for example, at baseline, 6, and 12 hours) in cases in which
outcome measures were not reported directly. The variance of an effect
size was derived from the common variance of a single croup score
assuming a correlation of 0.5 between pre-treatment and post-treatment
scores. Other variance imputations were performed according to the work
of Follman et al.12 Variances of a single score were
derived from the P values of the Mann-Whitney testw8 w9
w23 and from the measurement of confidence
intervals.w4
2 statistic for between study
variation.13 For the analyses of croup scores and
secondary outcomes, fixed effect models were used to combine treatment
effects if there was no evidence of heterogeneity across studies;
otherwise, the more conservative estimates from random effect models
were reported. For binary data (such as improvement in signs and
symptoms and the presence of various additional interventions), rate
differences and the number needed to treat were derived. For the number
needed to treat, we inverted the differences in the proportions
improved and their 95% confidence intervals.
Heterogeneity between studies was explored using sensitivity and
subgroup analyses performed on the primary outcome of the change in
croup scores from baseline at 6 hours. Westley scores were the scores
most commonly used in the trials.19 Westley scores use a
17 point scale to assess air entry (2 points), stridor (2 points),
intercostal retractions (indrawing of the chest wall between the ribs
on inspiration) (3 points), cyanosis (5 points), and level of
consciousness (5 points). Treatment differences in Westley scores were
calculated in place of effect sizes to provide an approximate
conversion between the two scales. Differences between estimates
derived from Westley and other scores were assessed.
A trial effect size was defined as the difference between the two
treatments in the mean change from croup score at baseline. We derived
effect sizes from cross sectional summaries (for example, baseline, 6, 12 hours) for trials not reporting effect sizes directly. The
standardised effect size (that is, an effect size divided by the common
standard deviation of the change from baseline) was used to combine
trials reporting different versions of the croup score. Sensitivity
analyses were based on the type and dose of glucocorticoid
administered. The quality score of the included trials was incorporated
into the pooled estimates using the method proposed by
Moher.20 In addition, the impact of the concealment of
treatment allocation on the pooled estimates was
assessed.9
| |
Results |
|---|
|
|
|---|
Study identification and characteristics
Ninety seven studies were identified as being potentially relevant
and retrieved. Two of these studies were in press at the time of data
extraction and have since been published.w11 w13
Forty four studies were excluded because they were reviews or commentaries, 12 did not study croup, nine had inadequate randomisation strategies, four were retrospective studies, two had no control group,
one had no outcome of interest, and one was a duplication. Therefore,
24 studies were included (references and full details of these studies
can be found in table A on the BMJ's website). The
weighted
score between two reviewers was 0.89, indicating substantial agreement.
Quality assessment of trials
The intraclass correlation between two reviewers was 0.63 for the
Jadad scale, 0.98 for allocation concealment, and 1.0 for sponsorship,
indicating at least substantial agreement in all cases. The median
Jadad score was 3 (interquartile range 2.75 to 4) or 60% (55% to
80%) for the best quality of reporting. Allocation concealment was
adequate in 11 (46%) of the studies, inadequate in one (4%), and
unclear in 12 (50%). Pharmaceutical sponsorship was identified in
three (13%) studies, support was from other sources in three (13%),
and not mentioned in 18 (75%). Overall, the quality of studies was
better than has been observed for other diseases.
9 20 21
Croup score
The most frequent outcome utilised in 13 studies was the clinical
croup score based on a 17 point ordinal scale developed by
Westley.19 Other scoring systems, none of which have been
validated, were utilised in five studies; in six studies no clinical
score was reported.
1 is similar to that seen at
earlier evaluation points but the 95% confidence interval crosses 0. A
decrease in effect size of 1 from baseline is thought to be a
clinically important change.
|
Additional interventions
There was no significant increase in the use of antibiotics among
those treated with glucocorticoids as compared with those treated with
placebo when expressed as the difference in risk. This was consistent
for the dexamethasone group (4%,
20% to 27%) and the budesonide
group (
2%,
17% to 13%). There was a significant decrease noted
in the use of adrenaline in the glucocorticoid groups with a difference
in risk of
9% (
16% to
2%) in the budesonide group (number
needed to treat 10; baseline rate 16%) and
12% (
20% to
4%)
in the dexamethasone group (number needed to treat 8; baseline rate
23%). There was no significant impact on the use of supplemental
glucocorticoids among either those treated with dexamethasone (4%,
4% to 13%) or those treated with budesonide (
15%,
32% to
2%).
2% (
14% to 10%; baseline rate 3.2%,
2.9% to 3.5%).
Hospitalisation
Overall, a significantly shorter time was spent in accident and
emergency when children were treated with a glucocorticoid as compared
with placebo (5 studies, 596 patients); the weighted mean difference
was
11 (
18 to 4) hours. For inpatients, the difference was
16
(
31 to 1) hours.
16% (
39% to 6%) in the
rate of hospitalisation for patients treated with budesonide versus
patients treated with placebo (baseline rate 32%, 24% to 39%). This
was also true for patients treated with dexamethasone as compared with
patients treated with placebo (
2%,
31% to 5%) or if any
glucocorticoid was compared with placebo (
14%,
12% to 5%). The
more conservative random effects model was used to derive the overall
estimate of the difference in hospitalisation rates because there was
significant heterogeneity between studies. If the fixed effects model
estimate was used there was a significant decrease in hospital
admissions between patients treated with budesonide and those treated
with placebo (
15%,
20% to
10%).
Sensitivity and subgroup analyses
The sensitivity analysis showed that the method of scoring the
severity of croup was important (fig 2). An effect size of
1.2
(
1.7 to
0.7) was identified when the Westley croup score was used
(9 studies, 569 patients) as compared with an effect size that was 50%
smaller when other croup scores were used (4 studies, 497 patients;
0.6,
1.5 to 0.3), a size that was no longer significant. The
Westley score is the only method that has undergone validation and
reliability testing and been shown to be sensitive to important changes
in a patient's clinical status. The smaller treatment effect noted
with non-Westley scores could be the result of sensitivity to change or
perhaps a greater degree of variability caused by low
reliability.
|
1.2 (
1.9
to
0.5) and for the studies in which it was inadequately concealed
or in which it was unclear was
0.9 (
1.4 to
0.3). These
differences are probably not clinically or statistically significant.
Publication bias
We identified a marked publication bias, and there is also the
possibility that small studies that showed that glucocorticoids had no
effect were suppressed from publication. There was a significant
correlation between treatment effect and sample size (for example, rank
correlation test P=0.013; graphical method P=0.004). The Dear-Begg
estimate of this correlation was 0.29. Pooled effect size at 6 hours
calculated using the simple graphical method was
1.1 (
1.5 to
0.8); with the selection model it was
1.2 (
2.4 to
0.01);
and with the trim and fill method it was
0.2 (
0.8 to 0.4). The
trim and fill method suggested that seven small trials were suppressed
because their results were not significant.
| |
Discussion |
|---|
|
|
|---|
Efficacy of steroids
This meta-analysis has shown that treatment with glucocorticoids
is effective in improving symptoms of croup in children by as early as
6 hours and for up to at least 12 hours after treatment. This is shown
by the significant improvement in scores of croup severity, shorter
hospital stays, and the fact that adrenaline was used less often as an
additional intervention. Although the decrease in the rate of
hospitalisation was not significant, this outcome criterion varies from
hospital to hospital and the direction of the change was towards
effectiveness. The degree of benefit identified would merit the use of
glucocorticoids, since 5 to 7 patients would need to be treated with
glucocorticoids for one patient to experience a significant improvement
in symptoms.
Publication bias
Of more importance is the fact that publication bias seems to be a
modifier of this result, and it is likely that our analysis did not
include smaller studies that had statistically negative results.
Publication bias is an important threat to the validity of systematic
reviews and is difficult to combat except through the registration of
all randomised controlled trials on human participants. The existence
of this bias suggests that this meta-analysis overestimates the
effectiveness of treatment with glucocorticoids. The results indicate
that the number needed to treat at 12 hours is 5 patients for one
patient to experience improvement. If publication bias exists and has
exaggerated the benefit of treatment, then the number needed to treat
would be greater. Thus, clinicians will have to decide whether it is
still worth treating patients for croup. Considering the comparative safety and low cost of dexamethasone, it probably makes sense to
continue using glucocorticoids. In cases in which the effect of
adopting treatment with glucocorticoids has been examined, there has
been evidence for a decline in hospital admission rates, fewer
admissions to the intensive care unit, and shorter lengths of
stay.
22 23
Study quality
The quality of the studies included was good. The median Jadad
score in our study was 3; in other studies the median is often 2 or
less.
20 21
In 46% of the trials allocation was
adequately concealed whereas in most other studies about 10% to 15%
of the trials being assessed have adequate
concealment.
9 20
Although quality assessment and methods
of its incorporation into systematic reviews are controversial, we have
recently shown the importance of such assessments in detecting bias and
have proposed a method of quality weighting.20
Outcome measures
Outcome measures are important in detecting significant change in
a patient's clinical status. It is important that this measure is
valid (that it measures what it ought to be measuring) and responsive
(that it is sensitive to change).27 This meta-analysis
supports the importance of using valid and responsive outcome measures
since the magnitude of the effectiveness of the treatment in this study
was dependent on which scoring method was used. We have shown that the
Westley score is valid, responsive, and a reliable
measure.28 Although further validation and modification
could be made to the Westley score, it should remain the primary
outcome measure in trials currently being conducted.
| |
Acknowledgments |
|---|
Alison Jones was helpful in retrieving articles and in managing this project. We also thank Jessie McGowen for helping with the electronic searches of bibliographic databases. We thank Jack Vevea for the use of a computer program which implemented the selection model for publication bias.
Contributors: MA and AS were responsible for most of the project management and were responsible for retrieving articles, assessing their relevance and quality, and extracting data. They also helped with writing the paper. BP helped with data management and in the statistical analysis of this project. DM helped in reaching the consensus decisions on relevance and quality assessment and provided methodological support and editorial comments. JDK assessed the quality of trials included and provided methodological support and editorial comments on the paper. TPK helped assess studies for their relevance for inclusion, checked the data for accuracy, and helped write the paper. Annie Walker, of the Child and Youth Clinical Trials Network, assisted in the preparation of this article. TPK is the guarantor for the study.
| |
Footnotes |
|---|
Funding: This review was supported in part by the Health Research Fund from the government of Spain: MA received FIS grant No 97/5407 and AS received FIS grant No 97/5408.
Competing interests: DWJ received research funding from Astra Pharmaceuticals, the manufacturer of budesonide, to complete a trial comparing treatment with budesonide, dexamethasone, and placebo (reference w12 on the BMJ's website).
website extra: References for the trials included and other additional information can be found on the BMJ's website www.bmj.com
| |
References |
|---|
|
|
|---|
| 1. | Henrickson KJ, Kuhn SM, Savatski LL. Epidemiology and cost of infection with human parainfluenza virus types 1 and 2 in young children. Clin Infect Dis 1994; 18: 770-779[Medline]. |
| 2. |
Denny FW, Murphy TF, Clyde WA, Collier AM, Henderson FW.
Croup: an 11 year study in pediatric practice.
Pediatrics
1983;
71:
871-876 |
| 3. | To T, Young W. Hospitalizations for croup in Ontario [abstract]. Clin Invest Med 1994; 17: A25. |
| 4. | Marx A, Torok TJ, Holman RC, Clarke MJ. Pediatric hospitalizations for croup (laryngotracheitis): biennal increases associated with human parainfluenza virus 1 epidemics. J Infect Dis 1997; 176: 1423-1427[Medline]. |
| 5. | Skolnik NS. Treatment of croup: a critical review. Am J Dis Child 1989; 143: 1045-1049[Abstract]. |
| 6. |
Waiisman Y, Klein BL, Boenning DA, Young GM, Chamberlain JM, O'Donnell R, et al.
Prospective randomized double-blind study compaing L-epinephrine and racemic epinephrine aerosols in the treatment of laryngotracheitis (croup).
Pediatrics
1992;
89:
302-306 |
| 7. |
Kairys SW, Olmstead EM, O'Connor GT.
Steroid treatment of laryngotracheitis: a meta-analysis of the evidence from randomized trials.
Pediatrics
1989;
83:
683-693 |
| 8. | Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJM, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996; 17: 1-12[Medline]. |
| 9. | Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias: dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995; 273: 408-412[Abstract]. |
| 10. |
Cho MK, Bero LA.
The quality of drug studies published in symposium procedings.
Ann Intern Med
1996;
124:
485-489 |
| 11. | Bartko JJ. General methodology. II. Measures of agreement: a single procedure. Stat Med 1994; 13: 737-745[Medline]. |
| 12. | Follman D, Elliott P, Sul I, Cutler J. Variance imputation for overviews of clinical trials with continuous response. J Clin Epidemiol 1992; 45: 769-773[Medline]. |
| 13. | Hedges LV, Olkin I. Statistical methods for meta-analysis. Orlando, FL: Academic Press , 1995. |
| 14. | Begg CB, Mazundar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50: 1088-1101[Medline]. |
| 15. |
Egger M, Davey Smith G, Schneider M, Minder C.
Bias in meta-analysis detected by a simple, graphical test.
BMJ
1997;
315:
629-634 |
| 16. | Light RS, Pillemar DB. Summing up: the science of reviewing research. Cambridge, MA: Havard University Press , 1984. |
| 17. | Hedges LV. Modelling publication selection effects in meta-analysis. Stat Sci 1992; 7: 246-255. |
| 18. | Taylor S, Tweedie R. Trim and fill: a simple funnel plot based method of testing and adjusting for publication bias in meta-analyses. Fort Collins, CO: Colorado State University , 1998. |
| 19. | Westley CR, Cotton EK, Brook JG. Nebulized racemic epinephrine by IPPB for the treatment of croup: a double-blind study. Am J Dis Child 1978; 132: 484-487[Abstract]. |
| 20. | Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does the poor quality of reports of randomized trials exaggerate estimates of intervention effectiveness reported in meta-analysis? Lancet 1998; 352: 609-613[Medline]. |
| 21. | Moher D, Fortin P, Jadad AR, Juni P, Klassen T, LeLorier J, et al. Completeness of reporting of trials published in languages other than English: implications for conduct and reporting of systematic reviews. Lancet 1996; 347: 363-366[Medline]. |
| 22. | Klassen TP. Glucocorticoids in the treatment of croup: barking up the right tree. Can Med Assoc J 1998; 159: 1121-1122[Medline]. |
| 23. | Geelhoed GC. Sixteen years of croup in a Western Australian teaching hospital: effects of routine steroid treatment. Ann Emerg Med 1996; 28: 621-626[Medline]. |
| 24. | Martensson B, Nilson G, Torbjar J. The effect of corticosteroids in the treatment of pseudo-croup. Acta Otolaryngol 1960; 158(suppl): 62-71. |
| 25. | Novik A. Corticosteroid treatment of non-diptheritic croup. Acta Otolaryngol 1960; 158(suppl): 20-23. |
| 26. |
Sussman S, Grossman M, Magoffin R, Schieble J.
Dexamethasone (16 alpha-methyl, 9 alpha-fluoroprednisolone) in obstructive respiratory tract infections in children.
Pediatrics
1964;
34:
851-855 |
| 27. | Guyatt GH, Kirshner B, Jaeschke R. Measuring health status: what are the necessary measurement properties? J Clin Epidemiol 1992; 45: 1341-1345[Medline]. |
| 28. | Klassen TP, Rowe PC. The croup score as an evaluative instrument in clinical trials [abstract]. Arch Pediatr Adolesc Med 1995; 149: 60. |
(Accepted 2 June 1999)
Read all Rapid Responses
Israeli students are refusing to perform intimate examinations on anaesthetised women without their informed consent.