BMJ 2000;320:537-540 ( 26 February )

Papers

Systematic reviews and meta-analyses on treatment of asthma: critical evaluation

Alejandro R Jadad, professor a,  Michael Moher, Royal College of General Practitioners research training fellow b,  George P Browman, professor a,  Lynda Booker, research assistant a,  Christopher Sigouin, doctoral student a,  Mario Fuentes, research assistant c,  Robert Stevens, research assistant c. 

a Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Canada L8N 3Z5, b Institute of Health Sciences, University of Oxford, Headington, Oxford OX3 7LF, c Foresight Consultants, Dundas, Ontario, Canada L9H 2R5

Correspondence to: A R Jadad jadada{at}fhs.mcmaster.ca


    Abstract
Top
Abstract
Introduction
Methods
Results
Discussion
References

Objective: To evaluate the clinical, methodological, and reporting aspects of systematic reviews and meta-analyses on the treatment of asthma and to compare those published by the Cochrane Collaboration with those published in paper based journals.
Design: Analysis of studies identified from Medline, CINAHL, HealthSTAR, EMBASE, Cochrane Library, personal collections, and reference lists.
Studies: Articles describing a systematic review or a meta-analysis of the treatment of asthma that were published as a full report, in any language or format, in a peer reviewed journal or the Cochrane Library.
Main outcome measures: General characteristics of studies reviewed and methodological characteristics (sources of articles; language restrictions; format, design, and publication status of studies included; type of data synthesis; and methodological quality).
Results: 50 systematic reviews and meta-analyses were included. More than half were published in the past two years. Twelve reviews were published in the Cochrane Library and 38 were published in 22 peer reviewed journals. Forced expiratory volume in one second was the most frequently used outcome, but few reviews evaluated the effect of treatment on costs or patient preferences. Forty reviews were judged to have serious or extensive flaws. All six reviews associated with industry were in this group. Seven of the 10 most rigorous reviews were published in the Cochrane Library.
Conclusions: Most reviews published in peer reviewed journals or funded by industry have serious methodological flaws that limit their value to guide decisions. Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals.

    Introduction
Top
Abstract
Introduction
Methods
Results
Discussion
References

One of the most important challenges for anyone treating patients with asthma is the need to cope with vast amounts of information about an ever increasing number of new devices and drugs. The abundance of information often makes it difficult to establish the most appropriate drug or regimen to use in a given clinical situation.1

During the past two decades, interest has risen in the use of systematic reviews as tools to help decision makers cope with information overload. These reviews, in their ideal form, include an explicit description of how they were conducted and incorporate strategies to minimise bias and maximise precision. 2 3 These reviews can also include meta-analysis (the statistical combination of the results of several independent studies to produce a single estimate of the effect of a particular intervention or healthcare situation).4 However, most systematic reviews and meta-analyses published in peer reviewed journals have methodological deficiencies that may limit their validity.5-12

Recently, important initiatives have emerged to improve the methodological quality of systematic reviews and meta-analyses. Perhaps the most prominent is the Cochrane Collaboration, a large international group 11 13 that seems to be producing reviews that are more rigorous and better reported than those published in peer reviewed journals. 9 14 We evaluated the quality of published systematic reviews and meta-analyses on the treatment of asthma and compared the characteristics of Cochrane reviews with those in peer reviewed journals.

    Methods
Top
Abstract
Introduction
Methods
Results
Discussion
References

Inclusion criteria
To be included, a report had to be described as a systematic review or a meta-analysis of the treatment of asthma and to be published in full, in any language or format, in a journal or the Cochrane Library.

Literature search and study selection
We identified eligible studies by a search up to July 1998 in Medline (from 1966), CINAHL (from 1982), HealthSTAR (from 1975), and EMBASE (from 1984) using a refined search strategy (see BMJ's website for details).9 This was complemented by a search of the Cochrane Library (issue 3, 1998) with the term "asthma" and searches of personal collections and the reference lists of eligible studies.

Independently, two of us (LB and ARJ) reviewed the citations identified by the search strategy to judge their eligibility. The final decision on inclusion in the review was made by consensus.

Data extraction
Three trained reviewers (MF, LB, RS) extracted data independently using unmasked reports.15 The final set was agreed by consensus, and differences were resolved by a fourth reviewer (ARJ).

Data were extracted on the general characteristics of the studies (authors, sources of funding, and source, year, place, and language of publication); clinical issues (population, intervention, condition, and outcomes reviewed), methodological characteristics (language restrictions; number, format, design, and publication status of the studies included; data synthesis; heterogeneity testing; and methodological quality); and conclusions. Methodological quality was assessed with Oxman and Guyatt's index, a validated tool that scores reviews on a seven point scale. 8 16 Reports were regarded as having serious or extensive flaws if they received a score of 1 to 3, and as having minimal or minor flaws if they received scores from 4 to 7.

Data analysis
Reviews were divided according to publication in the Cochrane Library or journals and to the presence or absence of association with industry. The Wilcoxon rank-sum test (two sided) was used to compare the number of authors, included studies, and sources and the overall quality scores. Fisher's exact test (two sided) was used to compare the responses to the first nine items in Oxman and Guyatt's index and also the proportion of reviews that described the primary outcomes, selection criteria, and heterogeneity testing and the number of reviews with language restrictions between the Cochrane Library and journals. Values of P<0.05 were regarded as significant.

    Results
Top
Abstract
Introduction
Methods
Results
Discussion
References

General characteristics
We identified 50 eligible reviews (see BMJ's website for full list). The first review identified was published in 1988. Twenty nine (58%) of the reviews were published in 1997 and 1998. Twelve reviews were published in the Cochrane Library, and the remaining 38 were published in 22 peer reviewed journals. Only one review appeared in both groups. None of the reviews published in journals represented updated versions of earlier work. The journal with the highest number of reviews was Annals of Pharmacotherapy (seven) followed by the Journal of Allergy and Clinical Immunology and Respiratory Medicine (four each). Table 1 gives other characteristics of the reviews.


                              
View this table:
[in this window]
[in a new window]
 

Table 1. Characteristics of 50 reviews of treatment of asthma

Methodological characteristics
The number of studies included in the reviews varied from 2 to 97. Most of the reviews (37) included randomised controlled trials, but three included non-randomised trials with contemporaneous controls and one included case series. In 14 reviews (including some of those mentioned in the previous sentence) the exact type of studies was either unclear or not reported. Seven of the 50 reviews included unpublished articles and nine included articles available only in abstract form. None of the reviews published in peer reviewed journals had been updated.

Methodological quality
Forty reviews obtained quality scores of 3 or less, which is compatible with serious or extensive flaws. All six reviews associated with industry were in this group (table 2). None of these reviews described efforts to reduce selection bias; one described the search strategy, one described the methods used to assess the quality of the studies, and three reported the methods used to combine data across studies (table 2). All but one17 of these studies had results and conclusions that favoured the interventions related to the companies sponsoring the reviews. The number of reviews associated with industry was too small to warrant meaningful statistical comparisons with other reviews.


                              
View this table:
[in this window]
[in a new window]
 

Table 2. Methodological quality of systematic reviews and meta-analyses of the treatment of asthma. Values are number of affirmative answers/number of reviews relevant to each question

Analysis of individual components of Oxman and Guyatt's index showed that 66% of the reviews stated the search methods used to find the evidence, 52% included a reasonably comprehensive search for evidence, 56% reported the inclusion criteria, 30% included measures to avoid selection bias, 28% reported the criteria used to assess the validity of the included studies, 24% used appropriate criteria for validity assessment, 52% reported the methods used to synthesise findings, and 50% had conclusions supported by the data or the analysis reported in the review (table 2). In addition, 20 reviews (40%) included heterogeneity testing, 16 (32%) stated the primary outcome of interest to the reviewers, and eight (16%) included assessment of publication bias. We found no significant difference in the proportion of reviews with favourable results between those with minimal or minor flaws and those with serious or extensive flaws (1/10 v 11/40, P=0.416).

Cochrane reviews versus reviews in peer reviewed journals
Of the 10 reviews with scores of 4 or more, seven were published in the Cochrane Library. Cochrane reviews had higher overall quality scores than those published in peer reviewed journals (median 6 v 2, P<0.005). Compared with reviews published in journals, more Cochrane reviews had adequate reporting of the search strategy, had comprehensive search strategies, described the inclusion criteria, made efforts to avoid bias during the selection of the studies, reported the criteria for assessing the quality of the studies, reported the methods used to combine study findings, and combined the findings of the relevant studies appropriately (table 2). Fewer Cochrane reviews had language restrictions (0/12 v 21/38, P<0.005) and more included heterogeneity testing (9 v 11, P=0.007).

There were no significant differences between the groups in the number of authors, the number of studies reviewed, assessment of publication bias, and identification of primary outcomes.

Findings of reviews
Twelve reviews identified an intervention as better than the control treatment. None of the reviews reported patient preferences. The box gives the conclusions of the reviews with minimal flaws.


Findings of studies with minimal flaws

Peer reviewed journals

  • Use of oral and intravenous steroids early in the treatment of asthma exacerbations reduces hospital admissions in adults and children; steroids are effective in preventing relapse in outpatient management of exacerbations; and oral and intravenous steroids seem to have equivalent effects on pulmonary function during acute exacerbations18
  • Addition of ipratropium bromide to beta  agonist significantly improves the predicted forced expiratory volume in one second but gives no clinical improvement19
  • Bronchodilator delivery through a meter dosed inhaler or wet nebuliser is equivalent in acute treatment of asthma20

Cochrane Library

  • Limited asthma education is unlikely to improve health outcomes in adults with asthma21
  • Addition of a single inhalation of anticholinergics to a beta  agonist regimen may improve lung function but has no notable effect on hospital admissions. Multiple doses may avoid hospital admission in 1 of 11 treated patients22
  • A short course of corticosteroids (oral or intramuscular) after an acute exacerbation of asthma (of variable and poorly reported severity at baseline) reduces the number of relapses and decreases use of beta  agonist without apparent increase in adverse effects23
  • There is no indication for routine use of methotrexate in patients receiving long term treatment with oral steroids24
  • Prophylaxis with single doses of nedocromil sodium1-8 mg inhibits the severity and duration of exercise induced bronchoconstriction. Benefits seem greatest in patients with more severe symptoms25
  • Allergen specific immunotherapy reduces the symptoms and drug requirements but has no consistent effect on lung function. The effects are greater in patients with allergen specific bronchial hyperreactivity than in those with non-specific hyperreactivity26
  • Chemical and physical measures to reduce exposure to mites or their products at home seem to be ineffective27



    Discussion
Top
Abstract
Introduction
Methods
Results
Discussion
References

The number of systematic reviews and meta-analyses evaluating the treatment of asthma is increasing. Most of the reviews have clinical relevance but have methodological limitations that could have been avoided easily. Future reviews should include comprehensive and well reported search strategies, attempts to reduce bias during the selection of the studies, assessment of the validity of the studies, and clear description of the methods used to synthesise the data available. Few reviews address safety issues or the effect of treatment on quality of life, costs, or patient preferences.

This study also confirms that Cochrane reviews are more rigorous than reviews published in peer reviewed journals. 9 14 Several factors may explain the differences. Cochrane reviews follow standardised instructions, are peer reviewed at several levels, and receive input from different groups at different stages.13 One limitation of our analyses is that the tool used for quality assessments was developed by Andrew Oxman, who led the development of the methodology of Cochrane reviews.

Perhaps peer reviewed journals could improve the quality of the systematic reviews they publish by providing authors and peer reviewers with clear reporting criteria, including those followed by Cochrane reviewers, 28 29 by influencing the review process at a much earlier stage, and by promoting more frequent updates or correction of published material on the internet. Authors should be particularly careful when doing reviews in association with industry, as such reviews have been shown to have an increased risk of producing results in favour of the interventions promoted by the sponsors.12 This was the case for all but one of the reviews associated with industry in our study. The only review that did not favour an intervention was designed to evaluate the effects of vitamin C on asthma, not a new proprietary compound.17

Bridging the gap between methodological research and methodological practice will require unprecedented efforts by researchers, consumers, funders, journal editors, and peer reviewers. Efforts made by members of the Cochrane Collaboration are already contributing to filling the gap and should be emulated by peer reviewed journals.


What is already known on this topic

Systematic reviews and meta-analyses could help decision makers cope with information overload

The number of systematic reviews and meta-analyses evaluating asthma treatments is increasing

What this study adds

Most reviews of asthma treatment published in peer reviewed journals or funded by industry have serious methodological flaws that limit their usefulness

Cochrane reviews are more rigorous and better reported than those published in peer reviewed journals

The clinically relevant messages from the 10 most rigorous reviews are summarised



    Acknowledgments

We thank Ann Murray for editorial assistance. The review was coordinated by Foresight Consultants, a division of Foresight Links Corporation.

Contributors: ARJ (guarantor) initiated and designed the study, participated in data collection and analysis, wrote the first draft of the paper, collated comments from the other authors, and incorporated the comments of the peer reviewers into the final version. MM and GB provided input to the design of the study, contributed to the design of the data extraction forms, and commented on all the drafts of the paper. LB, MF, and RS provided input to the data extraction forms and extracted the data from the reviews. CS was responsible for data checking and the statistical analysis.

    Footnotes

Funding: Foresight Consultants was commissioned by AstraZeneca Research and Development Lund, Sweden, and AstraZeneca US to perform an independent review of this topic through an unrestricted contract. Representatives from AstraZeneca did not participate in the study selection or appraisal or in the analysis of the data. ARJ was supported in part by a National Health Research Scholar Award from Health Canada, Ottawa, Ontario.

Competing interests: ARJ is codirector of the Canadian Cochrane Network and Centre.

website extra: Details of the search strategy and all included studies are available on the BMJ's website www.bmj.com

    References
Top
Abstract
Introduction
Methods
Results
Discussion
References

1. O'Byrne PM. Clinical comparisons of inhaler systems---what are the important aspects. J Aer Med 1995; 8: S39-S47.
2. Mulrow CD. Rationale for systematic reviews. In: Chalmers I, Altman DG, eds. Systematic reviews. London: BMJ Publishing, 1995:1-8.
3. Oxman AD, Guyatt GH. Guidelines for reading literature reviews. Can Med Ass J 1988; 138: 687-703.
4. Lau J, Ioannidis JPA, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med 1997; 127: 820-826[Abstract/Free Full Text].
5. Sacks HS, Berrier J, Reitman D, Pagano D, Chalmers T. Meta-analyses of randomized control trials: an update of the quality and methodology. In: Bailar JC, III,Mosteller F, eds. Medical uses of statistics. Boston: New England Medical Journal Publications, 1992:427-442.
6. Sacks HS, Reitman D, Pagano D, Kupelnick B. Meta-analysis: an update. Mount Sinai J Med 1996; 3-4: 216-224.
7. Assendelft WJJ, Koes BW, Knipschild PG, Bouter LM. The relationship between methodological quality and conclusions in reviews of spinal manipulation. JAMA 1995; 274: 1942-1948[Abstract/Free Full Text].
8. Jadad AR, McQuay HJ. Meta-analyses to evaluate analgesic interventions: a systematic qualitative review of their methodology. J Clin Epidemiol 1996; 49: 235-243[CrossRef][Medline].
9. Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, Moher M, et al. Methodology and reports of systematic reviews and meta-analyses: a comparison of Cochrane reviews with articles published in paper-based journals. JAMA 1998; 280: 278-280[Abstract/Free Full Text].
10. Moher D, Jadad AR, Cook DJ, Jones A, Klassen TP, Tugwell P, et al. Does the poor quality of reports of randomized trials exaggerate estimates of intervention effectiveness reported in meta-analyses? Lancet 1998; 352: 609-613[CrossRef][Medline].
11. Bero LA, Rennie D. Influences on the quality of published drug trials. Int J Technol Assess Health Care 1996; 12: 209-237[Medline].
12. Barnes EC, Bero L. Why review articles on the health effects of passive smoking reach different conclusions. JAMA 1998; 279: 1566-1570[Abstract/Free Full Text].
13. Jadad AR, Haynes RB. The Cochrane Collaboration---advances and challenges in improving evidence-based decision making. Med Decis Making 1998; 18: 2-9[Abstract/Free Full Text].
14. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629-634[Abstract/Free Full Text].
15. Berlin JA, for the University of Pennsylvania Meta-analysis Blinding Study Group. Does blinding of readers affect the results of meta-analyses? Lancet 1997; 350: 185-186[Medline].
16. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol 1991; 44: 1271-1278[CrossRef][Medline].
17. Bielory L, Gandhi R. Asthma and vitamin C. Ann Allergy 1994; 73: 89-96[Medline].
18. Rowe BH, Keller JL, Oxman AD. Effectiveness of steroid therapy in acute exacerbations of asthma: a meta-analysis. Am J Emerg Med 1992; 10: 301-310[CrossRef][Medline].
19. Osmond MH, Klassen TP. Efficacy of ipratropium bromide in acute childhood asthma: a meta-analysis. Acad Emerg Med 1995; 2: 651-656[Medline].
20. Turner MO, Patel A, Ginsburg S, FitzGerald JM. Bronchodilator delivery in acute airflow obstruction. A meta-analysis. Arch Intern Med 1997; 157: 1736-1744[Abstract/Free Full Text].
21. Gibson PG, Coughlan J, Wilson AJ, Hensley MJ, Abramson M, Bauman A, et al. The effects of limited (information only) patient education programs on the health outcomes of adults with asthma. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
22. Plotnick LH, Ducharme FM. Efficacy and safety of combined inhaled anticholinergics and beta-s-agonists in the initial management of acute pediatric asthma. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
23. Rowe BH, Spooner CH, Ducharme FM, Bretzlaff JA, Bota GW. The effectiveness of corticosteroids in the treatment of acute exacerbations of asthma: a meta-analysis of their effect on relapse following acute assessment. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
24. Davies H, Olson L, Gibson P. Methotrexate as a steroid sparing agent in adult asthma. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
25. Spooner CH, Saunders LD, Rowe BH. Nedocromil sodium as single dose prophylactic treatment of exercise-induced bronchoconstriction. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
26. Abramson MJ, Puy RM, Weiner JM. Allergen specific immunotherapy for asthma. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
27. Hammerquist C, Burr ML, Gotzsche PC. House dust mite control measures in the management of asthma. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
28. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, Stroup DF, for the QUOROM Group. Improving the quality of reports of meta-analyses of randomized controlled trials: the QUOROM statement [Eprint, unreviewed]. Lancet Interactive www.thelancet.com/newlancet/reg/issues/vol354no9172/commentary2.html (accessed 18 October, 1999).
29. Shea B, Dube C, Moher D. Assessing the quality of reports of systematic reviews and meta-analyses: a systematic review of checklists and scales. Abstract presented at the VII Cochrane Colloquium. 1999.

(Accepted 13 December 1999)

© BMJ 2000
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Articles

Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study
Veronica Yank, Drummond Rennie, and Lisa A Bero
BMJ 2007 335: 1202-1205. [Abstract] [Full Text] [PDF]

Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review
Anders W Jørgensen, Jørgen Hilden, and Peter C Gøtzsche
BMJ 2006 333: 782. [Abstract] [Full Text] [PDF]

Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study
Giuseppe G L Biondi-Zoccai, Marzia Lotrionte, Antonio Abbate, Luca Testa, Enrico Remigi, Francesco Burzotta, Marco Valgimigli, Enrico Romagnoli, Filippo Crea, and Pierfrancesco Agostoni
BMJ 2006 332: 202-209. [Abstract] [Full Text] [PDF]

Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study
Lorenzo P Moja, Elena Telaro, Roberto D'Amico, Ivan Moschetti, Laura Coe, Alessandro Liberati on behalf of the Metaquality Study Group
BMJ 2005 330: 1053. [Abstract] [Full Text] [PDF]

The quality of systematic reviews
Stephen Senn, Douglas G Altman, Jonathan J Deeks, Mike Clarke, Christopher Cates, N C Barnes, C Hallett, T A J Harris, Carole Wilson, Paula Waugh, Paul Garner, Alejandro R Jadad, Michael Moher, George P Browman, Lynda Booker, Christopher Sigouin, Mario Fuentes, and Robert Stevens
BMJ 2000 321: 297. [Extract] [Full Text] [PDF]

Systematic reviews and meta-analyses are often flawed
BMJ 2000 320: 0. [Full Text]

Advances in managing chronic disease
Ronald M Davis, Edward G Wagner, and Trish Groves
BMJ 2000 320: 525-526. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

  • Rowe, B. H., Voaklander, D. C., Wang, D., Senthilselvan, A., Klassen, T. P., Marrie, T. J., Rosychuk, R. J. (2009). Asthma Presentations by Adults to Emergency Departments in Alberta, Canada: A Large Population-Based Study. Chest 135: 57-65 [Abstract] [Full text]  
  • Nkoy, F. L., Fassl, B. A., Simon, T. D., Stone, B. L., Srivastava, R., Gesteland, P. H., Fletcher, G. M., Maloney, C. G. (2008). Quality of Care for Children Hospitalized With Asthma. Pediatrics 122: 1055-1063 [Abstract] [Full text]  
  • Boluyt, N., Tjosvold, L., Lefebvre, C., Klassen, T. P., Offringa, M. (2008). Usefulness of Systematic Review Search Strategies in Finding Child Health Systematic Reviews in MEDLINE. Arch Pediatr Adolesc Med 162: 111-116 [Abstract] [Full text]  
  • Garg, A. X., Hackam, D., Tonelli, M. (2008). Systematic Review and Meta-analysis: When One Study Is Just not Enough. CJASN 3: 253-260 [Full text]  
  • Yank, V., Rennie, D., Bero, L. A (2007). Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ 335: 1202-1205 [Abstract] [Full text]  
  • Boluyt, N., van der Lee, J. H., Moyer, V. A., Brand, P. L. P., Offringa, M. (2007). State of the Evidence on Acute Asthma Management in Children: A Critical Appraisal of Systematic Reviews. Pediatrics 120: 1334-1343 [Abstract] [Full text]  
  • Lathyris, D. N, Trikalinos, T. A, Ioannidis, J. P. (2007). Evidence from crossover trials: empirical evaluation and comparison against parallel arm trials. Int J Epidemiol 36: 422-430 [Abstract] [Full text]  
  • Jorgensen, A. W, Hilden, J., Gotzsche, P. C (2006). Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ 333: 782- [Abstract] [Full text]  
  • Waters, E., Doyle, J., Jackson, N., Howes, F., Brunton, G., Oakley, A. (2006). Evaluating the effectiveness of public health interventions: the role and activities of the Cochrane Collaboration.. J. Epidemiol. Community Health 60: 285-289 [Abstract] [Full text]  
  • Biondi-Zoccai, G. G L, Lotrionte, M., Abbate, A., Testa, L., Remigi, E., Burzotta, F., Valgimigli, M., Romagnoli, E., Crea, F., Agostoni, P. (2006). Compliance with QUOROM and quality of reporting of overlapping meta-analyses on the role of acetylcysteine in the prevention of contrast associated nephropathy: case study. BMJ 332: 202-209 [Abstract] [Full text]  
  • Tattersfield, A E (2005). When should a long acting {beta} agonist be added to an inhaled corticosteroid?. Thorax 60: 710-710 [Full text]  
  • Moja, L. P, Telaro, E., D'Amico, R., Moschetti, I., Coe, L., Liberati, A., on behalf of the Metaquality Study Group, (2005). Assessment of methodological quality of primary studies by systematic reviews: results of the metaquality cross sectional study. BMJ 330: 1053- [Abstract] [Full text]  
  • Gilligan, P, Law, H, Lumsden, G, Brenchley, J, Kitching, G, Taylor, A, Khan, A, Shepherd, M, Jones, J, Hegarty, D (2005). SOCRATES 3 (synopsis of Cochrane reviews applicable to emergency services). Emerg. Med. J. 22: 50-52 [Full text]  
  • Eng, J., Krishnan, J. A., Segal, J. B., Bolger, D. T., Tamariz, L. J., Streiff, M. B., Jenckes, M. W., Bass, E. B. (2004). Accuracy of CT in the Diagnosis of Pulmonary Embolism: A Systematic Literature Review. Am. J. Roentgenol. 183: 1819-1827 [Abstract] [Full text]  
  • Als-Nielsen, B., Chen, W., Gluud, C., Kjaergard, L. L. (2003). Association of Funding and Conclusions in Randomized Drug Trials: A Reflection of Treatment Effect or Adverse Events?. JAMA 290: 921-928 [Abstract] [Full text]  
  • Jewitt, K., Hughes, R. (2003). SYSTEMATIC REVIEWS TO HELP GUIDE CLINICAL PRACTICE IN NEUROMUSCULAR DISEASE. J. Neurol. Neurosurg. Psychiatry 74: ii43-44 [Full text]  
  • Lexchin, J., Bero, L. A, Djulbegovic, B., Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 326: 1167-1170 [Abstract] [Full text]  
  • Astin, J. A., Shapiro, S. L., Eisenberg, D. M., Forys, K. L. (2003). Mind-Body Medicine: State of the Science, Implications for Practice. J Am Board Fam Med 16: 131-147 [Abstract] [Full text]  
  • Linde, K., Willich, S. N (2003). How objective are systematic reviews? Differences between reviews on complementary medicine. JRSM 96: 17-22 [Abstract] [Full text]  
  • McDonald, E., Cook, D., Newman, T., Griffith, L., Cox, G., Guyatt, G. (2002). Effect of Air Filtration Systems on Asthma: A Systematic Review of Randomized Trials. Chest 122: 1535-1542 [Abstract] [Full text]  
  • Shea, B., Moher, D., Graham, I., Pham, B., Tugwell, P. (2002). A Comparison of the Quality of Cochrane Reviews and Systematic Reviews Published in Paper-Based Journals. Eval Health Prof 25: 116-129 [Abstract]  
  • FIELD, S K, SUTHERLAND, L R, GIBSON, P (2001). Gastro-oesophageal reflux and asthma. Thorax 56: 898-898 [Full text]  
  • Olsen, O., Middleton, P., Ezzo, J., Gotzsche, P. C, Hadhazy, V., Herxheimer, A., Kleijnen, J., McIntosh, H. (2001). Quality of Cochrane reviews: assessment of sample from 1998. BMJ 323: 829-832 [Abstract] [Full text]  
  • Hopayian, K. (2001). The need for caution in interpreting high quality systematic reviews. BMJ 323: 681-684 [Full text]  
  • T-L. Choi, P., Halpern, S. H., Malik, N., Jadad, A. R., Tramer, M. R., Walder, B. (2001). Examining the Evidence in Anesthesia Literature: A Critical Appraisal of Systematic Reviews. Anesth. Analg. 92: 700-709 [Abstract] [Full text]  
  • Senn, S., Greig, A D, Ram, F. S F, Shrewsbury, S., Pyke, S., Britton, M. (2000). Meta-analysis of increased inhaled steroid or addition of salmeterol in asthma. BMJ 321: 1016a-1016 [Full text]  
  • Senn, S., Altman, D. G, Deeks, J. J, Clarke, M., Cates, C., Barnes, N C, Hallett, C, Harris, T A J, Wilson, C., Waugh, P., Garner, P., Jadad, A. R, Moher, M., Browman, G. P, Booker, L., Sigouin, C., Fuentes, M., Stevens, R. (2000). The quality of systematic reviews. BMJ 321: 297-297 [Full text]  
  • (2000). A Systematic Review of Systematic Reviews. JWatch General 2000: 10-10 [Full text]  
  • Davis, R. M, Wagner, E. G, Groves, T. (2000). Advances in managing chronic disease. BMJ 320: 525-526 [Full text]  

Rapid Responses:

Read all Rapid Responses

A never-ending trail...
Eyal Shahar
bmj.com, 25 Feb 2000 [Full text]
Biased review
Stephen Senn
bmj.com, 26 Feb 2000 [Full text]
Systematic review
Alan M Edwards
bmj.com, 2 Mar 2000 [Full text]
The quality of systematic reviews
Douglas G Altman
bmj.com, 17 Mar 2000 [Full text]
Erratum
Cecilia Hammarquist
bmj.com, 28 Mar 2000 [Full text]
Meta-analysis: if it's not stated, was it done?
C Hallett
bmj.com, 11 Apr 2000 [Full text]
Use of HEPA filter vacume cleaner in house dust mite control
J W Fletcher
bmj.com, 28 Jun 2000 [Full text]
Doc2Doc Vacancy
Access jobs at BMJ Careers
Whats new online at Student BMJ