BMJ 2000;320:1574-1577 ( 10 June )

Papers

Empirical assessment of effect of publication bias on meta-analyses

A J Sutton, lecturer in medical statistics a,  S J Duval, assistant professor b,  R L Tweedie, head c,  K R Abrams, senior lecturer in medical statistics a,  D R Jones, professor in medical statistics a. 

a Department of Epidemiology and Public Health, University of Leicester, Leicester LE1 6TP, b Division of Epidemiology, School of Public Health, University of Minnesota, Minneapolis, USA, c Department of Biostatistics, School of Public Health, University of Minnesota

Correspondence to: A J Sutton ajs22{at}le.ac.uk

    Abstract
Top
Abstract
Introduction
Methods
Results
Discussion
References

Objective: To assess the effect of publication bias on the results and conclusions of systematic reviews and meta-analyses.
Design: Analysis of published meta-analyses by trim and fill method.
Studies: 48 reviews in Cochrane Database of Systematic Reviews that considered a binary endpoint and contained 10 or more individual studies.
Main outcome measures: Number of reviews with missing studies and effect on conclusions of meta-analyses.
Results: The trim and fill fixed effects analysis method estimated that 26 (54%) of reviews had missing studies and in 10 the number missing was significant. The corresponding figures with a random effects model were 23 (48%) and eight. In four cases, statistical inferences regarding the effect of the intervention were changed after the overall estimate for publication bias was adjusted for.
Conclusions: Publication or related biases were common within the sample of meta-analyses assessed. In most cases these biases did not affect the conclusions. Nevertheless, researchers should check routinely whether conclusions of systematic reviews are robust to possible non-random selection mechanisms.

    Introduction
Top
Abstract
Introduction
Methods
Results
Discussion
References

Selection bias is known to occur in meta-analyses because studies with results that are significant, interesting, from large well-funded studies, or of higher quality are more likely to be submitted, published, or published more rapidly than work without such characteristics.1 A meta-analysis based on a literature search will thus include such studies differentially, and the resulting bias may invalidate the conclusions.

The best way to deal with these problems, which we shall collectively label "publication bias," is to avoid them. Recently, for example, a trial amnesty was announced that encouraged researchers to submit for publication reports of previously unpublished trials.2 Additionally, steps are being taken to encourage the prospective registration of trials through trial registries.3 Although these steps may reduce the problem of publication bias in the future, it will remain a serious problem, and one that meta-analysts need to address for some time to come.

The simplest and most commonly used method to detect publication bias is an informal examination of a funnel plot.4 Formal tests for publication bias, such as those developed by Begg and Mazumdar5 and Egger et al,6 exist, but in practice few meta-analyses have assessed or adjusted for the presence of publication bias. A recent assessment of the quality of systematic reviews reported that only 6.5% and 3.2% of studies in high impact general and specialist journals respectively reported that a funnel plot had been examined.7 The uptake of any formal methods is lower still, although there are notable exceptions.8

The main aim of this paper is to assess what effect publication bias could have on the results and conclusions of meta-analyses of randomised controlled trials in general. We applied the trim and fill method to a set of meta-analyses contained within the Cochrane Database of Systematic Reviews9 and estimated the numbers of missing trials and their effects on the inferences in these meta-analyses. This method both tests for the presence of publication bias and adjusts for it. It is simpler to implement than previously described methods,10 and simulation studies suggest that it may outperform more sophisticated methods in many situations.

    Methods
Top
Abstract
Introduction
Methods
Results
Discussion
References

A funnel plot is a plot of each trial's effect size against some measure of its size, such as the precision (used here), the overall sample size, or the standard error (fig 1, top).4 These plots are referred to as funnel plots because they should be shaped like a funnel if no publication bias is present. This shape is expected because trials of smaller size (which are more numerous) have increasingly large variation in the estimates of their effect size as random variation becomes increasingly influential. However, since smaller or non-significant studies are less likely to be published, trials in the bottom left hand corner (when a desirable outcome is being considered) of the plot are often omitted, creating a degree of asymmetry in the funnel (fig 1, bottom).



View larger version (14K):
[in this window]
[in a new window]
  		Fig 1.   Typical funnel plot generated from 35 simulated studies (top) and same data with five missing studies showing a typical manifestation of publication bias (bottom)

We used the "trim and fill" method to evaluate bias in funnel plots.10-12 Firstly, the number of "asymmetric" trials on the right side of the funnel is estimated: these can broadly be thought of as trials which have no left side counterpart. These trials are then removed, or "trimmed," from the funnel, leaving a symmetric remainder from which the true centre of the funnel is estimated by standard meta-analysis procedures. The trimmed trials are then replaced and their missing counterparts imputed or "filled": these are mirror images of the trimmed trials with the mirror axis placed at the pooled estimate (see BMJ 's website for figure). This then allows an adjusted overall confidence interval to be calculated. A test for the presence of publication bias has also been derived from this method, based on the estimated number of missing trials.11

Selection and analysis of studies
We examined all reviews contained in the Cochrane Database of Systematic Reviews (1998, issue 3).9 Reviews including 10 or more trials reporting a binary outcome measure were included in the assessment. At most, one meta-analysis from each review was included, and when more than one met the inclusion criteria, the one containing the most studies was selected. If two or more contained the same number of studies, the one listed first in the review was chosen. The (log) odds ratio measure was used for analysis, and where data were sparse, a continuity correction of 0.5 was used.13 For consistency, funnel plots were reflected about zero for meta-analyses in which the reported outcome measure was "undesirable" so that the left hand side of the funnel plot was scrutinised for publication bias in every case.

For each meta-analysis, we trimmed the trials considered to be symmetrically unmatched (assumed to be the k right-most trials in each funnel). The number k was estimated by an iterative procedure (details given elsewhere10-12) using the estimator denoted L0. 11 12 We used fixed and random effects models to estimate the overall effect in order to assess the impact of choice of model on publication bias. The estimated effect of the missing trials provides an indication of whether the imputed missing studies affect the overall result of the meta-analysis.

    Results
Top
Abstract
Introduction
Methods
Results
Discussion
References

Included studies
At the time of the investigation, the Cochrane Library contained 397 reviews that included a meta-analysis. Of these, 49 included 10 or more trials with at least one dichotomous outcome. However, one of these did not assess a comparative effect and was excluded, leaving 48 meta-analyses for assessment. The number of trials included in each dataset ranged from 10 to 47 (median 13), with only four analyses including more than 20 trials.

Random effects meta-analyses of these datasets, ignoring possible publication bias, resulted in 28 estimates that reached significance at the 5% level, with the remaining 20 being inconclusive. The corresponding figures were 30 and 18 with a fixed effects model.

The funnel plots for all 48 meta-analyses are available on the BMJ 's website. Each trial's log odds ratio is plotted against the reciprocal of its standard error. The distribution of individual trial effect sizes is often highly irregular. Only a few of the plots closely conform to the classic funnel shape.

Estimated numbers of missing studies
Details of the estimates of the number of trials missed because of publication bias for each review are available on the BMJ 's website. In all, 23 meta-analyses were estimated to have some degree of publication bias (L0 >0) with the random effects model; this increased to 26 with the fixed effects model. The number of missing trials was significant if L0 >3 for the range of trials included in the meta-analyses evaluated here.12 Eight meta-analyses reached this critical level under the random effects model and 10 under the fixed effects model. These estimates suggest that about half of meta-analyses may be subject to some level of publication bias and about a fifth have a strong indication of missing trials.

Changes in significance and magnitude of the overall pooled estimates
Imputing missing trials changed the estimates of the overall effect for all meta-analyses in which one or more trials was estimated as missing. Use of the random effects model indicated that in four reviews this would lead to significant changes in the conclusions. Three meta-analyses that were considered significant at the 5% level in the original analysis became non-significant (studies 5, 10, 13), and one that was considered non-significant became significantly negative (study 30). These results seem plausible in the light of the trial distribution in figure 2, and thus we deduce that around 5-10% of meta-analyses may be interpreted incorrectly because of publication bias.

Figure 2 shows the effect of adjustment by the trim and fill method on the odds ratios for the 23 meta-analyses estimated to have one or more missing trials. Although only modest changes in outcome are observed in most instances, in six studies with a positive effect (studies 1, 3, 5, 10, 24, and 47) the reduction is greater than 30%. In two cases (studies 30 and 48) with a negative effect, adding missing studies had an even stronger effect (see table on BMJ 's website for details).



View larger version (17K):
[in this window]
[in a new window]
  		Fig 2.   Scatter plot of unadjusted versus adjusted odds ratios after filling with trim and fill method under random effects model. Dotted line is line of equality, and vertical distance away from this line indicates magnitude by which original pooled estimates have been reduced by adjusting for publication bias


    Discussion
Top
Abstract
Introduction
Methods
Results
Discussion
References

We found a clear indication of publication bias within this sample of studies from the Cochrane Database of Systematic Reviews. About half had some indication of publication bias, with a fifth having a strong indication. The potential effect of such bias varies from dataset to dataset. In some instances (for example, study 3) the number of studies estimated to be missing was relatively large but the adjusted estimate of effect size was only slightly lower than the original estimate. This can largely be explained by the presence of one or more studies that are much larger than those filled. These large studies have sufficient influence over the overall pooled estimate that asymmetry in the lower part of the funnel makes little impression on the overall pooled result. In other cases (for example, study 5), the estimated number of missing studies is smaller but the review's conclusions are altered.

The only other assessment of the impact of funnel plot asymmetry on a general collection of meta-analyses which is known to us is that of Egger et al,6 who applied their test to an earlier edition of the Cochrane Database of Systematic Reviews. Their inclusion criteria were less stringent than ours, including meta-analyses of categorical outcomes with five or more trials (compared with our minimum requirement of 10). They found significant indication of bias in five meta-analyses out of 38 examined (P<0.1). Our decision to include only meta-analyses with a minimum of 10 trials was largely arbitrary; however, five studies are usually too few to detect an asymmetric funnel.

Use of bias assessment
Although the development of methods for assessing publication bias has a reasonably long history, these methods are rarely used in practice.7 We searched the 48 original review reports from which the 48 meta-analyses were taken for references to publication bias and descriptions of any steps taken to deal with it. Thirty (63%) made no reference to publication bias. Five reviews mentioned examining a funnel plot, and three used the test of Egger et al. Since many of these reviews were written before that test was published, it has made a relatively high impact among reviewers subsequently. Generally, it was the more recently conducted reviews that had considered or tested for funnel plot asymmetry.

One possible reason for the lack of uptake of methods to deal with publication bias is that previous approaches have involved modelling methods that are difficult to implement and require lengthy calculations. The trim and fill method is both theoretically simple and easy and quick to implement. It may therefore be appropriate for routine use in evaluating meta-analyses. Our results seem plausible, with the four studies whose conclusions changed on adjustment all having visually skewed funnel plots.

Validity of results
Some cautionary remarks are needed in assessing our results. Since the method is based on the lack of symmetry in the funnel plot, and asymmetry might be due to factors other than publication bias,14 the results produced by trim and fill may not always reflect correction for publication bias. Moreover, the odds ratio outcome was used exclusively in this investigation. The appearance of a funnel plot can depend on the outcome measure used, and different results might be obtained in some instances if the risk difference or relative risk scale is used. The sensitivity of assessments of publication bias to the outcome measure used requires further investigation.


What is already known on this topic

Meta-analyses are subject to bias because smaller or non-significant studies are less likely to be published

Most meta-analyses do not consider the effect of publication bias on their results

What this study adds

A simple trim and fill adjustment method on studies in the Cochrane database suggests that publication bias may be present to some degree in about 50% of meta-analyses and strongly indicated in about 20%

Publication bias affected the results in less than 10% of meta-analyses

Researchers should always check for the presence of publication bias and perform a sensitivity analysis to assess the potential impact of missing studies

The idea of adjusting the results of meta-analyses for publication bias and imputing "fictional" studies into a meta-analysis is controversial.15 We certainly would not rely on results of imputed studies in forming a final conclusion, partly because asymmetry in a funnel plot may be due to factors other than publication bias. Any adjustment method should be used primarily as a form of sensitivity analysis, to assess the potential effect of missing studies on the meta-analysis, rather than as a means of adjusting results themselves.

If, as our study indicates, missing studies change the conclusions in less than 10% of meta-analyses, publication bias, although widespread, may not be a major practical problem. On the other hand, the fact that almost half the funnel plots examined seemed to exhibit some asymmetry leads us to conclude that routine evaluation for this bias should be an important step in any systematic review.

    Acknowledgments

   Contributors: AJS had the original idea for the study, extracted the relevant data from the Cochrane Database of Systematic Reviews, and assisted with the interpretation of the results. SJD assisted with the study design, carried out the trim and fill analyses, and assisted with the interpretation of the results. RLT assisted with the study design and the interpretation of the results. KRA and DRJ assisted with the interpretation of the results. The paper was written and revised jointly by all authors. AJS is the guarantor for this paper.

    Footnotes

Funding: None.

Competing interests: None declared.

Figures illustrating the method and funnel plots of all trials and a full table of results are available on the BMJ's website


    References
Top
Abstract
Introduction
Methods
Results
Discussion
References

1. Song F, Easterwood A, Gilbody S, Duley L, Sutton, AJ. Publication bias. In: Stevens A, Abrams K, Brazier J, Fitzpatrick R, Lilford R, eds. Handbook of research methods for evidence-based health care---insights from the NHS HTA programme. London: Sage Publications (in press).
2. Horton R. Medical editors trial amnesty. Lancet 1997; 350: 756[CrossRef][Medline]
3. Easterbrook PJ. Directory of registries of clinical trials. Stat Med 1992; 11: 345-423[Medline].
4. Begg CB. Publication bias. In: Cooper H, Hedges LV, eds. The handbook of research synthesis. New York: Russell Sage Foundation, 1994:399-409.
5. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994; 50: 1088-1101[CrossRef][Medline].
6. Egger M, Smith GD, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ 1997; 315: 629-634[Abstract/Free Full Text].
7. Tallon D, Schneider M, Egger M. Quality of systematic reviews published in high impact general and specialist journals. Proceedings of 2nd symposium on systematic reviews: beyond the basics, Oxford, 1999. (www.ihs.ox.ac.uk/csm/talks.html#p8; accessed 1 June 2000.)
8. Linde K, Clausius N, Ramirez G, Melchart D, Eitel F, Hedges LV, et al. Are the clinical effects of homoeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet 1997; 350: 834-843[CrossRef][Medline].
9. Cochrane database of systematic reviews. In: Cochrane Collaboration,ed. Cochrane Library. Issue 3. Oxford: Update Software, 1998.
10. Duval S, Tweedie R. Practical estimates of the effect of publication bias in meta-analysis. Australasian Epidemiologist 1998; 5: 14-17.
11. Duval S, Tweedie R. A non-parametric "trim and fill" method of assessing publication bias in meta-analysis. J Am Stat Ass (in press).
12. Duval S, Tweedie R. Trim and fill: a simple funnel plot based method of testing and adjusting for publication bias in meta-analysis. Biometrics (in press).
13. Sankey SS, Weissfeld LA, Fine MJ, Kapoor W. An assessment of the use of the continuity correction for sparse data in meta-analysis. Communications In Statistics---Simulation and Computation 1996; 25: 1031-1056.
14. Petticrew M, Gilbody S, Sheldon TA. Relation between hostility and coronary heart disease: evidence does not support link. BMJ 1999; 319: 917[Free Full Text].
15. Begg CB. Comment on Givens GH, Smith DD, Tweedie RL. Publication bias in meta-analysis: a Bayesian data-augmentation approach to account for issues exemplified in the passive smoking debate. Stat Sci 1997; 12: 221-250.

(Accepted 2 March 2000)

© BMJ 2000
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Related Articles

Review of publication bias in studies on publication bias: Meta-research on publication bias does not help transfer research results to patient care
Peter Kranke
BMJ 2005 331: 638. [Extract] [Full Text]

Review of publication bias in studies on publication bias: Here's a proposal for editors that may help reduce publication bias
M Maria Glymour and Ichiro Kawachi
BMJ 2005 331: 638. [Extract] [Full Text]

Passive smoking: Wider evidence needs to be interpreted
Julia Critchley
BMJ 2003 327: 501. [Extract] [Full Text]

Half of meta-analyses may contain publication bias
BMJ 2000 320: 0. [Full Text]

This article has been cited by other articles:

  • Carriquiry, M., Weber, W. J., Crooker, B. A. (2008). Administration of Bovine Somatotropin in Early Lactation: A Meta-Analysis of Production Responses by Multiparous Holstein Cows. J DAIRY SCI 91: 2641-2652 [Abstract] [Full text]  
  • Boluyt, N., van der Lee, J. H., Moyer, V. A., Brand, P. L. P., Offringa, M. (2007). State of the Evidence on Acute Asthma Management in Children: A Critical Appraisal of Systematic Reviews. Pediatrics 120: 1334-1343 [Abstract] [Full text]  
  • Leaper, C., Ayres, M. M. (2007). A Meta-Analytic Review of Gender Variations in Adults' Language Use: Talkativeness, Affiliative Speech, and Assertive Speech. Pers Soc Psychol Rev 11: 328-363 [Abstract]  
  • Sung, L., Nathan, P. C., Alibhai, S. M.H., Tomlinson, G. A., Beyene, J. (2007). Meta-analysis: Effect of Prophylactic Hematopoietic Colony-Stimulating Factors on Mortality and Outcomes of Infection. ANN INTERN MED 147: 400-411 [Abstract] [Full text]  
  • Iqbal, A., Schirmer, H., Lunde, P., Figenschau, Y., Rasmussen, K., Jorde, R. (2007). Thyroid Stimulating Hormone and Left Ventricular Function. J. Clin. Endocrinol. Metab. 92: 3504-3510 [Abstract] [Full text]  
  • Hall, R., de Antueno, C., Webber, A. (2007). Publication bias in the medical literature: a review by a Canadian Research Ethics Board: [Biais de publication dans la litterature medicale : un compte rendu d'un Comite d'ethique de recherche canadien]. Canadian J. Anesthesia 54: 380-388 [Abstract] [Full text]  
  • Strazzullo, P., Kerry, S. M., Barbato, A., Versiero, M., D'Elia, L., Cappuccio, F. P. (2007). Do Statins Reduce Blood Pressure?: A Meta-Analysis of Randomized, Controlled Trials. Hypertension 49: 792-798 [Abstract] [Full text]  
  • Braye, S., Preston-Shoot, M. (2007). On Systematic Reviews in Social Work: Observations from Teaching, Learning and Assessment of Law in Social Work Education. Br J Soc Work 37: 313-334 [Abstract] [Full text]  
  • Wiesbauer, F., Schlager, O., Domanovits, H., Wildner, B., Maurer, G., Muellner, M., Blessberger, H., Schillinger, M. (2007). Perioperative {beta}-Blockers for Preventing Surgery-Related Mortality and Morbidity: A Systematic Review and Meta-Analysis. Anesth. Analg. 104: 27-41 [Abstract] [Full text]  
  • Flores-Mir, C., Major, P. W. (2006). A systematic review of cephalometric facial soft tissue changes with the Activator and Bionator appliances in Class II division 1 subjects. Eur J Orthod 28: 586-593 [Abstract] [Full text]  
  • Dekker, A., Bulley, S., Beyene, J., Dupuis, L. L., Doyle, J. J., Sung, L. (2006). Meta-Analysis of Randomized Controlled Trials of Prophylactic Granulocyte Colony-Stimulating Factor and Granulocyte-Macrophage Colony-Stimulating Factor After Autologous and Allogeneic Stem Cell Transplantation. JCO 24: 5207-5215 [Abstract] [Full text]  
  • Oliveira, G. J., Leles, C. R. (2006). Critical appraisal and positive outcome bias in case reports published in brazilian dental journals.. J Dent Educ 70: 869-874 [Abstract] [Full text]  
  • Bagos, P G, Nikolopoulos, G, Ioannidis, A (2006). Chlamydia pneumoniae infection and the risk of multiple sclerosis: a meta-analysis. Mult Scler 12: 397-411 [Abstract]  
  • Abou-Setta, A. M., Mansour, R. T., Al-Inany, H. G., Aboulghar, M. A., Kamal, A., Aboulghar, M. A., Serour, G. I. (2006). Intrauterine insemination catheters for assisted reproduction: a systematic review and meta-analysis. Hum Reprod 21: 1961-1967 [Abstract] [Full text]  
  • Smith-Warner, S. A., Spiegelman, D., Ritz, J., Albanes, D., Beeson, W. L., Bernstein, L., Berrino, F., van den Brandt, P. A., Buring, J. E., Cho, E., Colditz, G. A., Folsom, A. R., Freudenheim, J. L., Giovannucci, E., Goldbohm, R. A., Graham, S., Harnack, L., Horn-Ross, P. L., Krogh, V., Leitzmann, M. F., McCullough, M. L., Miller, A. B., Rodriguez, C., Rohan, T. E., Schatzkin, A., Shore, R., Virtanen, M., Willett, W. C., Wolk, A., Zeleniuch-Jacquotte, A., Zhang, S. M., Hunter, D. J. (2006). Methods for Pooling Results of Epidemiologic Studies: The Pooling Project of Prospective Studies of Diet and Cancer. Am J Epidemiol 163: 1053-1064 [Abstract] [Full text]  
  • Athanasiou, T., Jones, C., Jin, R., Grunkemeier, G. L., Ross, D. N. (2006). Homograft Implantation Techniques in the Aortic Position: To Preserve or Replace the Aortic Root?. Ann. Thorac. Surg. 81: 1578-1585 [Abstract] [Full text]  
  • Smetana, G. W., Lawrence, V. A., Cornell, J. E. (2006). Preoperative pulmonary risk stratification for noncardiothoracic surgery: systematic review for the American College of Physicians.. ANN INTERN MED 144: 581-595 [Abstract] [Full text]  
  • Dentali, F., Crowther, M., Ageno, W. (2006). Thrombophilic abnormalities, oral contraceptives, and risk of cerebral vein thrombosis: a meta-analysis. Blood 107: 2766-2773 [Abstract] [Full text]  
  • Delgado-Rodriguez, M. (2006). Systematic reviews of meta-analyses: applications and limitations. J. Epidemiol. Community Health 60: 90-92 [Full text]  
  • Lagravere, M. O., Heo, G., Major, P. W., Flores-Mir, C. (2006). Meta-analysis of immediate changes with rapid maxillary expansion treatment. Journal of the American Dental Association 137: 44-53 [Abstract] [Full text]  
  • Kalus, J. S., Coleman, C. I., White, C. M. (2006). The Impact of Suppressing the Renin-Angiotensin System on Atrial Fibrillation. J Clin Pharmacol 46: 21-28 [Abstract] [Full text]  
  • Akobeng, A K, Ramanan, A V, Buchan, I, Heller, R F (2006). Effect of breast feeding on risk of coeliac disease: a systematic review and meta-analysis of observational studies. Arch. Dis. Child. 91: 39-43 [Abstract] [Full text]  
  • Collins, J. A., Blake, J. M., Crosignani, P. G. (2005). Breast cancer risk with postmenopausal hormonal treatment. Hum Reprod Update 11: 545-560 [Abstract] [Full text]  
  • Palma, S., Delgado-Rodriguez, M. (2005). Assessment of publication bias in meta-analyses of cardiovascular diseases. J. Epidemiol. Community Health 59: 864-869 [Abstract] [Full text]  
  • Kranke, P. (2005). Review of publication bias in studies on publication bias: Meta-research on publication bias does not help transfer research results to patient care. BMJ 331: 638-638 [Full text]  
  • Glymour, M M., Kawachi, I. (2005). Review of publication bias in studies on publication bias: Here's a proposal for editors that may help reduce publication bias. BMJ 331: 638-638 [Full text]  
  • Sin, D. D., Wu, L., Man, S. F. P. (2005). The Relationship Between Reduced Lung Function and Cardiovascular Mortality: A Population-Based Study and a Systematic Review of the Literature. Chest 127: 1952-1959 [Abstract] [Full text]  
  • Juffer, F., van IJzendoorn, M. H. (2005). Behavior Problems and Mental Health Referrals of International Adoptees: A Meta-analysis. JAMA 293: 2501-2515 [Abstract] [Full text]  
  • Tinmouth, A., MacDougall, L., Fergusson, D., Amin, M., Graham, I. D., Hebert, P. C., Wilson, K. (2005). Reducing the Amount of Blood Transfused: A Systematic Review of Behavioral Interventions to Change Physicians' Transfusion Practices. Arch Intern Med 165: 845-852 [Abstract] [Full text]  
  • Moles, D.R., Needleman, I.G., Niederman, R., Lau, J. (2005). Introduction to Cumulative Meta-analysis in Dentistry: Lessons Learned from Undertaking a Cumulative Meta-analysis in Periodontology. J. Dent. Res. 84: 345-349 [Abstract] [Full text]  
  • Streppel, M. T., Arends, L. R., van 't Veer, P., Grobbee, D. E., Geleijnse, J. M. (2005). Dietary Fiber and Blood Pressure: A Meta-analysis of Randomized Placebo-Controlled Trials. Arch Intern Med 165: 150-156 [Abstract] [Full text]  
  • Sung, L., Nathan, P. C., Lange, B., Beyene, J., Buchanan, G. R. (2004). Prophylactic Granulocyte Colony-Stimulating Factor and Granulocyte-Macrophage Colony-Stimulating Factor Decrease Febrile Neutropenia After Chemotherapy in Children With Cancer: A Meta-Analysis of Randomized Controlled Trials. JCO 22: 3350-3356 [Abstract] [Full text]  
  • Cappuccio, F. P, Kerry, S. M, Forbes, L., Donald, A. (2004). Blood pressure control by home monitoring: meta-analysis of randomised trials. BMJ 329: 145- [Abstract] [Full text]  
  • Healy, D G, Abou-Sleiman, P M, Lees, A J, Casas, J P, Quinn, N, Bhatia, K, Hingorani, A D, Wood, N W (2004). Tau gene and Parkinson's disease: a case-control study and meta-analysis. J. Neurol. Neurosurg. Psychiatry 75: 962-965 [Abstract] [Full text]  
  • Casas, J. P., Bautista, L. E., Humphries, S. E., Hingorani, A. D. (2004). Endothelial Nitric Oxide Synthase Genotype and Ischemic Heart Disease: Meta-Analysis of 26 Studies Involving 23028 Subjects. Circulation 109: 1359-1365 [Abstract] [Full text]  
  • Nathan, P. C., Sung, L., Crump, M., Beyene, J. (2004). Consolidation Therapy With Autologous Bone Marrow Transplantation in Adults With Acute Myeloid Leukemia: A Meta-analysis. JNCI J Natl Cancer Inst 96: 38-45 [Abstract] [Full text]  
  • Critchley, J. (2003). Passive smoking: Wider evidence needs to be interpreted. BMJ 327: 501-501 [Full text]  
  • Hoh, B. L., Rabinov, J. D., Pryor, J. C., Carter, B. S., Barker, F. G. II (2003). In-Hospital Morbidity and Mortality after Endovascular Treatment of Unruptured Intracranial Aneurysms in the United States, 1996-2000: Effect of Hospital and Physician Volume. Am. J. Neuroradiol. 24: 1409-1420 [Abstract] [Full text]  
  • Masson, L. F, McNeill, G., Avenell, A. (2003). Genetic variation and the lipid response to dietary intervention: a systematic review. Am. J. Clin. Nutr. 77: 1098-1111 [Abstract] [Full text]  
  • Critchley, J A, Unal, B (2003). Health effects associated with smokeless tobacco: a systematic review. Thorax 58: 435-443 [Abstract] [Full text]  
  • Astin, J. A., Shapiro, S. L., Eisenberg, D. M., Forys, K. L. (2003). Mind-Body Medicine: State of the Science, Implications for Practice. J Am Board Fam Med 16: 131-147 [Abstract] [Full text]  
  • Gaertner, R R W, Theriault, G P (2002). Risk of bladder cancer in foundry workers: a meta-analysis. Occup. Environ. Med. 59: 655-663 [Abstract] [Full text]  
  • Nelson, H. D., Humphrey, L. L., Nygren, P., Teutsch, S. M., Allan, J. D. (2002). Postmenopausal Hormone Replacement Therapy: Scientific Review. JAMA 288: 872-881 [Abstract] [Full text]  
  • Miller, J., Chan, B. K.S., Nelson, H. D. (2002). Postmenopausal Estrogen Replacement and Risk for Venous Thromboembolism: A Systematic Review and Meta-Analysis for the U.S. Preventive Services Task Force. ANN INTERN MED 136: 680-690 [Abstract] [Full text]  
  • Klassen, T. P., Wiebe, N., Russell, K., Stevens, K., Hartling, L., Craig, W. R., Moher, D. (2002). Abstracts of Randomized Controlled Trials Presented at the Society for Pediatric Research Meeting: An Example of Publication Bias. Arch Pediatr Adolesc Med 156: 474-479 [Abstract] [Full text]  
  • Song, F., Khan, K. S, Dinnes, J., Sutton, A. J (2002). Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. Int J Epidemiol 31: 88-95 [Abstract] [Full text]  
  • Thoennissen, J., Herkner, H., Lang, W., Domanovits, H., Laggner, A. N., Mullner, M. (2001). Does bed rest after cervical or lumbar puncture prevent headache? A systematic review and meta-analysis. CMAJ 165: 1311-1316 [Abstract] [Full text]  
  • Copas, J B, Shi, J Q (2001). A sensitivity analysis for publication bias in systematic reviews. Stat Methods Med Res 10: 251-265 [Abstract]  
  • McQueen, M. J. (2001). Overview of Evidence-based Medicine: Challenges for Evidence-based Laboratory Medicine. Clin. Chem. 47: 1536-1546 [Abstract] [Full text]  
  • Sterne, J. A C, Egger, M., Smith, G. D. (2001). Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. BMJ 323: 101-105 [Full text]  
  • Ross, S. D. (2001). Drug-Related Adverse Events: A Readers' Guide to Assessing Literature Reviews and Meta-analyses. Arch Intern Med 161: 1041-1046 [Full text]  
  • Schwartz, M. D (2001). Review: prokinetics and histamine-2 receptor antagonists improve symptom scores in non-ulcer dyspepsia. Evid. Based Med. 6: 47-47 [Full text]  
  • Sutton, A. J, Song, F., Gilbody, S. M, Abrams, K. R (2000). Modelling publication bias in meta-analysis: a review. Stat Methods Med Res 9: 421-445 [Abstract]  

Rapid Responses:

Read all Rapid Responses

High false positive rate for trim and fill method
Jonathan A C Sterne
bmj.com, 21 Jul 2000 [Full text]
Re: High false positive rate for trim and fill method
Alex J Sutton
bmj.com, 22 Sep 2000 [Full text]

Student BMJ

Intimate examinations

Israeli students are refusing to perform intimate examinations on anaesthetised women without their informed consent.

www.student.bmj.com

Listen to the latest BMJ Interview