BMJ  2005;331:638 (17 September), doi:10.1136/bmj.331.7517.638

Letter

Review of publication bias in studies on publication bias

Meta-research on publication bias does not help transfer research results to patient care

Editor—Dubben and Beck-Bornholdt conclude that there is no evidence of publication bias in reports on publication bias.¹ Apart from the fact that funnel plots should be used only as a "tool" and not a "rule" in the evaluation of publication bias,² I question whether such "meta-research" really helps to improve patient care or facilitates the applicability of research results.

Systematic reviews help to improve patient care since pooling of appropriate data sometimes enables us to see the results without the noise of the random play of chance. All sources of bias are a potential threat to the credibility of meta-analyses. Despite efforts to ensure that the set of trials used in meta-analyses is a non-biased sample of all existing studies, a recent analysis on studies in the Cochrane database finds that publication bias may be present to some degree in about 50% of meta-analyses and strongly indicated in about 20%.³

What are the implications of these findings? When such facts are known, doubts arise on the applicability of such "skewed data." It is even harder to imagine the implications of the meta-research presented in by Dubben and Beck-Bornholdt.

Where do we go from here? Do we need another investigation that focuses on the biases associated with the publication of papers on the "publication bias in studies on publication bias"? What do the results mean other than that publication bias is no fiction: it exists in the real world.

For the clinician it may be reassuring to know that, in most cases, these biases did not affect the conclusions.³ Therefore, systematic reviews continue to represent a valuable tool to digest huge amounts of research or to find hidden "pearls of evidence" given the time constraints in daily business. This enables clinicians to focus on the "complicated, value laden, rewarding activity that is clinical medicine."⁴

Department of Anaesthesiology, University Hospital of Würzburg (Germany), Oberdürrbacher Strasse 6, D-97080 Würzburg, Germany kranke_p{at}klinik.uni-wuerzburg.de

---

Competing interests: None declared.

References

1. Dubben HH, Beck-Bornholdt HP. Systematic review of publication bias in studies on publication bias. BMJ 2005;331: 433-4. (20-27 August.)[Free Full Text]
2. Tang JL, Liu JL. Misleading funnel plot for detection of bias in meta-analysis. J Clin Epidemiol 2000;53: 477-84[CrossRef][ISI][Medline]
3. Sutton AJ, Duval SJ, Tweedie RL, Abrams KR, Jones DR. Empirical assessment of effect of publication bias on meta-analyses. BMJ 2000;320: 1574-7.[Abstract/Free Full Text]
4. Goodman NW. Is evidence-based medicine still an option? In: Tramèr M, ed. Evidence-based resource in anaesthesia and analgesia. London: BMJ Books, 2003; 3-11.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Relevant Articles

Systematic review of publication bias in studies on publication bias

Hans-Hermann Dubben and Hans-Peter Beck-Bornholdt
BMJ 2005 331: 433-434. [Full Text] [PDF]

Empirical assessment of effect of publication bias on meta-analyses

A J Sutton, S J Duval, R L Tweedie, K R Abrams, and D R Jones
BMJ 2000 320: 1574-1577. [Abstract] [Full Text] [PDF]