BMJ 2007;335:914-916 (3 November), doi:10.1136/bmj.39343.408449.80
Analysis
Uncertainty in heterogeneity estimates in meta-analyses
John P A Ioannidis, professor,
Nikolaos A Patsopoulos, research associate,
Evangelos Evangelou, research associate
Clinical Trials and Evidence-Based Medicine Unit, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina 45110, Greece
Correspondence to: J P A Ioannidis jioannid@cc.uoi.gr
John Ioannidis, Nikolaos Patsopoulos, and Evangelos Evangelou argue that, although meta-analyses often measure heterogeneity between studies, these estimates can have large uncertainty, which must be taken into account when interpreting evidence
| The first 150 words of the full text of this article appear below. |
Summary points
- The extent of between study heterogeneity should be measured when interpreting results of meta-analyses
- Meta-analyses rarely document uncertainty in estimates of heterogeneity
- Our evaluation of a large number of meta-analyses shows a wide range of uncertainty about the extent of heterogeneity in most
- Confidence intervals of I2 should be calculated and considered when interpreting meta-analyses
| |
An important aim of systematic reviews and meta-analyses is to assess the extent to which different studies give similar or dissimilar results.1 Clinical, methodological, and biological heterogeneity are often topic specific, but statistical heterogeneity can be examined with the same methods in all meta-analyses. Therefore, the perception of statistical heterogeneity or homogeneity often influences meta-analysts and clinicians in important decisions. These decisions include whether the data are similar enough to combine different studies; whether a treatment is applicable to all or should be "individualised" because of variable benefits or harms in different types of patients; . . . [Full text of this article]
Evaluating heterogeneity between studies
Interpreting heterogeneity in selected meta-analyses
Uncertainty in I2: large scale survey of meta-analyses
Technical aspects
Concluding comments

CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
Technorati What's this?
Related Articles
-
Reasons or excuses for avoiding meta-analysis in forest plots
- John P A Ioannidis, Nikolaos A Patsopoulos, and Hannah R Rothstein
BMJ 2008 336: 1413-1415.
[Extract]
[Full Text]
[PDF]
-
Doctors versus patients global assessments of treatment effectiveness: empirical survey of diverse treatments in clinical trials
- Evangelos Evangelou, Georgios Tsianos, and John P A Ioannidis
BMJ 2008 336: 1287-1290.
[Abstract]
[Full Text]
[PDF]
-
Antithrombin III in critically ill patients
- A Torossian, J Graf, and A Bauhofer
BMJ 2007 335: 1219-1220.
[Extract]
[Full Text]
[PDF]
-
Sedative hypnotics in older people with insomnia: meta-analysis of risks and benefits
- Jennifer Glass, Krista L Lanctôt, Nathan Herrmann, Beth A Sproule, and Usoa E Busto
BMJ 2005 331: 1169.
[Abstract]
[Full Text]
[PDF]
-
Angiotensin receptor blockers and risk of myocardial infarction: systematic review
- Michael A McDonald, Scot H Simpson, Justin A Ezekowitz, Gabor Gyenes, and Ross T Tsuyuki
BMJ 2005 331: 873.
[Abstract]
[Full Text]
[PDF]
-
Tacrolimus versus ciclosporin as primary immunosuppression for kidney transplant recipients: meta-analysis and meta-regression of randomised trial data
- Angela C Webster, Rebecca C Woodroffe, Rod S Taylor, Jeremy R Chapman, and Jonathan C Craig
BMJ 2005 331: 810.
[Abstract]
[Full Text]
[PDF]
-
Effectiveness of innovations in nurse led chronic disease management for patients with chronic obstructive pulmonary disease: systematic review of evidence
- Stephanie J C Taylor, Bridget Candy, Rosamund M Bryar, Jean Ramsay, Hubertus J M Vrijhoef, Glenda Esmond, Jadwiga A Wedzicha, and Chris J Griffiths
BMJ 2005 331: 485.
[Abstract]
[Full Text]
[PDF]
-
How strong is the evidence for the use of perioperative
blockers in non-cardiac surgery? Systematic review and meta-analysis of randomised controlled trials
- P J Devereaux, W Scott Beattie, Peter T-L Choi, Neal H Badner, Gordon H Guyatt, Juan C Villar, Claudio S Cinà, Kate Leslie, Michael J Jacka, Victor M Montori, Mohit Bhandari, Alvaro Avezum, Alexandre B Cavalcanti, Julian W Giles, Thomas Schricker, Homer Yang, Carl-Johan Jakobsen, and Salim Yusuf
BMJ 2005 331: 313-321.
[Abstract]
[Full Text]
[PDF]
-
Treatment of ocular hypertension and open angle glaucoma: meta-analysis of randomised controlled trials
- Philip C Maier, Jens Funk, Guido Schwarzer, Gerd Antes, and Yngve T Falck-Ytter
BMJ 2005 331: 134.
[Abstract]
[Full Text]
[PDF]
-
Psychosocial and psychological interventions for prevention of postnatal depression: systematic review
- Cindy-Lee Dennis
BMJ 2005 331: 15.
[Abstract]
[Full Text]
[PDF]
-
Measuring inconsistency in meta-analyses
- Julian P T Higgins, Simon G Thompson, Jonathan J Deeks, and Douglas G Altman
BMJ 2003 327: 557-560.
[Extract]
[Full Text]
[PDF]
-
Systematic Reviews: Obtaining data from randomised controlled trials: how much do we need for reliable and informative meta-analyses?
- M J Clarke and L A Stewart
BMJ 1994 309: 1007-1010.
[Extract]
[Full Text]
This article has been cited by other articles:
-
Ioannidis, J. P A, Patsopoulos, N. A, Rothstein, H. R
(2008). Reasons or excuses for avoiding meta-analysis in forest plots. BMJ
336: 1413-1415
[Full text]
-
Evangelou, E., Tsianos, G., Ioannidis, J. P A
(2008). Doctors' versus patients' global assessments of treatment effectiveness: empirical survey of diverse treatments in clinical trials. BMJ
336: 1287-1290
[Abstract]
[Full text]
-
Clark, W. F., Sontrop, J. M.
(2008). What Have We Learned about Optimal Induction Therapy for Lupus Nephritis (III through V) from Randomized, Controlled Trials?. CJASN
3: 895-898
[Full text]
-
Barbui, C., Signoretti, A., Mule, S., Boso, M., Cipriani, A.
(2008). Does the Addition of a Second Antipsychotic Drug Improve Clozapine Treatment?. Schizophr Bull
0: sbn030v1-sbn030
[Abstract]
[Full text]
-
Patsopoulos, N. A, Evangelou, E., Ioannidis, J. P.
(2008). Sensitivity of between-study heterogeneity in meta-analysis: proposed metrics and empirical evaluation. Int J Epidemiol
0: dyn065v1-dyn065
[Abstract]
[Full text]
-
Torossian, A, Graf, J, Bauhofer, A
(2007). Antithrombin III in critically ill patients. BMJ
335: 1219-1220
[Full text]