Papers

Bias in meta-analysis detected by a simple, graphical test

^a Department of Social Medicine, University of Bristol, Bristol BS8 2PR, ^b Department of Social and Preventive Medicine, University of Berne, CH-3012 Berne, Switzerland

Correspondence to: Dr Egger m.egger@bristol.ac.uk

	Abstract

Top Abstract Introduction Methods Results Discussion References

Objective: Funnel plots (plots of effect estimates against sample size) may be useful to detect bias in meta-analyses that were later contradicted by large trials. We examined whether a simple test of asymmetry of funnel plots predicts discordance of results when meta-analyses are compared to large trials, and we assessed the prevalence of bias in published meta-analyses.
Design: Medline search to identify pairs consisting of a meta-analysis and a single large trial (concordance of results was assumed if effects were in the same direction and the meta-analytic estimate was within 30% of the trial); analysis of funnel plots from 37 meta-analyses identified from a hand search of four leading general medicine journals 1993-6 and 38 meta-analyses from the second 1996 issue of the Cochrane Database of Systematic Reviews.
Main outcome measure: Degree of funnel plot asymmetry as measured by the intercept from regression of standard normal deviates against precision.
Results: In the eight pairs of meta-analysis and large trial that were identified (five from cardiovascular medicine, one from diabetic medicine, one from geriatric medicine, one from perinatal medicine) there were four concordant and four discordant pairs. In all cases discordance was due to meta-analyses showing larger effects. Funnel plot asymmetry was present in three out of four discordant pairs but in none of concordant pairs. In 14 (38%) journal meta-analyses and 5 (13%) Cochrane reviews, funnel plot asymmetry indicated that there was bias.
Conclusions: A simple analysis of funnel plots provides a useful test for the likely presence of bias in meta-analyses, but as the capacity to detect bias will be limited when meta-analyses are based on a limited number of small trials the results from such analyses should be treated with considerable caution.

	Introduction

Top Abstract Introduction Methods Results Discussion References

Systematic reviews of the best available evidence regarding the benefits and risks of medical interventions can inform decision making in clinical practice and public health.^{1 2} Such reviews are, whenever possible, based on meta-analysis: "a statistical analysis which combines or integrates the results of several independent clinical trials considered by the analyst to be 'combinable.' "³ However, the findings of some meta-analyses have later been contradicted by large randomised controlled trials.⁴ Such discrepancies have brought discredit on a technique that has been controversial since the outset.⁵ The appearance of misleading meta-analysis is not surprising considering the existence of publication bias and the many other biases that may be introduced in the process of locating, selecting, and combining studies.^{6 7 8 9}

Funnel plots, plots of the trials' effect estimates against sample size, may be useful to assess the validity of meta-analyses.^{4 10} The funnel plot is based on the fact that precision in estimating the underlying treatment effect will increase as the sample size of component studies increases. Results from small studies will scatter widely at the bottom of the graph, with the spread narrowing among larger studies. In the absence of bias the plot will resemble a symmetrical inverted funnel. Conversely, if there is bias, funnel plots will often be skewed and asymmetrical.

The value of the funnel plot has not been systematically examined, and symmetry (or asymmetry) has generally been defined informally, through visual examination. Unsurprisingly, funnel plots have been interpreted differently by different observers.¹¹ We measured funnel plot asymmetry numerically and examined the extent to which such asymmetry predicts discordance of results when meta-analyses are compared to single large trials of the same issue. We used the same method to assess the prevalence of funnel plot asymmetry, and thus of possible bias, among meta-analyses published in leading general medicine journals and meta-analyses disseminated electronically by the Cochrane Collaboration.

	Methods

Top Abstract Introduction Methods Results Discussion References

Measures of funnel plot asymmetry
We used a linear regression approach to measure funnel plot asymmetry on the natural logarithm scale of the odds ratio. This corresponds to a regression analysis of Galbraith's radial plot,¹² although in the present context the regression is not constrained to run through the origin. The standard normal deviate (SND), defined as the odds ratio divided by its standard error, is regressed against the estimate's precision, the latter being defined as the inverse of the standard error (regression equation: SND= a+ bxprecision). As precision depends largely on sample size, small trials will be close to zero on the x axis. Small trials may produce an odds ratio that differs from unity, but because the standard error will be large, the resulting standard normal deviate will again be close to zero. Small trials will thus be close to zero on both axes—that is, close to the origin. Conversely, large studies will produce precise estimates and, if the treatment is effective, also produce large standard normal deviates. The points from a homogeneous set of trials, not distorted by selection bias, will thus scatter about a line that runs through the origin at standard normal deviate zero (a=0), with the slope b indicating the size and direction of effect.¹² This situation corresponds to a symmetrical funnel plot.

If there is asymmetry, with smaller studies showing effects that differ systematically from larger studies, the regression line will not run through the origin. The intercept a provides a measure of asymmetry—the larger its deviation from zero the more pronounced the asymmetry. If the smaller studies show big protective effects, they will force the regression line below the origin on the logarithmic scale. Negative values will therefore indicate that smaller studies show more pronounced beneficial effects than larger studies. In some situations (for example, if there are several small trials but only one larger study) power is gained by weighting the analysis by the inverse of the variance of the effect estimate. We performed both weighted and unweighted analyses and used the output from the analysis yielding the intercept with the larger deviation from zero.

In contrast to the overall test of heterogeneity, the test for funnel plot asymmetry assesses a specific type of heterogeneity and provides a more powerful test in this situation. However, any analysis of heterogeneity depends on the number of trials included in a meta-analysis, which is generally small, and this limits the statistical power of the test. We therefore based evidence of asymmetry on P<0.1, and we present intercepts with 90% confidence intervals. The same significance level has been used in previous analyses of heterogeneity in meta-analysis.^{13 14}

Identification of meta-analyses and matching large randomised trials
A Medline search (Knight Ridder Information Services, Berne, Switzerland) covering the period January 1985 to April 1996 was performed in April 1996 to identify published meta-analyses. For this purpose the word "meta-analysis" was entered in a free text search. The articles identified included all those indexed with the Medical Subject Heading (MeSH) keyword "meta-analysis," which was introduced in 1989, and articles without the keyword which carried the word meta-analysis in their title or abstract. Results were tabulated by source of publication, and the items published in journals which yielded 30 or more hits were examined further. Meta-analyses of controlled trials combining at least five trials with binary endpoints were identified.

Large scale randomised controlled trials of the same interventions which had been published after the meta-analyses were identified by a Medline search using appropriate keywords. Large trials had to provide an effect estimate with a precision of at least 5. For example, a trial among patients with heart failure in which mortality in the control group at three months is 5%¹⁵ and in which mortality is reduced to 3% among treated patients will need to randomise 2800 patients to measure this effect with a precision of 5 and about 12 000 patients for a precision of 10. Also, the effect estimate from the large trials had to be of equal or greater precision than the meta-analysis. We scrutinised potential matching pairs of meta-analyses and large trials with regard to study participants, interventions, end points and lengths of follow up. In some cases a further Medline search was performed to identify a meta-analysis published in any journal indexed in Medline which would be more suitable for comparison with the large trial.

Some meta-analyses were published several years before the corresponding large trial. In these cases we examined whether the shape of the funnel plot changed when the meta-analysis was updated with trials published in the intervening period.

Concordance and discordance of results
Comparison of results from meta-analyses and large trials required expressing results on a common scale. Odds ratios were used for this purpose. The meta-analysis and the large trial were considered concordant when effects were in the same direction and the estimates from the meta-analysis were within 30% of the estimate of the single trial. A difference of 30% was proposed by Villar et al to denote high similarity between the results from meta-analyses and large trials.¹¹

SAS version 6.11 software package (Statistical Analysis System, Cary, NC) was used for statistical analysis.

Frequency of asymmetry in funnel plots
We performed a hand search of four leading general medicine journals, Annals of Internal Medicine, BMJ, JAMA, and Lancet, from 1993 to 1996 and examined the second 1996 issue of the Cochrane Database of Systematic Reviews¹⁶ to identify meta-analyses of controlled trials. Analyses that were based on at least five trials with categorical end points were examined further. For each intervention and comparison, the outcome measure which was reported in the largest number of trials was selected. To obtain consistency across reviews, end points were recorded if necessary so that the direction of effect for the expected beneficial outcome was in the same direction. For example, in a review of trials of nicotine patches in smoking cessation, continued smoking rather than quitting was considered to be the outcome, so that an odds ratio above unity indicates an adverse effect.

We identified 38 Cochrane reviews and 37 journal meta-analyses. All references of meta-analyses and trials included are available from the authors on request.

	Results

Top Abstract Introduction Methods Results Discussion References

Eight pairs consisting of a meta-analysis and a large trial were identified (table 1).^{14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30} Five were from cardiovascular medicine, one from diabetic medicine, one from geriatric medicine, and one from perinatal medicine. Effect estimates from meta-analyses had an average precision of 7.9 compared with 14.4 for large trials. There were four concordant pairs^{15 17 18 19 20 21 22 26} and four discordant pairs^{14 23 24 25 27 28 29 30} (fig 1). In all cases discordance was a consequence of the meta-analyses showing more beneficial effects than the large trials. Three out of four discordant meta-analyses showed significant (P<0.1) funnel plot asymmetry; funnel plots from concordant pairs showed no significant asymmetry (2, table 2).

View larger version (33K): [in this window] [in a new window]   Fig 1 Results from four concordant and four discordant pairs of meta-analysis and large scale randomised controlled trial

View larger version (24K): [in this window] [in a new window]   Fig 2 Funnel plots and single large trials. Points indicate odds ratios from trials included in meta-analysis; squares with horizontal lines show odds ratio from large trial with 95% confidence interval. See table 1 for abbreviations of trial names

Additional trials were identified for three meta-analyses published several years earlier than the large trial.^{26 27 29} These were extracted from more recent meta-analyses.^{4 31 32} When the meta-analysis of trials of intravenous magnesium in myocardial infarction was updated with five additional trials the intercept indicated even greater asymmetry (-1.36 (90% confidence interval -2.06 to -0.66), P=0.005). When 13 additional trials were added to the analysis of trials of angiotensin converting enzyme inhibitors in heart failure the plot remained symmetrical (intercept 0.07 (-0.53 to 0.67), P=0.85). When the analysis of aspirin for the prevention of pre-eclampsia was updated with nine additional trials, the funnel plot became asymmetrical (intercept -1.49 (-2.20 to -0.79), P=0.003) (fig 3).

View larger version (11K): [in this window] [in a new window]   Fig 3 Funnel plot of trials of low dose aspirin in the prevention of pre-eclampsia. Trials included in Imperiale and Stollenwerk's 1991 meta-analysis (closed circles),29 trials published in subsequent years (1990 to 1993, open circles) and the large 1994 CLASP (collaborative low-dose aspirin study in pregnancy) trial (square with horizontal line indicating 95% confidence interval)30

Figure 4 shows the distribution of regression intercepts from 38 Cochrane reviews and 37 journal meta-analyses. In the absence of bias, random fluctuations should produce a symmetrical distribution of intercepts around a central value of zero, with an equal number of positive and negative values. This is not what was observed. Distributions were shifted towards negative values, with a mean of -0.24 (-0.65 to 0.17) for Cochrane reviews and -1.00 (-1.50 to -0.49) for journal meta-analyses There were 24 negative and 14 positive intercepts among Cochrane reviews (P=0.10 by sign test) and 26 negative and 11 positive intercepts among journal meta-analyses (P=0.007 by sign test). In five (13%) Cochrane reviews and 14 (38%) journal meta-analyses there was evidence of significant (P<0.1) asymmetry.

View larger version (33K): [in this window] [in a new window]   Fig 4 Distribution of intercepts from regression analysis of funnel plot asymmetry for 38 meta-analyses from the Cochrane Database of Systematic Reviews, 1996 (upper panel) and 37 meta-analyses published in Annals of Internal Medicine, BMJ, JAMA, and Lancet 1993 through 1996 (lower panel)

	Discussion

Top Abstract Introduction Methods Results Discussion References

The selective publication of positive findings from randomised controlled trials is an important concern in meta-analytic reviews of the literature.⁹ If the literature is more likely to contain trials showing beneficial effects of treatments, and if equally valid trials showing no effect remain unpublished, how can systematic reviews of this literature serve as an objective guide to decision making in clinical practice and health policy? The potentially serious consequences of such publication bias have been realised for some time, and there have been repeated calls for worldwide registration of clinical trials at inception.^{1 4 33 34 35} Although registration of trials and creation of a database holding the results of both published and unpublished trials would solve the problem, it is unlikely that this will be widely instituted in the foreseeable future.

Critical examination for the presence of publication and related biases must therefore become an essential part of meta-analytic studies and systematic reviews. The findings presented here indicate that a simple graphical and statistical method is useful for this purpose. When testing this method on pairs consisting of meta-analyses and single large trials of the same intervention, we found asymmetry in funnel plots in three out of four pairs with discordant results. The fourth was based on only six trials, and asymmetry emerged when it was updated with further studies.

Sources of funnel plot asymmetry
Publication bias has long been associated with funnel plot asymmetry.¹⁰ Among published studies, however, the probability of identifying relevant trials for meta-analysis is also influenced by their results. English language bias—the preferential publication of "negative" findings in journals published in languages other than English—makes the location and inclusion of such studies less likely.⁸ As a consequence of citation bias, "negative" studies are quoted less frequently and are therefore more likely to be missed in the search for relevant trials.^{7 36} Results of "positive" trials are sometimes reported more than once, increasing the probability that they will be located for meta-analysis (multiple publication bias).³⁷ These biases are likely to affect smaller studies to a greater degree than large trials.

Another source of asymmetry arises from differences in methodological quality. Smaller studies are, on average, conducted and analysed with less methodological rigour than larger studies. Trials of lower quality also tend to show the larger effects.^{38 39 40} The degree of symmetry found in a funnel plot may depend on the statistic used to measure effect. Odds ratios overestimate the relative reduction, or increase, in risk if the event rate is high.⁴¹ This can lead to funnel plot asymmetry if the smaller trials were consistently conducted in patients at higher risk. Similarly, if events accrue at a constant rate, relative risks will move towards unity with increasing length of follow up. In large trials, follow up is often longer than in small studies. Finally, an asymmetrical funnel plot may arise by chance.

The trials displayed in a funnel plot may not estimate the same underlying effect of the intervention, and such heterogeneity between results may lead to asymmetry in funnel plots. For example, if a combined outcome is considered then substantial benefit may be seen only in patients at high risk for the component of the combined outcome that is affected by the intervention.⁴² A cholesterol lowering drug that reduces mortality from coronary heart disease will have a greater effect on all cause mortality in high risk patients with established cardiovascular disease than in asymptomatic patients with isolated hypercholesterolaemia. This is because a consistent relative reduction in mortality from coronary heart disease will translate into a greater relative reduction in all cause mortality in high risk patients, in whom a greater proportion of all deaths will be from coronary heart disease. This will produce asymmetry in funnel plots if the smaller trials were performed in high risk patients.

Small trials are generally conducted before larger trials are established. In the intervening years, control treatments may have improved or changed in a way that could reduce the efficacy of the experimental treatment. Such a mechanism has been proposed as an explanation for the discrepant results obtained in clinical trials of the effect of magnesium infusion in myocardial infarction,⁴³ although this interpretation is not supported by the data from clinical trials.⁴⁴ Finally, some interventions may have been implemented less thoroughly in larger trials, thus explaining the more positive results in smaller trials. This could have occurred in one of the interventions considered in our comparison of meta-analysis and single large trials, inpatient geriatric consultation.¹⁴

Very different mechanisms can thus lead to asymmetry in funnel plots, as summarised in the box. It is important to note, however, that this will always be associated with a biased overall estimate of effect when studies are combined in a meta-analysis. The more pronounced the asymmetry, the more likely it is that the amount of bias will be substantial. The exception to this rule arises when asymmetry is produced by chance alone.

How frequent is bias in meta-analysis?
Several studies have recently tried to evaluate the validity of meta-analysis. Villar et al analysed 38 meta-analyses from the pregnancy and childbirth module of the 1993 Cochrane database by comparing the results from the largest trial with the remaining smaller studies.⁴⁵ On the basis of the direction of estimates of treatment effects, they concluded that 80% of meta-analyses were in total or partial agreement with the results from the larger "gold standard" trial. In a similar study, Cappelleri et al analysed 79 meta-analyses and concluded that there was agreement between smaller trials and large trials in over 80%.¹³ In both these analyses, however, the precision of the large trials was low in a sizeable proportion of comparisons. The larger trials in fact often provided an estimate of lower precision than the meta-analysis of the smaller studies. In this situation, concordance between the two could simply be due to the fact that estimates with large, overlapping confidence intervals are unlikely to be classified as discordant.⁴⁶

We thought that stringent criteria were necessary for identifying single large trials that could sensibly be used to assess the results from meta-analyses of smaller trials. As a result, the large trials used in our analysis on average provided an estimate of considerably greater precision that the corresponding meta-analyses. Despite an extensive literature search, we identified only eight such pairs. The matched pair approach may therefore not be suitable assessing the frequency of misleading meta-analysis. However, our results indicate that an asymmetrical funnel plot makes bias likely. The prevalence of funnel plot asymmetry may thus provide a useful proxy measure to examine the prevalence of biased analyses in the literature. Our findings indicate that bias may be present in a small proportion of meta-analyses published in the Cochrane Database of Systematic Reviews. Bias may be considerably more prevalent, however, among meta-analyses published in leading general medicine journals. Whether such bias is likely to affect the conclusions of a systematic review or meta-analysis must be carefully assessed for each case.

Begg and Mazumbar proposed a rank correlation test to measure asymmetry in funnel plots.⁴⁷ The method is based on the degree of association between the size of effect estimates and their variances. If publication bias is present, the smaller studies will show the larger effects. A positive correlation between effect size and variance emerges in this situation because the variance of the estimates from smaller studies will also be large. When we applied their test to the eight meta-analyses, it indicated significant (P<0.1) asymmetry for only one meta-analysis (inpatient geriatric consultation¹⁴). This indicates that the linear regression approach may be more powerful than the rank correlation test.

Conclusions
In the absence of large, conclusive trials for most medical interventions, systematic reviews based on randomised controlled trials are clearly the best strategy for appraising the evidence. Selection bias and other biases pose a serious threat to the validity of this approach, however, and care must be taken to avoid meta-analysis becoming discredited. The technique discussed here should contribute to this goal, providing a reproducible measure for the likely presence, or apparent absence, of such biases. It is easily calculated and provides summary statistics that can be reported when space limitations do not permit the display of funnel plots. Though more methodological research is required, the critical examination for the presence of publication and related biases should be considered a routine procedure. The capacity to unearth such bias will, however, be limited when meta-analyses are based exclusively on small trials. There is no statistical solution in this situation, and the results from such analyses should therefore be treated with caution.

	Acknowledgements

We are grateful to Andreas Stuck and Gilbert Ramirez for kindly providing additional data.

Funding: Swiss National Science Foundation (grants 3200-045597 and 3233-038803).

Conflict of interest: None.

	References

Top Abstract Introduction Methods Results Discussion References

1. Chalmers I, Dickersin K, Chalmers TC. Getting to grips with Archie Cochrane's agenda. BMJ 1992;305:786-8.
2. Mulrow CD. Rationale for systematic reviews. BMJ 1994;309:597-9. [Free Full Text]
3. Huque MF. Experiences with meta-analysis in NDA submissions. Proc Biopharmaceutical Section Am Statist Assoc 1988;2:28-33.
4. Egger M, Davey Smith G. Misleading meta-analysis. Lessons from "an effective, safe, simple" intervention that wasn't. BMJ 1995;310:752-4. [Free Full Text]
5. Eysenck HJ. An exercise in mega-silliness. Am Psychol 1978;33:517.
6. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991;337:867-72.
7. Gøtzsche PC. Reference bias in reports of drug trials. BMJ 1987;295:654-6.
8. Egger M, Zellweger-Zähner T, Schneider M, Junker C, Lengeler C, Antes G. Language bias in randomised controlled trials published in English and German. Lancet 1997;350:326-9. [Medline]
9. Egger M, Davey Smith G. Meta-analysis: bias in location and selection of studies. BMJ (in press).
10. Light RJ, Pillemer DB. Summing up. The science of reviewing research. Cambridge, MA: Harvard University Press, 1984.
11. Villar J, Piaggio G, Carroli G, Donner A. Factors affecting the comparability of meta-analyses and largest trials results in perinatology. J Clin Epidemiol 1997;50:997-1002. [Medline]
12. Galbraith R. A note on graphical presentation of estimated odds ratios from several clinical trials. Stat Med 1988;7:889-94.
13. Cappelleri JC, Ioannidis JPA, Schmid CH, de Ferranti SD, Aubert M, Chalmers TC, et al. Large trials vs meta-analysis of smaller trials. How do their results compare? JAMA 1996;276:1332-8.
14. Stuck AE, Siu AL, Wieland GD, Adams J, Rubenstein LZ. Comprehensive geriatric assessment: a meta-analysis of controlled trials. Lancet 1993;342:1032-6. [Medline]
15. SOLVD investigators. Effect of enalapril on survival in patients with reduced left ventricular ejection fractions and congestive heart failure. N Engl J Med 1991;325:293-302. [Abstract]
16. The Cochrane Database of Systematic Reviews. Oxford: Cochrane Collaboration, 1996.
17. Yusuf S, Collins R, Peto R, Furberg C, Stampfer MJ, Goldhaber SZ, et al. Intravenous and intracoronary fibrinolytic therapy in acute myocardial infarction: overview of results on mortality, reinfarction and side-effects from 33 randomized controlled trials. Eur Heart J 1985;6:556-85.
18. Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI). Effectiveness of intravenous thrombolytic treatment in acute myocardial infarction. Lancet 1986;i:397-402.
19. Yusuf S, Peto R, Lewis J, Collins R, Sleight P. Beta blockade during and after myocardial infarction: an overview of the randomized trials. Progr Cardiovasc Dis 1985;17:335-71.
20. ISIS-1 Collaborative Group. Randomised trial of intravenous atenolol among 16 027 cases of suspected acute myocardial infarction: ISIS-1. Lancet 1986;ii:57-66.
21. Wang PH, Lau J, Chalmers TC. Meta-analysis of effects of intensive blood-glucose control on late complications of type I diabetes. Lancet 1993;341:1306-9. [Medline]
22. Diabetes Control and Complications Trial Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med 1993;329:977-86.
23. Reuben DB, Borok GM, Wolde-Tsadik G, Ershoff DH, Fishman LK, Ambrosini VL, et al. Randomized trial of comprehensive geriatric assessment in the care of hospitalized patients. N Engl J Med 1995;332:1345-50.
24. Yusuf S, Collins R, MacMahon S, Peto R. Effect of intravenous nitrates on mortality in acute myocardial infarction: an overview of the randomised trials. Lancet 1988;i:1088-92.
25. Gruppo Italiano per lo Studio della Streptochinasi nell'Infarto Miocardico (GISSI). GISSI-3: effects of lisinopril and transdermal glyceryl trinitrate singly and together on 6-week mortality and ventricular function after acute myocardial infarction. Lancet 1994;343:1115-22.
26. Mulrow CD, Mulrow JP, Linn WD, Aguilar C, Ramirez G. Relative efficacy of vasodilator therapy in chronic congestive heart failure. JAMA 1988;259:3422-6. [Abstract/Free Full Text]
27. Teo KK, Yusuf S. Role of magnesium in reducing mortality in acute myocardial infarction. A review of the evidence. Drugs 1993;46:347-59. [Medline]
28. ISIS-4 Collaborative Group. ISIS-4: a randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58,050 patients with suspected acute myocardial infarction. Lancet 1995;345:669-87. [Medline]
29. Imperiale TF, Stollenwerk Petrullis A. A meta-analysis of low-dose aspirin for the prevention of pregnancy-induced hypertensive disease. JAMA 1991;266:261-5.
30. CLASP Collaborative Group. CLASP: a randomized trial of low-dose aspirin for the prevention and treatment of pre-eclampsia among 9364 pregnant women. Lancet 1994;343:619-29.
31. Garg R, Yusuf S for the Collaborative Group on ACE Inhibitor Trials. Overview of randomised trials of angiotensin-converting enzyme inhibitors on mortality and morbidity in patients with heart failure. JAMA 1995;273:1450-6.
32. Collins R. Antiplatelet agents for IUGR and pre-eclampsia. In: Enkin MW, Keirse MJNC, Renfrew MJ, Neilson JP, eds. Pregnancy and childbirth module, Cochrane Database of Systematic Reviews. Oxford: Update Software, 1994. (Review No 04000, 12 March 1994. Cochrane Updates on Disk, disk issue 3.)
33. Chalmers I. Underreporting research is scientific misconduct. JAMA 1990;263:1405-8. [Abstract/Free Full Text]
34. Levy G. Publication bias: its implications for clinical pharmacology. Clin Pharmacol Ther 1992;52:115-9.
35. Savulescu J, Chalmers I, Blunt J. Are research ethics committees behaving unethically? Some suggestions for improving performances and accountability. BMJ 1996;313:1390-3. [Free Full Text]
36. Ravnskov U. Cholesterol lowering trials in coronary heart disease: frequency of citation and outcome. BMJ 1992;305:15-9.
37. Huston P, Moher D. Redundancy, disaggregation, and the integrity of medical research. Lancet 1996;347:1024-6.
38. Chalmers TC, Celano P, Sacks HS, Smith H. Bias in treatment assignment in controlled clinical trials. N Engl J Med 1983;309:1358-61.
39. Schulz KF, Chalmers I, Hayes RJ, Altman DG. Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 1995;273:408-12.
40. Altman DG. The scandal of poor medical research. BMJ 1994;308:283-4. [Free Full Text]
41. Egger M, Davey Smith G, Phillips AN. Meta-analysis: principles and procedures. BMJ (in press).
42. Davey Smith G, Egger M. Who benefits from medical interventions? Treating low risk patients can be a high risk strategy. BMJ 1994;308:72-4. [Free Full Text]
43. Baxter GF, Sumeray MS, Walker JM. Infarct size and magnesium: insights into LIMIT-2 and ISIS-4 from experimental studies. Lancet 1996;348:1424-6. [Medline]
44. Collins R, Peto R. Magnesium in acute myocardial infarction. Lancet 1997;349:282.
45. Villar J, Carroli G, Belizan JM. Predictive ability of meta-analyses of randomised controlled trials. Lancet 1995;345:772-6.
46. Flournoy N, Olkin I. Do small trials square with large ones? Lancet 1995;345:741-2. [Medline]
47. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics 1994;50:1088-99.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    StumbleUpon    Technorati    What's this?

This article has been cited by other articles:

• Taioli, E., Garza, M. A., Ahn, Y. O., Bishop, D. T., Bost, J., Budai, B., Chen, K., Gemignani, F., Keku, T., Lima, C. S. P., Le Marchand, L., Matsuo, K., Moreno, V., Plaschke, J., Pufulete, M., Thomas, S. B., Toffoli, G., Wolf, C. R., Moore, C. G., Little, J. (2009). Meta- and Pooled Analyses of the Methylenetetrahydrofolate Reductase (MTHFR) C677T Polymorphism and Colorectal Cancer: A HuGE-GSEC Review. Am J Epidemiol 170: 1207-1221 [Abstract] [Full text]  
• Sunkara, S. K., Khairy, M., El-Toukhy, T., Khalaf, Y., Coomarasamy, A. (2009). The effect of intramural fibroids without uterine cavity involvement on the outcome of IVF treatment: a systematic review and meta-analysis. Hum Reprod 0: dep396v1-dep396 [Abstract] [Full text]  
• Kondo, N., Sembajwe, G., Kawachi, I., van Dam, R. M, Subramanian, S V, Yamagata, Z. (2009). Income inequality, mortality, and self rated health: meta-analysis of multilevel studies. BMJ 339: b4471-b4471 [Abstract] [Full text]  
• Alvarez-Jimenez, M., Parker, A. G., Hetrick, S. E., McGorry, P. D., Gleeson, J. F. (2009). Preventing the Second Episode: A Systematic Review and Meta-analysis of Psychosocial and Pharmacological Trials in First-Episode psychosis. Schizophr Bull 0: sbp129v1-sbp129 [Abstract] [Full text]  
• Kuper, H., Nicholson, A., Kivimaki, M., Aitsi-Selmi, A., Cavalleri, G., Deanfield, J. E, Heuschmann, P., Jouven, X., Malyutina, S., Mayosi, B. M, Sans, S., Thomsen, T., Witteman, J. C M, Hingorani, A. D, Lawlor, D. A, Hemingway, H. (2009). Evaluating the causal relevance of diverse risk markers: horizontal systematic review. BMJ 339: b4265-b4265 [Abstract] [Full text]  
• Zoungas, S., Ninomiya, T., Huxley, R., Cass, A., Jardine, M., Gallagher, M., Patel, A., Vasheghani-Farahani, A., Sadigh, G., Perkovic, V. (2009). Systematic Review: Sodium Bicarbonate Treatment Regimens for the Prevention of Contrast-Induced Nephropathy. ANN INTERN MED 151: 631-638 [Abstract] [Full text]  
• Tsertsvadze, A., Fink, H. A., Yazdi, F., MacDonald, R., Bella, A. J., Ansari, M. T., Garritty, C., Soares-Weiser, K., Daniel, R., Sampson, M., Fox, S., Moher, D., Wilt, T. J. (2009). Oral Phosphodiesterase-5 Inhibitors and Hormonal Treatments for Erectile Dysfunction: A Systematic Review and Meta-analysis. ANN INTERN MED 151: 650-661 [Abstract] [Full text]  
• McKenzie, F., Jeffreys, M. (2009). Do Lifestyle or Social Factors Explain Ethnic/Racial Inequalities in Breast Cancer Survival?. Epidemiol Rev 31: 52-66 [Abstract] [Full text]  
• Crepaz, N., Marshall, K. J., Aupont, L. W., Jacobs, E. D., Mizuno, Y., Kay, L. S., Jones, P., McCree, D. H., O'Leary, A. (2009). The Efficacy of HIV/STI Behavioral Interventions for African American Females in the United States: A Meta-Analysis. AJPH 99: 2069-2078 [Abstract] [Full text]  
• Balsells, M., Garcia-Patterson, A., Gich, I., Corcoy, R. (2009). Maternal and Fetal Outcome in Women with Type 2 Versus Type 1 Diabetes Mellitus: A Systematic Review and Metaanalysis. J. Clin. Endocrinol. Metab. 94: 4284-4291 [Abstract] [Full text]  
• Chen, L., Davey Smith, G., Evans, D. M., Cox, A., Lawlor, D. A., Donovan, J., Yuan, W., Day, I. N. M., Martin, R. M., Lane, A., Rodriguez, S., Davis, M., Zuccolo, L., Collin, S. M., Hamdy, F., Neal, D., Lewis, S. J. (2009). Genetic Variants in the Vitamin D Receptor Are Associated with Advanced Prostate Cancer at Diagnosis: Findings from the Prostate Testing for Cancer and Treatment Study and a Systematic Review. Cancer Epidemiol. Biomarkers Prev. 18: 2874-2881 [Abstract] [Full text]  
• Baliunas, D. O., Taylor, B. J., Irving, H., Roerecke, M., Patra, J., Mohapatra, S., Rehm, J. (2009). Alcohol as a Risk Factor for Type 2 Diabetes: A systematic review and meta-analysis. Diabetes Care 32: 2123-2132 [Abstract] [Full text]  
• Lee, Y. H., Song, G. G. (2009). Lack of association of TNF-{alpha} promoter polymorphisms with ankylosing spondylitis: a meta-analysis. Rheumatology (Oxford) 48: 1359-1362 [Abstract] [Full text]  
• Schurks, M., Rist, P. M, Bigal, M. E, Buring, J. E, Lipton, R. B, Kurth, T. (2009). Migraine and cardiovascular disease: systematic review and meta-analysis. BMJ 339: b3914-b3914 [Abstract] [Full text]  
• Minneci, P. C., Deans, K. J., Natanson, C. (2009). Corticosteroid Therapy for Severe Sepsis and Septic Shock. JAMA 302: 1643-1643 [Full text]  
• Annane, D. (2009). Corticosteroid Therapy for Severe Sepsis and Septic Shock--Reply. JAMA 302: 1644-1645 [Full text]  
• Peng, B., Cao, L., Wang, W., Xian, L., Jiang, D., Zhao, J., Zhang, Z., Wang, X., Yu, L. (2009). Polymorphisms in the promoter regions of matrix metalloproteinases 1 and 3 and cancer risk: a meta-analysis of 50 case-control studies. Mutagenesis 0: gep041v1-gep041 [Abstract] [Full text]  
• Tsertsvadze, A., Fink, H. A., Yazdi, F., MacDonald, R., Bella, A. J., Ansari, M. T., Garritty, C., Soares-Weiser, K., Daniel, R., Sampson, M., Fox, S., Moher, D., Wilt, T. J. (2009). Oral Phosphodiesterase-5 Inhibitors and Hormonal Treatments for Erectile Dysfunction: A Systematic Review and Meta-analysis. ANN INTERN MED 0: 0000605-200911030-00150v1-E-150 [Abstract] [Full text]  
• Baker, W. L., Coleman, C. I., Kluger, J., Reinhart, K. M., Talati, R., Quercia, R., Phung, O. J., White, C. M. (2009). Systematic Review: Comparative Effectiveness of Angiotensin-Converting Enzyme Inhibitors or Angiotensin II-Receptor Blockers for Ischemic Heart Disease. ANN INTERN MED 0: 0000605-200912150-00162v1-E-162 [Abstract] [Full text]  
• Zhang, F, Dong, L, Ge, J (2009). Simple versus complex stenting strategy for coronary artery bifurcation lesions in the drug-eluting stent era: a meta-analysis of randomised trials. Heart 95: 1676-1681 [Abstract] [Full text]  
• Tleyjeh, I. M., Kashour, T., Hakim, F. A., Zimmerman, V. A., Erwin, P. J., Sutton, A. J., Ibrahim, T. (2009). Statins for the Prevention and Treatment of Infections: A Systematic Review and Meta-analysis. Arch Intern Med 169: 1658-1667 [Abstract] [Full text]  
• El-Zein, M., Parent, M.-E., Benedetti, A., Rousseau, M.-C. (2009). Does BCG vaccination protect against the development of childhood asthma? A systematic review and meta-analysis of epidemiological studies. Int J Epidemiol 0: dyp307v1-dyp307 [Abstract] [Full text]  
• Buckley, D. I., Fu, R., Freeman, M., Rogers, K., Helfand, M. (2009). C-Reactive Protein as a Risk Factor for Coronary Heart Disease: A Systematic Review and Meta-analyses for the U.S. Preventive Services Task Force. ANN INTERN MED 151: 483-495 [Abstract] [Full text]  
• La Caze, A. (2009). Evidence-Based Medicine Must Be .... J Med Philos 34: 509-527 [Abstract] [Full text]  
• Silcocks, P (2009). Hazard ratio funnel plots for survival comparisons. J. Epidemiol. Community Health 63: 856-861 [Abstract] [Full text]  
• Jamal, S. A., Fitchett, D., Lok, C. E., Mendelssohn, D. C., Tsuyuki, R. T. (2009). The effects of calcium-based versus non-calcium-based phosphate binders on mortality among patients with chronic kidney disease: a meta-analysis. Nephrol Dial Transplant 24: 3168-3174 [Abstract] [Full text]  
• Rodrigo, G. J., Castro-Rodriguez, J. A., Plaza, V. (2009). Safety and Efficacy of Combined Long-Acting {beta}-Agonists and Inhaled Corticosteroids vs Long-Acting {beta}-Agonists Monotherapy for Stable COPD: A Systematic Review. Chest 136: 1029-1038 [Abstract] [Full text]  
• Brar, S. S., Hiremath, S., Dangas, G., Mehran, R., Brar, S. K., Leon, M. B. (2009). Sodium Bicarbonate for the Prevention of Contrast Induced-Acute Kidney Injury: A Systematic Review and Meta-analysis. CJASN 4: 1584-1592 [Abstract] [Full text]  
• Lega, J-C, Lacasse, Y, Lakhal, L, Provencher, S (2009). Natriuretic peptides and troponins in pulmonary embolism: a meta-analysis. Thorax 64: 869-875 [Abstract] [Full text]  
• Bischoff-Ferrari, H A, Dawson-Hughes, B, Staehelin, H B, Orav, J E, Stuck, A E, Theiler, R, Wong, J B, Egli, A, Kiel, D P, Henschkowski, J (2009). Fall prevention with supplemental and active forms of vitamin D: a meta-analysis of randomised controlled trials. BMJ 339: b3692-b3692 [Abstract] [Full text]  
• Geeganage, C. M., Bath, P. M.W. (2009). Relationship Between Therapeutic Changes in Blood Pressure and Outcomes in Acute Stroke: A Metaregression. Hypertension 54: 775-781 [Abstract] [Full text]  
• Cook, M. B, Akre, O., Forman, D., Madigan, M P., Richiardi, L., McGlynn, K. A (2009). A systematic review and meta-analysis of perinatal variables in relation to the risk of testicular cancer--experiences of the mother. Int J Epidemiol 0: dyp287v1-dyp287 [Abstract] [Full text]  
• Takkouche, B., Regueira-Mendez, C., Montes-Martinez, A. (2009). Risk of cancer among hairdressers and related workers: a meta-analysis. Int J Epidemiol 0: dyp283v1-dyp283 [Abstract] [Full text]  
• Quant, E. C, Jeste, S. S, Muni, R. H, Cape, A. V, Bhussar, M. K, Peleg, A. Y (2009). The benefits of steroids versus steroids plus antivirals for treatment of Bell's palsy: a meta-analysis. BMJ 339: b3354-b3354 [Abstract] [Full text]  
• Burzotta, F., De Vita, M., Gu, Y. L., Isshiki, T., Lefevre, T., Kaltoft, A., Dudek, D., Sardella, G., Orrego, P. S., Antoniucci, D., De Luca, L., Biondi-Zoccai, G. G.L., Crea, F., Zijlstra, F. (2009). Clinical impact of thrombectomy in acute ST-elevation myocardial infarction: an individual patient-data pooled analysis of 11 trials. Eur Heart J 0: ehp348v1-ehp348 [Abstract] [Full text]  
• Campbell, A., Hausenblas, H. A. (2009). Effects of Exercise Interventions on Body Image: A Meta-analysis. J Health Psychol 14: 780-793 [Abstract]  
• Wald, D. S, Bestwick, J. P (2009). Carotid ultrasound screening for coronary heart disease: results based on a meta-analysis of 18 studies and 44,861 subjects. J Med Screen 16: 147-154 [Abstract] [Full text]  
• Collin, S. M., Metcalfe, C., Zuccolo, L., Lewis, S. J., Chen, L., Cox, A., Davis, M., Lane, J. A., Donovan, J., Smith, G. D., Neal, D. E., Hamdy, F. C., Gudmundsson, J., Sulem, P., Rafnar, T., Benediktsdottir, K. R., Eeles, R. A., Guy, M., Kote-Jarai, Z., UK Genetic Prostate Cancer Study Group, , Morrison, J., Al Olama, A. A., Stefansson, K., Easton, D. F., Martin, R. M. (2009). Association of Folate-Pathway Gene Polymorphisms with the Risk of Prostate Cancer: a Population-Based Nested Case-Control Study, Systematic Review, and Meta-analysis. Cancer Epidemiol. Biomarkers Prev. 18: 2528-2539 [Abstract] [Full text]  
• Bosetti, C., Bravi, F., Negri, E., La Vecchia, C. (2009). Oral contraceptives and colorectal cancer risk: a systematic review and meta-analysis. Hum Reprod Update 15: 489-498 [Abstract] [Full text]  
• Zintzaras, E. (2009). Inhibin alpha gene and susceptibility to premature ovarian failure: a data synthesis. Mol Hum Reprod 15: 551-555 [Abstract] [Full text]  
• Shengyuan, L., Songpo, Y., Wen, W., Wenjing, T., Haitao, Z., Binyou, W. (2009). Hepatitis C Virus and Lichen Planus: A Reciprocal Association Determined by a Meta-analysis. Arch Dermatol 145: 1040-1047 [Abstract] [Full text]  
• Arnone, D., Cavanagh, J., Gerber, D., Lawrie, S. M., Ebmeier, K. P., McIntosh, A. M. (2009). Magnetic resonance imaging studies in bipolar disorder and schizophrenia: meta-analysis. Br. J. Psychiatry 195: 194-201 [Abstract] [Full text]  
• Kodama, S., Saito, K., Yachi, Y., Asumi, M., Sugawara, A., Totsuka, K., Saito, A., Sone, H. (2009). Association Between Serum Uric Acid and Development of Type 2 Diabetes. Diabetes Care 32: 1737-1742 [Abstract] [Full text]  
• Abhary, S., Hewitt, A. W., Burdon, K. P., Craig, J. E. (2009). A Systematic Meta-Analysis of Genetic Association Studies for Diabetic Retinopathy. Diabetes 58: 2137-2147 [Abstract] [Full text]  
• Langhorst, J., Musial, F., Klose, P., Hauser, W. (2009). Efficacy of hydrotherapy in fibromyalgia syndrome--a meta-analysis of randomized controlled clinical trials. Rheumatology (Oxford) 48: 1155-1159 [Abstract] [Full text]  
• Dubben, H.-H. (2009). New methods to deal with publication bias. BMJ 339: b3272-b3272 [Full text]  
• Hoste, E. A. J., De Waele, J. J., Gevaert, S. A., Uchino, S., Kellum, J. A. (2009). Sodium bicarbonate for prevention of contrast-induced acute kidney injury: a systematic review and meta-analysis. Nephrol Dial Transplant 0: gfp389v1-gfp389 [Abstract] [Full text]  
• Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gotzsche, P. C., Ioannidis, J. P.A., Clarke, M., Devereaux, P. J., Kleijnen, J., Moher, D. (2009). The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration. ANN INTERN MED 151: W-65-W-94 [Abstract] [Full text]  
• Moreno, S. G, Sutton, A. J, Turner, E. H, Abrams, K. R, Cooper, N. J, Palmer, T. M, Ades, A E (2009). Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications. BMJ 339: b2981-b2981 [Abstract] [Full text]  
• Chandra, D., Parisini, E., Mozaffarian, D. (2009). Meta-analysis: Travel and Risk for Venous Thromboembolism. ANN INTERN MED 151: 180-190 [Abstract] [Full text]  
• Rao, S., Srinivasjois, R., Patole, S. (2009). Prebiotic Supplementation in Full-term Neonates: A Systematic Review of Randomized Controlled Trials. Arch Pediatr Adolesc Med 163: 755-764 [Abstract] [Full text]  
• Lean, I. J., Rabiee, A. R., Duffield, T. F., Dohoo, I. R. (2009). Invited review: Use of meta-analysis in animal health and reproduction: Methods and applications. J DAIRY SCI 92: 3545-3565 [Abstract] [Full text]  
• Wang, G., Bainbridge, D., Martin, J., Cheng, D. (2009). The Efficacy of an Intraoperative Cell Saver During Cardiac Surgery: A Meta-Analysis of Randomized Trials. Anesth. Analg. 109: 320-330 [Abstract] [Full text]  
• Karageorgopoulos, D E, Valkimadi, P E, Kapaskelis, A, Rafailidis, P I, Falagas, M E (2009). Short versus long duration of antibiotic therapy for bacterial meningitis: a meta-analysis of randomised controlled trials in children. Arch. Dis. Child. 94: 607-614 [Abstract] [Full text]  
• Liberati, A., Altman, D. G, Tetzlaff, J., Mulrow, C., Gotzsche, P. C, Ioannidis, J. P A, Clarke, M., Devereaux, P J, Kleijnen, J., Moher, D. (2009). The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339: b2700-b2700 [Abstract] [Full text]  
• Li, S., Shin, H. J., Ding, E. L., van Dam, R. M. (2009). Adiponectin Levels and Risk of Type 2 Diabetes: A Systematic Review and Meta-analysis. JAMA 302: 179-188 [Abstract] [Full text]  
• Wills, A. -M., Cronin, S., Slowik, A., Kasperaviciute, D., Van Es, M. A., Morahan, J. M., Valdmanis, P. N., Meininger, V., Melki, J., Shaw, C. E., Rouleau, G. A., Fisher, E.M.C., Shaw, P. J., Morrison, K. E., Pamphlett, R., Van den Berg, L. H., Figlewicz, D. A., Andersen, P. M., Al-Chalabi, A., Hardiman, O., Purcell, S., Landers, J. E., Brown, R. H. Jr (2009). A large-scale international meta-analysis of paraoxonase gene polymorphisms in sporadic ALS. Neurology 73: 16-24 [Abstract] [Full text]  
• Hujoel, P. P., Zina, L. G., Moimaz, S. A.S., Cunha-Cruz, J. (2009). Infant Formula and Enamel Fluorosis: A Systematic Review. Journal of the American Dental Association 140: 841-854 [Abstract] [Full text]  
• Lee, Y., Ji, J., Song, G. (2009). Fc{gamma} receptor IIB and IIIB polymorphisms and susceptibility to systemic lupus erythematosus and lupus nephritis: a meta-analysis. Lupus 18: 727-734 [Abstract]  
• Banel, D. K, Hu, F. B (2009). Effects of walnut consumption on blood lipids and other cardiovascular risk factors: a meta-analysis and systematic review. Am. J. Clin. Nutr. 90: 56-63 [Abstract] [Full text]  
• Gandhi, R., Tsvetkov, D., Davey, J. R., Mahomed, N. N. (2009). Survival and clinical function of cemented and uncemented prostheses in total knee replacement: A META-ANALYSIS. J Bone Joint Surg Br 91-B: 889-895 [Abstract] [Full text]  
• Omori, I., Watanabe, N, Nakagawa, A, Akechi, T, Cipriani, A, Barbui, C, McGuire, H, Churchill, R, Furukawa, T. (2009). Efficacy, tolerability and side-effect profile of fluvoxamine for major depression: meta-analysis. J Psychopharmacol 23: 539-550 [Abstract]  
• Choquet, H., Cavalcanti-Proenca, C., Lecoeur, C., Dina, C., Cauchi, S., Vaxillaire, M., Hadjadj, S., Horber, F., Potoczna, N., Charpentier, G., Ruiz, J., Hercberg, S., Maimaitiming, S., Roussel, R., Boenhnke, M., Jackson, A. U., Patsch, W., Krempler, F., Voight, B. F., Altshuler, D., Groop, L., Thorleifsson, G., Steinthorsdottir, V., Stefansson, K., Balkau, B., Froguel, P., Meyre, D. (2009). The T-381C SNP in BNP gene may be modestly associated with type 2 diabetes: an updated meta-analysis in 49 279 subjects. Hum Mol Genet 18: 2495-2501 [Abstract] [Full text]  
• Gardener, H., Spiegelman, D., Buka, S. L. (2009). Prenatal risk factors for autism: comprehensive meta-analysis. Br. J. Psychiatry 195: 7-14 [Abstract] [Full text]  
• Halasa, T., Osteras, O., Hogeveen, H., van Werven, T., Nielen, M. (2009). Meta-analysis of dry cow management for dairy cattle. Part 1. Protection against new intramammary infections. J DAIRY SCI 92: 3134-3149 [Abstract] [Full text]  
• Halasa, T., Nielen, M., Whist, A. C., Osteras, O. (2009). Meta-analysis of dry cow management for dairy cattle. Part 2. Cure of existing intramammary infections. J DAIRY SCI 92: 3150-3157 [Abstract] [Full text]  
• Reed, M., Meier, P., Tamhane, U. U., Welch, K. B., Moscucci, M., Gurm, H. S. (2009). The Relative Renal Safety of Iodixanol Compared With Low-Osmolar Contrast Media: A Meta-Analysis of Randomized Controlled Trials. J Am Coll Cardiol Intv 2: 645-654 [Abstract] [Full text]  
• Zintzaras, E., Zdoukopoulos, N. (2009). A Field Synopsis and Meta-Analysis of Genetic Association Studies in Peripheral Arterial Disease: The CUMAGAS-PAD Database. Am J Epidemiol 170: 1-11 [Abstract] [Full text]  
• Knaup, C., Koesters, M., Schoefer, D., Becker, T., Puschner, B. (2009). Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis. Br. J. Psychiatry 195: 15-22 [Abstract] [Full text]  
• Raimondi, S., Johansson, H., Maisonneuve, P., Gandini, S. (2009). Review and meta-analysis on vitamin D receptor polymorphisms and cancer risk. Carcinogenesis 30: 1170-1180 [Abstract] [Full text]  
• Banal, F, Dougados, M, Combescure, C, Gossec, L (2009). Sensitivity and specificity of the American College of Rheumatology 1987 criteria for the diagnosis of rheumatoid arthritis according to disease duration: a systematic literature review and meta-analysis. Ann Rheum Dis 68: 1184-1191 [Abstract] [Full text]  
• Brugts, J J, Yetgin, T, Hoeks, S E, Gotto, A M, Shepherd, J, Westendorp, R G J, de Craen, A J M, Knopp, R H, Nakamura, H, Ridker, P, van Domburg, R, Deckers, J W (2009). The benefits of statins in people without established cardiovascular disease but with cardiovascular risk factors: meta-analysis of randomised controlled trials. BMJ 338: b2376-b2376 [Abstract] [Full text]  
• Huynh, T., Perron, S., O'Loughlin, J., Joseph, L., Labrecque, M., Tu, J. V., Theroux, P. (2009). Comparison of Primary Percutaneous Coronary Intervention and Fibrinolytic Therapy in ST-Segment-Elevation Myocardial Infarction: Bayesian Hierarchical Meta-Analyses of Randomized Controlled Trials and Observational Studies. Circulation 119: 3101-3109 [Abstract] [Full text]  
• Segal, J. B., Brotman, D. J., Necochea, A. J., Emadi, A., Samal, L., Wilson, L. M., Crim, M. T., Bass, E. B. (2009). Predictive Value of Factor V Leiden and Prothrombin G20210A in Adults With Venous Thromboembolism and in Family Members of Those With a Mutation: A Systematic Review. JAMA 301: 2472-2485 [Abstract] [Full text]  
• Tang, N.-P., Zhou, B., Wang, B., Yu, R.-B., Ma, J. (2009). Flavonoids Intake and Risk of Lung Cancer: A Meta-analysis. Jpn J Clin Oncol 39: 352-359 [Abstract] [Full text]  
• Testa, L., Van Gaal, W.J., Biondi Zoccai, G.G.L., Agostoni, P., Latini, R.A., Bedogni, F., Porto, I., Banning, A.P. (2009). Myocardial infarction after percutaneous coronary intervention: a meta-analysis of troponin elevation applying the new universal definition. QJM 102: 369-378 [Abstract] [Full text]  
• Charytan, D. M., Wallentin, L., Lagerqvist, B., Spacek, R., De Winter, R. J., Stern, N. M., Braunwald, E., Cannon, C. P., Choudhry, N. K. (2009). Early Angiography in Patients with Chronic Kidney Disease: A Collaborative Systematic Review. CJASN 4: 1032-1043 [Abstract] [Full text]  
• Pavia, M., Bianco, A., Nobile, C. G. A., Marinelli, P., Angelillo, I. F. (2009). Efficacy of Pneumococcal Vaccination in Children Younger Than 24 Months: A Meta-Analysis. Pediatrics 123: e1103-e1110 [Abstract] [Full text]  
• Tonelli, M., Hemmelgarn, B., Reiman, T., Manns, B., Reaume, M. N., Lloyd, A., Wiebe, N., Klarenbach, S. (2009). Benefits and harms of erythropoiesis-stimulating agents for anemia related to cancer: a meta-analysis. CMAJ 180: E62-E71 [Abstract] [Full text]  
• Kodama, S., Saito, K., Tanaka, S., Maki, M., Yachi, Y., Asumi, M., Sugawara, A., Totsuka, K., Shimano, H., Ohashi, Y., Yamada, N., Sone, H. (2009). Cardiorespiratory Fitness as a Quantitative Predictor of All-Cause Mortality and Cardiovascular Events in Healthy Men and Women: A Meta-analysis. JAMA 301: 2024-2035 [Abstract] [Full text]  
• Yan, T. D., Black, D., Bannon, P. G., McCaughan, B. C. (2009). Systematic Review and Meta-Analysis of Randomized and Nonrandomized Trials on Safety and Efficacy of Video-Assisted Thoracic Surgery Lobectomy for Early-Stage Non-Small-Cell Lung Cancer. JCO 27: 2553-2562 [Abstract] [Full text]  
• Berger, J. S., Krantz, M. J., Kittelson, J. M., Hiatt, W. R. (2009). Aspirin for the Prevention of Cardiovascular Events in Patients With Peripheral Artery Disease: A Meta-analysis of Randomized Trials. JAMA 301: 1909-1919 [Abstract] [Full text]  
• Brar, S. S., Leon, M. B., Stone, G. W., Mehran, R., Moses, J. W., Brar, S. K., Dangas, G. (2009). Use of drug-eluting stents in acute myocardial infarction: a systematic review and meta-analysis.. J Am Coll Cardiol 53: 1677-1689 [Abstract] [Full text]  
• Kodama, S., Saito, K., Tanaka, S., Maki, M., Yachi, Y., Sato, M., Sugawara, A., Totsuka, K., Shimano, H., Ohashi, Y., Yamada, N., Sone, H. (2009). Influence of Fat and Carbohydrate Proportions on the Metabolic Profile in Patients With Type 2 Diabetes: A Meta-Analysis. Diabetes Care 32: 959-965 [Abstract] [Full text]  
• Talati, R., Phung, O. J, Mather, J., Coleman, C. I (2009). Effect of Non-Ergot Dopamine Agonists on Health-Related Quality of Life of Patients with Restless Legs Syndrome. The Annals of Pharmacotherapy 43: 813-821 [Abstract] [Full text]  
• Arab, L., Liu, W., Elashoff, D. (2009). Green and Black Tea Consumption and Risk of Stroke: A Meta-Analysis. Stroke 40: 1786-1792 [Abstract] [Full text]