BMJ  2004;329:883 (16 October), doi:10.1136/bmj.38250.571088.55 (published 6 October 2004)

Paper

Issues in the reporting of epidemiological studies: a survey of recent practice

¹ Department of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London WC1E 7HT, ² New England Research Institutes, 9 Galen St, Watertown, MA 02472, USA, ³ Department of Obstetrics and Gynaecology, Harvard Medical School and Beth Israel Deaconess Medical Centre, Boston, MA 02215, USA, ⁴ Clinical Research Program, Children's Hospital, Boston, MA 02115, USA, ⁵ Prometrika LLC, Cambridge, MA 02138, USA

Objectives To review current practice in the analysis and reporting of epidemiological research and to identify limitations.

Design Examination of articles published in January 2001 that investigated associations between risk factors/exposure variables and disease events/measures in individuals.

Setting Eligible English language journals including all major epidemiological journals, all major general medical journals, and the two leading journals in cardiovascular disease and cancer.

Main outcome measure Each article was evaluated with a standard proforma.

Results We found 73 articles in observational epidemiology; most were either cohort or case-control studies. Most studies looked at cancer and cardiovascular disease, even after we excluded specialty journals. Quantitative exposure variables predominated, which were mostly analysed as ordered categories but with little consistency or explanation regarding choice of categories. Sample selection, participant refusal, and data quality received insufficient attention in many articles. Statistical analyses commonly used odds ratios (38 articles) and hazard/rate ratios (23), with some inconsistent use of terminology. Confidence intervals were reported in most studies (68), though use of P values was less common (38). Few articles explained their choice of confounding variables; many performed subgroup analyses claiming an effect modifier, though interaction tests were rare. Several investigated multiple associations between exposure and outcome, increasing the likelihood of false positive claims. There was evidence of publication bias.

Conclusions This survey raises concerns regarding inadequacies in the analysis and reporting of epidemiological publications in mainstream journals.

CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Relevant Articles

Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies

Erik von Elm, Douglas G Altman, Matthias Egger, Stuart J Pocock, Peter C Gøtzsche, Jan P Vandenbroucke STROBE Initiative
BMJ 2007 335: 806-808. [Extract] [Full Text] [PDF]

Believability of relative risks and odds ratios in abstracts: cross sectional study

Peter C Gøtzsche
BMJ 2006 333: 231-234. [Abstract] [Full Text] [PDF]

Issues in reporting epidemiological studies: Can't we all agree on confidence intervals?

Matthew W Gillman
BMJ 2005 330: 146. [Extract] [Full Text]

Issues in reporting epidemiological studies: No data are given to support generalisation

David F Blackburn
BMJ 2005 330: 146. [Extract] [Full Text]

Issues in reporting epidemiological studies: Study raises several concerns

Karl-Heinz Jöckel and Andreas Stang
BMJ 2005 330: 146. [Extract] [Full Text]

HIV in injecting drug users in Asian countries: Authors' reply

Alex Wodak, Robert Ali, and M Farrell
BMJ 2005 330: 147. [Extract] [Full Text]

Epidemiological studies may mislead
BMJ 2004 329: 0. [Full Text]

The scandal of poor epidemiological research

Erik von Elm and Matthias Egger
BMJ 2004 329: 868-869. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

• Knol, M. J., Vandenbroucke, J. P., Scott, P., Egger, M. (2008). What Do Case-Control Studies Estimate? Survey of Methods and Assumptions in Published Case-Control Research. Am J Epidemiol 0: kwn217v1-kwn217 [Abstract] [Full text]  
• Ioannidis, J. P. A. (2008). Effect of Formal Statistical Significance on the Credibility of Observational Associations. Am J Epidemiol 168: 374-383 [Abstract] [Full text]  
• Boffetta, P., McLaughlin, J. K., La Vecchia, C., Tarone, R. E., Lipworth, L., Blot, W. J. (2008). False-Positive Results in Cancer Epidemiology: A Plea for Epistemological Modesty. JNCI J Natl Cancer Inst 100: 988-995 [Abstract] [Full text]  
• O'Neil, C. E., Nicklas, T. A. (2008). A Review of the Relationship Between 100% Fruit Juice Consumption and Weight in Children and Adolescents. AMERICAN JOURNAL OF LIFESTYLE MEDICINE 2: 315-354 [Abstract]  
• Bekkering, G. E., Harris, R. J., Thomas, S., Mayer, A.-M. B., Beynon, R., Ness, A. R., Harbord, R. M., Bain, C., Smith, G. D., Sterne, J. A. C. (2008). How Much of the Data Published in Observational Studies of the Association between Diet and Prostate or Bladder Cancer Is Usable for Meta-Analysis?. Am J Epidemiol 167: 1017-1026 [Abstract] [Full text]  
• Elm, E. v., Altman, D. G, Egger, M., Pocock, S. J, Gotzsche, P. C, Vandenbroucke, J. P, STROBE Initiative, (2007). Strengthening the reporting of observational studies in epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ 335: 806-808 [Full text]  
• von Elm, E., Altman, D. G., Egger, M., Pocock, S. J., Gotzsche, P. C., Vandenbroucke, J. P., for the STROBE Initiative, (2007). The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. ANN INTERN MED 147: 573-577 [Abstract] [Full text]  
• Vandenbroucke, J. P., Elm, E. v., Altman, D. G., Gotzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., Egger, M., for the STROBE initiative, (2007). Strengthening the Reporting of Observational Studies in Epidemiology (STROBE): Explanation and Elaboration. ANN INTERN MED 147: W-163-W-194 [Abstract] [Full text]  
• Egger, M., Altman, D. G, Vandenbroucke, J. P, of the STROBE group, (2007). Commentary: Strengthening the reporting of observational epidemiology the STROBE statement. Int J Epidemiol 0: dym199v1-dym199 [Full text]  
• Lawlor, D. A (2007). Quality in epidemiological research: should we be submitting papers before we have the results and submitting more hypothesis-generating research?. Int J Epidemiol 36: 940-943 [Full text]  
• Lee, W., Bindman, J., Ford, T., Glozier, N., Moran, P., Stewart, R., Hotopf, M. (2007). Bias in psychiatric case-control studies: Literature survey. Br. J. Psychiatry 190: 204-209 [Abstract] [Full text]  
• Gidlow, C., Johnston, L. H., Crone, D., Ellis, N., James, D. (2006). A systematic review of the relationship between socio-economic position and physical activity. Health Education Journal 65: 338-367 [Abstract]  
• Novack, L, Jotkowitz, A, Knyazer, B, Novack, V (2006). Evidence-based medicine: assessment of knowledge of basic epidemiological and research methods among medical doctors. Postgrad. Med. J. 82: 817-822 [Abstract] [Full text]  
• Smidt, N., Rutjes, A.W.S., van der Windt, D. A.W.M., Ostelo, R. W.J.G., Bossuyt, P. M., Reitsma, J. B., Bouter, L. M., de Vet, H. C.W. (2006). The quality of diagnostic accuracy studies since the STARD statement: has it improved?. Neurology 67: 792-797 [Abstract] [Full text]  
• Gotzsche, P. C (2006). Believability of relative risks and odds ratios in abstracts: cross sectional study. BMJ 333: 231-234 [Abstract] [Full text]  
• Carpenter, J. R (2006). Commentary: On Bayesian perspectives for epidemiological research.. Int J Epidemiol 35: 775-777 [Full text]  
• Ioannidis, J. P A (2006). Commentary: Grading the credibility of molecular evidence for complex diseases. Int J Epidemiol 35: 572-578 [Full text]  
• Morton, L. M., Cahill, J., Hartge, P. (2006). Reporting Participation in Epidemiologic Studies: A Survey of Practice. Am J Epidemiol 163: 197-203 [Abstract] [Full text]  
• Westfall, P., Young, S. S. (2005). Contradictions in Highly Cited Clinical Research. JAMA 294: 2695-2696 [Full text]  
• von Elm, E., Altman, D. G., Pocock, S., Vandenbroucke, J. P., Egger, M. (2005). RE: "QUALITY OF REPORTING OF OBSERVATIONAL LONGITUDINAL RESEARCH". Am J Epidemiol 162: 1032-1033 [Full text]  
• Skorge, T. D., Eagan, T. M. L., Eide, G. E., Gulsvik, A., Bakke, P. S. (2005). The Adult Incidence of Asthma and Respiratory Symptoms by Passive Smoking In Utero or in Childhood. Am. J. Respir. Crit. Care Med. 172: 61-66 [Abstract] [Full text]  
• FINLEY, J. W. (2005). Proposed Criteria for Assessing the Efficacy of Cancer Reduction by Plant Foods Enriched in Carotenoids, Glucosinolates, Polyphenols and Selenocompounds. ANN BOT (LOND) 95: 1075-1096 [Abstract] [Full text]  
• Barreto, M. L (2005). Efficacy, effectiveness, and the evaluation of public health interventions. J. Epidemiol. Community Health 59: 345-346 [Full text]  
• Gillman, M. W (2005). Issues in reporting epidemiological studies: Can't we all agree on confidence intervals?. BMJ 330: 146-146 [Full text]  
• Blackburn, D. F (2005). Issues in reporting epidemiological studies: No data are given to support generalisation. BMJ 330: 146-146 [Full text]  
• Jockel, K.-H., Stang, A. (2005). Issues in reporting epidemiological studies: Study raises several concerns. BMJ 330: 146-146 [Full text]  
• (2004). Robin Goodfellow (43-12). Rheumatology (Oxford) 43: 1598-1598 [Full text]  
• von Elm, E., Egger, M. (2004). The scandal of poor epidemiological research. BMJ 329: 868-869 [Full text]  

Rapid Responses:

Read all Rapid Responses

Added value

Luc Bonneux
bmj.com, 8 Oct 2004 [Full text]

Can't we all agree on confidence intervals?

Matthew W. Gillman
bmj.com, 15 Oct 2004 [Full text]

More Epidemiologic Study Bashing...

David F. Blackburn
bmj.com, 19 Oct 2004 [Full text]

Trouble With Epidemiology

William H James
bmj.com, 25 Oct 2004 [Full text]

Reporting Practices of Epidemiologic Studies.

Andreas Stang, et al.
bmj.com, 4 Nov 2004 [Full text]