- Victor M Montori, Assistant Professor1,
- Roman Jaeschke2, clinical professor of medicine,
- Holger J Schünemann, associate professor of medicine3,
- Mohit Bhandari, assistant professor of medicine3,
- Jan L Brozek, lecturer in medicine4,
- P J Devereaux, assistant professor of medicine3,
- Gordon H Guyatt (guyatt@mcmaster.ca), professor of medicine3
- 1 Department of Medicine, Mayo Clinic College of Medicine, Rochester MN, USA
- 2 Department of Medicine, McMaster University, Hamilton ON, Canada
- 3 Department of Clinical Epidemiology and Biostatistics, McMaster University
- 4 Polish Institute for Evidence Based Medicine, Jagiellonian University Medical School, Krakow, Poland
- Correspondence to: G H Guyatt
- Accepted 15 September 2004
Introduction
Science is often not objective.1 Emotional investment in particular ideas and personal interest in academic success may lead investigators to overemphasise the importance of their findings and the quality of their work. Even more serious conflicts arise when for-profit organisations, including pharmaceutical companies, provide funds for research and consulting, conduct data management and analyses, and write reports on behalf of the investigators.
Although guides to help recognise methodological weaknesses that may introduce bias are now widely available,2 3 these criteria do not protect readers against misleading interpretations of methodologically sound studies. In this article, we present a guide that provides clinicians with tools to defend against biased inferences from research studies (box).
Guide to avoid being misled by biased presentation and interpretation of data
Read only the Methods and Results sections; bypass the Discussion section
Read the abstract reported in evidence based secondary publications
Beware faulty comparators
Beware composite endpoints
Beware small treatment effects
Beware subgroup analyses
Read methods and results only
The discussion section of research reports often offers inferences that differ from those a dispassionate reader would draw from the methods and results.4 The table gives details of two systematic reviews summarising a similar set of randomised trials assessing the effect of albumin for fluid resuscitation. The trials included in both reviews were small and methodologically weak, and their results are heterogeneous. Both the reviews provide point estimates suggesting that albumin may increase mortality and confidence intervals that include the possibility of a considerable increase in mortality. Nevertheless, one set of authors took a strong position that albumin is dangerous, the other that it is not. Their positions were consistent with the interests of funders of their reviews.5
- In this window
- In a new window
Comparison of two …
Sign in
Article access
Article access for 1 day
Purchase this article for £20 $30 €32*
The PDF version can be downloaded as your personal record







CiteULike
Connotea
Del.icio.us
Digg
Facebook
Mendeley
Reddit
Technorati
Twitter
Stumbleupon
Rapid responses
Latest Responses
Re: Ventilator associated pneumonia
Published 30 May 2012
Re: Restless legs syndrome
Published 30 May 2012
Author's reply
Published 30 May 2012
Re: Full access to trial data holds many benefits and a few pitfalls, conference hears
Published 30 May 2012
Restless Legs Syndrome: Fact or Fiction
Published 30 May 2012
Most responses
Venous thrombosis in users of non-oral hormonal contraception: follow-up study, Denmark 2001-10 (12 responses)
Published 10 May 2012 - 23:32
The psychiatric oligarchs who medicalise normality (9 responses)
Published 2 May 2012 - 15:42
Are doctors justified in taking industrial action in defence of their pensions? No (8 responses)
Published 8 May 2012 - 12:21
Are doctors justified in taking industrial action in defence of their pensions? Yes (8 responses)
Published 8 May 2012 - 12:21
The hardest thing: admitting error (7 responses)
Published 2 May 2012 - 12:27