This article has a correction
Please see: When are randomised trials unnecessary? Picking signal from noise
- Paul Glasziou, professor1,
- Iain Chalmers, editor2,
- Michael Rawlins, honorary professor3,
- Peter McCulloch, reader4
- 1Centre for Evidence-Based Medicine, Department of Primary Health Care, University of Oxford, Oxford OX3 7LF
- 2James Lind Library, James Lind Initiative, Oxford OX2 7LG
- 3London School of Hygiene and Tropical Medicine, London WC1E 7HT
- 4Nuffield Department of Surgery, John Radcliffe Hospital, Oxford OX3 9DU
- Correspondence to: P Glasziou paul.glasziou@dphpc.ox.ac.uk
Although randomised trials are widely accepted as the ideal way of obtaining unbiased estimates of treatment effects, some treatments have dramatic effects that are highly unlikely to reflect inadequately controlled biases. We compiled a list of historical examples of such effects and identified the features of convincing inferences about treatment effects from sources other than randomised trials. A unifying principle is the size of the treatment effect (signal) relative to the expected prognosis (noise) of the condition. A treatment effect is inferred most confidently when the signal to noise ratio is large and its timing is rapid compared with the natural course of the condition. For the examples we considered in detail the rate ratio often exceeds 10 and thus is highly unlikely to reflect bias or factors other than a treatment effect. This model may help to reduce controversy about evidence for treatments whose effects are so dramatic that randomised trials are unnecessary.
Footnotes
We thank Abdelhamid Attia, Benjamin Djulbegovic, Hywel Williams, Jan Vandenbroucke, Olaf Dekkers, Dave Sackett, Jonathan Meakins, Ruth Gilbert, Amanda Burls, Ken Fleming, and the members of the Evidence-Based Health Care email list for help with examples and comments on earlier drafts of this paper.
Contributors and sources: All authors have been involved in both clinical trials and clinical practice and the links between these. PG and IC conceived the study; all authors contributed to compiling the examples used for analysis, and development of the concepts and writing of the paper. PG is guarantor.
Competing interests: None declared.
Sign in
Article access
Article access for 1 day
Purchase this article for £20 $30 €32*
The PDF version can be downloaded as your personal record







CiteULike
Connotea
Del.icio.us
Digg
Facebook
Mendeley
Reddit
Technorati
Twitter
Stumbleupon
Rapid responses
Latest Responses
Re: Ventilator associated pneumonia
Published 30 May 2012
Re: Restless legs syndrome
Published 30 May 2012
Author's reply
Published 30 May 2012
Re: Full access to trial data holds many benefits and a few pitfalls, conference hears
Published 30 May 2012
Restless Legs Syndrome: Fact or Fiction
Published 30 May 2012
Most responses
Venous thrombosis in users of non-oral hormonal contraception: follow-up study, Denmark 2001-10 (12 responses)
Published 10 May 2012 - 23:32
The psychiatric oligarchs who medicalise normality (9 responses)
Published 2 May 2012 - 15:42
Are doctors justified in taking industrial action in defence of their pensions? No (8 responses)
Published 8 May 2012 - 12:21
Are doctors justified in taking industrial action in defence of their pensions? Yes (8 responses)
Published 8 May 2012 - 12:21
The hardest thing: admitting error (7 responses)
Published 2 May 2012 - 12:27