Power is indeed irrelevant in interpreting completed studies
BMJ 2002; 325 doi: https://doi.org/10.1136/bmj.325.7375.1304 (Published 30 November 2002) Cite this as: BMJ 2002;325:1304- Stephen J Senn, professor of pharmaceutical and health statistics (stephen{at}senns.demon.co.uk)
EDITOR—I agree with Bacchetti (and most correspondents).1 Power is of no relevance in interpreting a completed study. In his classic, Planning of Experiments, Sir David Cox says that power is important in choosing between alternative methods of analysing data and in deciding on an appropriate size of experiment and that it is quite irrelevant in the analysis of data.2
I also agree with much of what Horrobin says, but he overstates the case against sample size determinations in pilot studies.1 In most indications the variability is a function of the disease not the treatment, and the fact that the treatment has not been studied is no bar to using an estimate. The difference you are seeking is not the same as the difference you expect to find, and again you do not have to know what the treatment will do to find a figure. This is common to all science. An astronomer does not know the magnitude of new stars until he has found them, but the magnitude of star he is looking for determines how much he has to spend on a telescope.
The definition of a medical statistician is one who will not accept that Columbus discovered America because he said he was looking for India in the trial plan.3 Columbus made an error in his power calculation—he relied on an estimate of the size of the Earth that was too small, but he made one none the less, and it turned out to have very fruitful consequences.
Footnotes
-
Competing interests SJS consults extensively for the pharmaceutical industry and his career as an academic is furthered by publication and grants awarded.
Log in
Log in using your username and password
Log in through your institution
Subscribe from £173 *
Subscribe and get access to all BMJ articles, and much more.
* For online subscription
Access this article for 1 day for:
£38 / $45 / €42 (excludes VAT)
You can download a PDF version for your personal record.