Intended for healthcare professionals

Research Methods & Reporting Statistics Notes

Uncertainty and sampling error

BMJ 2014; 349 doi: https://doi.org/10.1136/bmj.g7064 (Published 25 November 2014) Cite this as: BMJ 2014;349:g7064
  1. Douglas G Altman, professor of statistics in medicine1,
  2. J Martin Bland, professor of health statistics2
  1. 1Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, University of Oxford, Oxford OX3 7LD, UK
  2. 2Department of Health Sciences, University of York, York YO10 5DD, UK
  1. Correspondence to: D G Altman doug.altman{at}csm.ox.ac.uk

Medical research is conducted to help to reduce uncertainty. For example, randomised controlled trials aim to answer questions relating to treatment choices for a particular group of patients. Rarely, however, does a single study remove uncertainty. There are two reasons for this: sampling error and other (non-sampling) sources of uncertainty. The word “error” comes from a Latin root meaning “to wander,” and we use it in its statistical sense of meaning variation from the average, not “mistake.” Sampling error arises because any sample may not behave quite the same as the larger population from which it was drawn. Non-sampling error arises from the many ways a research study may deviate from addressing the question that the researcher wants to answer.

Sampling error is very much the concern of the statistician, who imagines that the group of people in the study is just one of the many possible samples from the population of interest. Despite it being widely condemned,1 the dominant way of …

View Full Text