BMJ 1999;318:1209-1209 ( 1 May )

Education and debate

Statistics notes

Treatment allocation in controlled trials: why randomise?

Douglas G Altman, professor of statistics in medicinea J Martin Bland, professor of medical statisticsb

a ICRF Medical Statistics Group, Centre for Statistics in Medicine, Institute of Health Sciences, Oxford OX3 7LF, b Department of Public Health Sciences, St George's Hospital Medical School, London SW17 0RE

Correspondence to: Professor Altman.

Since 1991 the BMJ has had a policy of not publishing trials that have not been properly randomised, except in rare cases where this can be justified.1 Why?

The simplest approach to evaluating a new treatment is to compare a single group of patients given the new treatment with a group previously treated with an alternative treatment. Usually such studies compare two consecutive series of patients in the same hospital(s). This approach is seriously flawed. Problems will arise from the mixture of retrospective and prospective studies, and we can never satisfactorily eliminate possible biases due to other factors (apart from treatment) that may have changed over time. Sacks et al compared trials of the same treatments in which randomised or historical controls were used and found a consistent tendency for historically controlled trials to yield more optimistic results than randomised trials.2 The use of historical controls can be justified only in tightly controlled situations of relatively rare conditions, such as in evaluating treatments for advanced cancer.

The need for contemporary controls is clear, but there are difficulties. If the clinician chooses which treatment to give each patient there will probably be differences in the clinical and demographic characteristics of the patients receiving the different treatments. Much the same will happen if patients choose their own treatment or if those who agree to have a treatment are compared with refusers. Similar problems arise when the different treatment groups are at different hospitals or under different consultants. Such systematic differences, termed bias, will lead to an overestimate or underestimate of the difference between treatments. Bias can be avoided by using random allocation.

A well known example of the confusion engendered by a non-randomised study was the study of the possible benefit of vitamin supplementation at the time of conception in women at high risk of having a baby with a neural tube defect.3 The investigators found that the vitamin group subsequently had fewer babies with neural tube defects than the placebo control group. The control group included women ineligible for the trial as well as women who refused to participate. As a consequence the findings were not widely accepted, and the Medical Research Council later funded a large randomised trial to answer to the question in a way that would be widely accepted.4

The main reason for using randomisation to allocate treatments to patients in a controlled trial is to prevent biases of the types described above. We want to compare the outcomes of treatments given to groups of patients which do not differ in any systematic way. Another reason for randomising is that statistical theory is based on the idea of random sampling. In a study with random allocation the differences between treatment groups behave like the differences between random samples from a single population. We know how random samples are expected to behave and so can compare the observations with what we would expect if the treatments were equally effective.

The term random does not mean the same as haphazard but has a precise technical meaning. By random allocation we mean that each patient has a known chance, usually an equal chance, of being given each treatment, but the treatment to be given cannot be predicted. If there are two treatments the simplest method of random allocation gives each patient an equal chance of getting either treatment; it is equivalent to tossing a coin. In practice most people use either a table of random numbers or a random number generator on a computer. This is simple randomisation. Possible modifications include block randomisation, to ensure closely similar numbers of patients in each group, and stratified randomisation, to keep the groups balanced for certain prognostic patient characteristics. We discuss these extensions in a subsequent Statistics note.

Fifty years after the publication of the first randomised trial5 the technical meaning of the term randomisation continues to elude some investigators. Journals continue to publish "randomised" trials which are no such thing. One common approach is to allocate treatments according to the patient's date of birth or date of enrolment in the trial (such as giving one treatment to those with even dates and the other to those with odd dates), by the terminal digit of the hospital number, or simply alternately into the different treatment groups. While all of these approaches are in principle unbiased---being unrelated to patient characteristics---problems arise from the openness of the allocation system.1 Because the treatment is known when a patient is considered for entry into the trial this knowledge may influence the decision to recruit that patient and so produce treatment groups which are not comparable.

Of course, situations exist where randomisation is simply not possible.6 The goal here should be to retain all the methodological features of a well conducted randomised trial7 other than the randomisation.

References

  1. Altman DG. Randomisation. BMJ 1991; 302: 1481-1482.
  2. Sacks H, Chalmers TC, Smith H. Randomized versus historical controls for clinical trials. Am J Med 1982; 72: 233-240[Medline].
  3. Smithells RW, Sheppard S, Schorah CJ, Seller MJ, Nevin NC, Harris R, et al. Possible prevention of neural-tube defects by periconceptional vitamin supplementation. Lancet 1980; i: 339-340.
  4. MRC Vitamin Study Research Group. Prevention of neural tube defects: results of the Medical Research Council vitamin study. Lancet 1991; 338: 131-137[Medline].
  5. Medical Research Council. Streptomycin treatment of pulmonary tuberculosis. BMJ 1948; 2: 769-782.
  6. Black N. Why we need observational studies to evaluate the effectiveness of health care. BMJ 1996; 312: 1215-1218[Free Full Text].
  7. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials: the CONSORT Statement. JAMA 1996; 276: 637-639[Medline].


© BMJ 1999

Related Articles

Reader's guide to critical appraisal of cohort studies: 2. Assessing potential for confounding
Muhammad Mamdani, Kathy Sykora, Ping Li, Sharon-Lise T Normand, David L Streiner, Peter C Austin, Paula A Rochon, and Geoffrey M Anderson
BMJ 2005 330: 960-962. [Extract] [Full Text] [PDF]

Reader's guide to critical appraisal of cohort studies: 1. Role and design
Paula A Rochon, Jerry H Gurwitz, Kathy Sykora, Muhammad Mamdani, David L Streiner, Susan Garfinkel, Sharon-Lise T Normand, and Geoffrey M Anderson
BMJ 2005 330: 895-897. [Extract] [Full Text] [PDF]

Taking folate in pregnancy and risk of maternal breast cancer: Authors' reply
Deborah Charles, Doris Campbell, Marion H Hall, Andy R Ness, and George Davey Smith
BMJ 2005 330: 600-601. [Extract] [Full Text]

This article has been cited by other articles:

  • Kanna, B., Gopalam, M. (2007). Prospective randomized study comparing amiodarone vs. amiodarone plus losartan vs. amiodarone plus perindopril for the prevention of atrial fibrillation recurrence in patients with lone paroxysmal atrial fibrillation. Eur Heart J 28: 381-381 [Full text]  
  • Tiruvoipati, R., Balasubramanian, S. P., Atturu, G., Peek, G. J., Elbourne, D. (2006). Improving the quality of reporting randomized controlled trials in cardiothoracic surgery: The way forward.. J. Thorac. Cardiovasc. Surg. 132: 233-240 [Abstract] [Full text]  
  • Gluud, L. L. (2006). Bias in Clinical Intervention Research. Am J Epidemiol 163: 493-501 [Abstract] [Full text]  
  • Mosis, G., Vlug, A. E., Mosseveld, M., Dieleman, J. P., Stricker, B. C., van der Lei, J., Sturkenboom, M. C.J.M. (2005). A Technical Infrastructure to Conduct Randomized Database Studies Facilitated by a General Practice Research Database. J. Am. Med. Inform. Assoc. 12: 602-607 [Abstract] [Full text]  
  • Heard, K., Bebarta, V. S., Lowenstein, S. R. (2005). Methodological Standards in Human vs Animal Clinical Trials. JAMA 294: 40-40 [Full text]  
  • Mamdani, M., Sykora, K., Li, P., Normand, S.-L. T, Streiner, D. L, Austin, P. C, Rochon, P. A, Anderson, G. M (2005). Reader's guide to critical appraisal of cohort studies: 2. Assessing potential for confounding. BMJ 330: 960-962 [Full text]  
  • Rochon, P. A, Gurwitz, J. H, Sykora, K., Mamdani, M., Streiner, D. L, Garfinkel, S., Normand, S.-L. T, Anderson, G. M (2005). Reader's guide to critical appraisal of cohort studies: 1. Role and design. BMJ 330: 895-897 [Full text]  
  • Charles, D., Campbell, D., Hall, M. H, Ness, A. R, Davey Smith, G. (2005). Taking folate in pregnancy and risk of maternal breast cancer: Authors' reply. BMJ 330: 600-601 [Full text]  
  • Beckerman, H., Becher, J. G, Lankhorst, G. J (2005). Definition of a randomized controlled trial. Clin Rehabil 19: 345-346  
  • Goodwin, G. M., Geddes, J. R. (2004). Introduction to Systematic Reviews. J Psychopharmacol 18: 249-250  
  • Munn, J., Herbert, R. D., Gandevia, S. C. (2004). Contralateral effects of unilateral resistance training: a meta-analysis. J. Appl. Physiol. 96: 1861-1866 [Abstract] [Full text]  
  • Westcombe, A M, Gambles, M A, Wilkinson, S M, Barnes, K, Fellowes, D, Maher, E J, Young, T, Love, S B, Lucey, R A, Cubbin, S, Ramirez, A J (2003). Learning the hard way! Setting up an RCT of aromatherapy massage for patients with advanced cancer. Palliat Med 17: 300-307 [Abstract]  
  • Chalmers, I. (2001). Comparing like with like: some historical milestones in the evolution of methods to create unbiased comparison groups in therapeutic experiments. Int J Epidemiol 30: 1156-1164 [Abstract] [Full text]  
  • Altman, D. G, Schulz, K. F (2001). Statistics Notes: Concealing treatment allocation in randomised trials. BMJ 323: 446-447 [Full text]  
  • Juni, P., Altman, D. G, Egger, M. (2001). Systematic reviews in health care: Assessing the quality of controlled clinical trials. BMJ 323: 42-46 [Full text]  
  • King, M. (2000). The effects of patients' and practitioners' preferences on randomized clinical trials. Palliat Med 14: 539-542  
  • Harrison, J. E. (2000). Evidence-based Orthodontics--How do I assess the evidence?. J. Orthod. 27: 189-197 [Full text]  
  • Chalmers, I. (1999). Why transition from alternation to randomisation in clinical trials was made. BMJ 319: 1372-1372 [Full text]  
  • Forbes, L., Chinn, S., Figueroa-Munoz, J., Seed, P., Welton, A J, Vickers, M R, Cooper, J A, Meade, T W, Marteau, T M (1999). Is recruitment more difficult with a placebo arm in RCTs?. BMJ 319: 853b-853 [Full text]  
  • Altman, D. G, Bland, J M. (1999). Statistics notes: How to randomise. BMJ 319: 703-704 [Full text]  

Online poll
Find out more

Rapid responses for this article

There are no rapid responses for this article.


Student BMJ

Risk of surgery for inflammatory bowel disease: record linkage studies

What can you learn from this BMJ paper? Read Leanne Tite's Paper+

www.student.bmj.com

Listen to the latest BMJ Interview