Science

The miracle of DICE therapy for acute stroke: fact or fictional product of subgroup analysis?

BMJ 1994; 309 doi: http://dx.doi.org/10.1136/bmj.309.6970.1677 (Published 24 December 1994) Cite this as: BMJ 1994;309:1677
  1. Carl E Counsell,
  2. Mike J Clarke,
  3. Jim Slattery,
  4. Peter A G Sandercock
  1. Department of Clinical Neurosciences, Western General Hospital, Edinburgh EH4 2XU, clinical research fellow statistician. reader in neurology. CTSU and ICRF Cancer Studies Unit, Radcliffe Infirmary, Oxford OX2 6HE. overviews coordinator.
  1. Correspondence to: Dr Sandercock.

    Abstract

    Objective: To determine whether inappropriate subgroup analysis together with chance could change the conclusion of a systematic review of several randomised trials of an ineffective treatment.

    Design: 44 randomised controlled trials of DICE therapy for stroke were performed (simulated by rolling different coloured dice; two trials per investigator). Each roll of the dice yielded the outcome (death or survival) for that “patient.” Publication bias was also simulated. The results were combined in a systematic review.

    Setting: Edinburgh. Main outcome measure—Mortality.

    Results: The “hypothesis generating” trial suggested that DICE therapy provided complete protection against death from acute stroke. However, analysis of all the trials suggested a reduction of only 11% (SD 11) in the odds of death. A predefined subgroup analysis by colour of dice suggested that red dice therapy increased the odds by 9% (22). If the analysis excluded red dice trials and those of poor methodological quality the odds decreased by 22% (13, 2P=0.09). Analysis of “published” trials showed a decrease of 23% (13, 2P=0.07) while analysis of only those in which the trialist had become familiar with the intervention showed a decrease of 39% (17, 2P=0.02).

    Conclusion: The early benefits of DICE therapy were not confirmed by subsequent trials. A plausible (but inappropriate) subset analysis of the effects of treatment led to the qualitatively different conclusion that DICE therapy reduced mortality, whereas in truth it was ineffective. Chance influences the outcome of clinical trials and systematic reviews of trials much more than many investigators realise, and its effects may lead to incorrect conclusions about the benefits of treatment.

      View Full Text

      Sign in

      Log in through your institution

      Free trial

      Register for a free trial to thebmj.com to receive unlimited access to all content on thebmj.com for 14 days.
      Sign up for a free trial

      Subscribe