Intended for healthcare professionals

General Practice

Statistics notes: Interaction 3: How to examine heterogeneity

BMJ 1996; 313 doi: https://doi.org/10.1136/bmj.313.7061.862 (Published 05 October 1996) Cite this as: BMJ 1996;313:862
  1. John N S Matthews, senior lecturer in medical statisticsa,
  2. Douglas G Altman, headb
  1. a Department of Medical Statistics, University of Newcastle, Newcastle upon Tyne NE2 4HH,
  2. b ICRF Medical Statistics Group, Centre for Statistics in Medicine, Institute of Health Sciences, PO Box 777, Oxford OX3 7LF
  1. Correspondence to: Dr Matthews.

    In preceding Statistics Notes we introduced the concept of interaction1 and explained why a common approach to the assessment of interaction is incorrect.2 In this note we give details of the correct approach using the same two examples.

    In a study of the effect of maternal vitamin D supplementation on neonatal serum calcium concentrations3 the researchers were interested in the possible difference between the effect of supplementation on breast and bottle fed babies. We define the treatment effect in each feeding group to be the difference in the mean serum calcium concentration of babies receiving supplements and those receiving placebo in that group: the treatment means and observed effects in the feeding groups are given in table 1.

    Table 1

    Serum calcium concentrations (mmol/l) at 1 week in babies born to mothers given vitamin D supplements or placebo and analysed according to whether they were breast fed or bottle fed

    View this table:

    The first step is to compute the difference between the two treatment effects—that is, 0.10 - 0.04 = 0.06 mmol/l. The standard error of this difference is 0.056 mmol/l, found from the standard errors of the separate effects using the usual method for the standard error of a difference.4 This is the same method that provides the standard error of a treatment effect from the standard errors of the treatment means. The P value can found from the ratio of the difference to its standard error, namely 0.06/0.056 = 1.07, again using standard methods,4 which gives P = 0.28, showing there is no evidence that the effects are different between the two feeding groups. An approximate 95% confidence interval can be found for the difference in the treatment effects in the usual way,4—that is, as 0.06 +/- 1.96 × 0.056, or - 0.05 to 0.17 mmol/l.

    A similar approach is adopted with a binary outcome measure. In a controlled trial of antenatal steroid therapy for neonatal respiratory distress syndrome 27.3% (9/33) of babies born to mothers with pre-eclampsia and 14.1% (37/262) of babies born to mothers without pre-eclampsia in the control group developed neonatal respiratory distress syndrome; the corresponding figures in the steroid group were 21.2% (7/33) and 7.9% (21/267) respectively.5 Once standard errors of each of these percentages have been found in the usual way4 the method for assessing an interaction between steroid therapy and mother's pre-eclampsia is the same as for continuous outcomes. The treatment effect in babies of mothers with pre-eclampsia is 27.3 - 21.2 = 6.1% (standard error 10.5%) and in babies born to unaffected mothers it is 14.1 - 7.9 = 6.2% (standard error 2.7%), so the difference in treatment effects is 6.2 - 6.1 = 0.1% (standard error 10.9%), from which the P value for the difference in treatment effects is P = 0.99. Thus there is no evidence in this trial that the effect of antenatal steroids depends on whether the mother suffered from pre-eclampsia: the 95% confidence interval for the difference in the treatment effects can also be constructed as before, giving 0.1 +/- 1.96 × 10.9 or - 21.3% to 21.5%.

    References

    1. 1.
    2. 2.
    3. 3.
    4. 4.
    5. 5.