Acupuncture for chronic headache in primary care: large, pragmatic, randomised trial
BMJ 2004; 328 doi: https://doi.org/10.1136/bmj.38029.421863.EB (Published 25 March 2004) Cite this as: BMJ 2004;328:744Data supplement
Appendix: Description of the sensitivity analyses
The basis of the sensitivity analyses was the imputation of missing data using linear regression. In brief, a regression model provides a prediction of every patient’s one-year headache score on the basis of baseline headache score and the randomisation strata (age, sex, chronicity, diagnosis, site). Additional variables (such as post-treatment score) were used in the prediction for the different analyses; however, treatment group (acupuncture or control) was deliberately excluded from the model as a conservative measure. The difference between a patient’s true and predicted headache score is called a residual and the distribution of residuals can be calculated for any particular regression model. For patients with missing data for headache score, we imputed the headache score predicted by the regression model, but added a randomly drawn residual. Imputed and non-missing data were then combined and analysed by ANCOVA as described in the methods section. The process was repeated 100 times and the difference between groups with associated standard error recorded for each iteration. The results for headache score were then combined following Rubin’s rules,1 using NORM statistical software2; the results for difference in response (that is, proportion improving by at least 35%) were combined by simple averaging.The imputations were conducted as shown in table A. Sensitivity analyses (table B) were conducted hierarchically, so that, for example, sensitivity analysis 2 used the data from the complete cases and the imputations for groups 1 and 2; sensitivity analysis 3 included all patients. Two additional sensitivity analyses were conducted: sensitivity analysis 4 was the same as sensitivity analysis 3 with the exception of one patient who provided no follow up data and who gave ineffectiveness of acupuncture as a reason for withdrawal. For this patient, change from baseline was fixed at the 5th centile (close to the worst possible result). In the final sensitivity analysis, we used an unadjusted t test to compare change between baseline and follow-up, as planned in the original protocol.
It has been argued that the coefficients for the linear prediction should be randomly sampled from a plausible distribution.1 This was attempted by using NORM, but the imputation had poor properties: the data augmentation algorithm did not converge unambiguously, and some imputations led to implausible results, such as the mean change in headache scores being a 20 point increase in both groups. Nonetheless, both the estimate for the difference between groups and the p value obtained from this method were close to those reported in table B3.66, P=0.001).
1. Little RJA, Rubin DB. Statistical analysis with missing data. New York: John-Wiley, 1987.
2. Schafer J. NORM: multiple imputation of incomplete multivariate data under a normal model. (2.03). Pennsylvania, Pennsylvania State University, 2000.
Table A Data used in the imputations
Group Patient groupn Data usedComplete cases Patients providing follow up score at one year301 Actual follow up score1 Patients providing post-treatment score but no score at one year31 Imputed from randomisation strata and post-treatment score2 Patients providing global score but no follow up diaries45 Imputed from randomisation strata and change in global estimate of headache severity3 Patients providing no follow up data24 Imputed from randomisation strata and whether patient completed the post-treatment or one year follow up diaries
Table B Results of the sensitivity analyses
Sensitivity analysisTotal No Difference between groups: headache score Difference between groups: response (%) Principal analysis301 4.60 (P=0.0002) 21.9 Sensitivity analysis 1332 4.42 (P=0.0004) 20.8 Sensitivity analysis 2377 4.16 (P=0.0007) 19.1 Sensitivity analysis 3401 3.91 (P=0.001) 18.2 Sensitivity analysis 4401 3.85 (P=0.002) 18.0 Sensitivity analysis 5301 3.96 (P=0.004) 21.9
Related articles
- This Week In The BMJ Published: 25 March 2004; BMJ 328 doi:10.1136/bmj.328.7442.0-d
- Other Published: 11 August 2005; BMJ 331 doi:10.1136/bmj.38512.405440.8F
- PAPERS Published: 29 July 2005; BMJ doi:10.1136/bmj.38512.405440.8F
See more
- Introductory AddressProv Med Surg J October 03, 1840, s1-1 (1) 1-4; DOI: https://doi.org/10.1136/bmj.s1-1.1.1
- Report of the Meeting of the Eastern Branch of the Provincial Association at Bury St. Edmond'sProv Med Surg J October 03, 1840, s1-1 (1) 10-13; DOI: https://doi.org/10.1136/bmj.s1-1.1.10
- Mr. Warburton's Bill for the Regulation of the Medical ProfessionProv Med Surg J October 03, 1840, s1-1 (1) 13-15; DOI: https://doi.org/10.1136/bmj.s1-1.1.13
- An Atlas of Plates, illustrative of the Principles and Practice of Obstetric Medicine and Surgery, with descriptive LetterpressProv Med Surg J October 03, 1840, s1-1 (1) 4; DOI: https://doi.org/10.1136/bmj.s1-1.1.4
- A Practical Treatise on the Diseases peculiar to Women, illustrated by Cases, &cProv Med Surg J October 03, 1840, s1-1 (1) 4-5; DOI: https://doi.org/10.1136/bmj.s1-1.1.4-a
Cited by...
- Multiple imputation of missing data under missing at random: compatible imputation models are not sufficient to avoid bias
- Treatment group outcome variance difference after dropout as an indicator of missing-not-at-random bias in randomized clinical trials
- Prognostic factors for chronic headache: A systematic review
- Acupuncture for acute migraine attacks in adults: a systematic review protocol
- Acupuncture for 'frequent attenders with medically unexplained symptoms: a randomised controlled trial (CACTUS study)
- A Critical Evaluation of Acupuncture Research: Physiologization of Chinese Medicine in Germany
- Stop Hypertension With the Acupuncture Research Program (SHARP): Results of a Randomized, Controlled Clinical Trial
- Acupuncture in patients with tension-type headache: randomised controlled trial
- Mainstreaming Complementary Therapies: New Directions In Health Care
- Acupuncture Helps Chronic Headache
- Acupuncture Helps Chronic Headache
- Acupuncture Helps Chronic Headache