Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 18 August 2009, doi:10.1136/bmj.b2273
Cite this as: BMJ 2009;339:b2273
45: economic evaluation of randomised controlled trialGarry R Barton, senior lecturer in health economics1, Tracey H Sach, senior lecturer in health economics1,2,3, Claire Jenkinson, research associate2, Michael Doherty, professor of rheumatology4, Anthony J Avery, professor of primary care2, Kenneth R Muir, professor of epidemiology2
1 Health Economics Group, School of Medicine, Health Policy and Practice, University of East Anglia, Norwich NR4 7TJ, 2 School of Community Health Sciences, University of Nottingham, Nottingham NG7 2RD, 3 School of Pharmacy, University of East Anglia, Norwich, 4 Academic Rheumatology, University of Nottingham, Nottingham
Correspondence to: T Sach, School of Pharmacy, University of East Anglia, Norwich NR4 7TJ T.Sach{at}uea.ac.uk
Design Cost utility analysis of randomised controlled trial.
Setting Five general practices in the United Kingdom.
Participants 389 adults aged
45 with self reported knee pain and body mass index (BMI)
28.
Interventions Dietary intervention plus quadriceps strengthening exercises, dietary intervention, quadriceps strengthening exercises, and leaflet provision. Participants received home visits over a two year period.
Main outcome measure Incremental cost per quality adjusted life year (QALY) gained over two years from a health service perspective.
Results Advice leaflet was associated with a mean change in cost of –£31, and a mean QALY gain of 0.085. Both strengthening exercises and dietary intervention were more effective (0.090 and 0.133 mean QALY gain, respectively) but were not cost effective. Dietary intervention plus strengthening exercises had a mean cost of £647 and a mean QALY gain of 0.147 and was estimated to have an incremental cost of £10 469 per QALY gain (relative to leaflet provision), and a 23.1% probability of being cost effective at a £20 000/QALY threshold.
Conclusion Dietary intervention plus strengthening exercises was estimated to be cost effective for individuals with knee pain, but with a large level of uncertainty.
Trial registration ISRCTN93206785 [controlled-trials.com] .
A previous study evaluated a weight reduction programme6 as weight loss has been shown to be associated with an improvement in the symptoms of knee osteoarthritis,7 of which pain is the principal feature.8 Indeed, it has been estimated that between a quarter and a half of all knee osteoarthritis might be prevented by eliminating obesity.9 The value of a quadriceps strengthening exercise programme has also been estimated as there is evidence that quadriceps weakness is associated with disability and pain in patients with knee osteoarthritis10 11 and that a home based exercise programme can help improve self reported knee pain and function.12 13
We investigated the cost effectiveness of four interventions designed to alleviate knee pain in overweight and obese adults.
45 in five Nottingham general practices. We did not contact terminally ill patients and those with psychiatric illness, dementia, or any other incapacitating disease that their general practitioner thought made them unsuitable for participation. A local media campaign was also conducted to improve recruitment. Recruitment started in May 2003 and ended in March 2005. Responding individuals were recruited into the study if they reported that they had had knee pain on most days of the past month, had a body mass index (BMI) >28.0, and gave consent to be randomised to one of the four intervention groups (a greater proportion was randomised to dietary intervention because we anticipated a higher rate of attrition in this group).
Interventions
The interventions are described more fully in the accompanying clinical paper.14 Participants in both the dietary intervention groups were visited by a dietitian and received a personalised dietary plan that would create a deficit of 2.5 MJ (600 kcal) a day. They were scheduled to receive visits every month in the first six months and every other month for the remainder of the 24 month intervention period. Participants in the exercise groups were taught exercises designed to strengthen the quadriceps (thigh) muscles and included resistance exercises, some of which were taught with rubber exercise (dyno) bands of varying strength. They were asked to repeat these exercises at home on a daily basis and were scheduled to receive visits every four months throughout the 24 month intervention period. The final intervention was the provision of a leaflet based on the Arthritis Research Campaign (ARC) Osteoarthritis of the Knee leaflet (www.arc.org.uk) but leaflets had all exercise and dietary advice removed (this was considered equivalent to standard care).
Measuring costs
For each participant we estimated the overall change in cost to the health service over the two year trial period by summing the costs associated with visits by healthcare professionals and the change in the costs associated with analgesic use. All costs were estimated in UK sterling (£) at 2006-7 financial year costs. Costs that occurred in the second year were discounted at the current recommended rate of 3.5%.15
Visit costs—Throughout the study each healthcare professional recorded the number of visits to each participant. All visits were made to provide advice, with the exception of visits to the leaflet group, where visits were undertaken to record trial outcome information such as weight and the percentage of body fat. As such visits would not be made if the intervention was routinely provided in the NHS, we assumed that the visit cost for all participants who received the leaflet was equivalent to zero. The unit cost of all other visits was estimated from a previously published source16 and included the additional time and travel costs associated with home visits. The cost of providing dyno bands to participants who were allocated to either of the strengthening exercise groups was also estimated (www.physioroom.com).
Analgesic costs—At baseline, participants were asked to report whether they currently used analgesics (obtained by prescription or over the counter) and, if so, which type. The same question was also asked of participants at 12 and 24 months after randomisation. These data were combined with unit cost data17 to estimate the four weekly cost of analgesics. When data were missing, we used multiple imputation18 to generate replacement cost values for participants who did not provide information on analgesic use at a particular follow-up point. Subsequently, for each participant, we used the area under the curve method,19 with baseline adjustment, to estimate the change in analgesic costs, over the 24 month trial period. The mean change in analgesic costs could thereby be calculated for each intervention group, and this was added to the mean visit cost to estimate the mean overall change in cost to the health service for each of the four intervention groups.
Use of other resources—Additionally, to provide an indication of whether participants who received a particular intervention had a relatively high or low level of use of other health service resources, we asked a subset of participants (at one year after randomisation) how many visits related to knee pain (in the preceding four weeks) they had made to the general practitioner, nurse, and other healthcare professionals or hospital (outpatient visits and inpatient admissions were recorded). For practical reasons, the subsample consisted of 229 consecutive participants who had reached the one year follow-up between June 2004 and August 2005. We used one way analysis of variance to assess whether there were significant differences in the mean number of visits across the four intervention groups.
Measuring outcomes
The accompanying clinical paper14 details the results according to the trial primary outcome measure of pain, as assessed by the Western Ontario and McMaster Universities osteoarthritis index (WOMAC).20 To estimate the impact that each intervention had on health related quality of life we asked participants to complete the EQ-5D21 at baseline and at six, 12, and 24 months after randomisation. This enabled us to carry out a cost utility analysis,22 in which we compared the benefits of different healthcare interventions on a common scale (utility is measured on a scale where 0 is equivalent to death and 1 is equivalent to full health). A utility score was assigned to each of the health state descriptions elicited by the EQ-5D with the York A1 tariff,23 on which scores range between –0.594 and 1.00. After using multiple imputation18 to predict missing EQ-5D scores, we used the area under the curve method (with adjustment for baseline differences)19 to estimate, for each participant, the quality adjusted life year (QALY) gain/loss that accrued over the trial period. QALY gains that accrued in the second year were discounted at 3.5%, and the mean QALY gain was estimated for each of the four intervention groups.
Cost effectiveness
The level of cost effectiveness was estimated from the viewpoint of the NHS. We excluded dominated interventions (which had a higher mean overall change in cost to the health service and lower mean QALY gain than another intervention) and interventions that were subject to extended dominance (as combinations of other interventions could provide a greater benefit at equivalent cost).24 Subsequently, we calculated the cost effectiveness of non-excluded interventions by estimating the incremental cost per QALY gain (incremental cost effectiveness ratio) associated with each intervention group, relative to the next best alternative. Confidence intervals for the incremental cost effectiveness ratio were also computed by using the bootstrap technique.25 In line with guidance provided by the National Institute of Health and Clinical Excellence (NICE)26 we sought to identify the most cost effective intervention by comparing the incremental cost effectiveness ratio with a cost effectiveness threshold (
) of £20 000-£30 000 per QALY.
Decision uncertainty
To estimate the level of uncertainty associated with the decision as to which intervention was most cost effective we used probabilistic methods to estimate the cost effectiveness acceptability curve for each intervention group, where the curve depicts the probability that an intervention is cost effective at different levels of the cost effectiveness threshold.27 28
Sensitivity analysis
One of our main assumptions was that all visits to those receiving the leaflet were undertaken solely to record trial outcome information and that these visits would not be made if the intervention was routinely provided in the NHS. Rather than assigning a zero cost to the visits received by those in the leaflet arm, in the sensitivity analysis we assumed that they should be assigned the same unit cost as those who received quadriceps strengthening exercises.
40).
Costs
The mean number of visits received by participants randomised to dietary intervention plus quadriceps strengthening exercises was 11.19 (range 0-16), compared with 13.46 for dietary intervention alone (range 0-17), 4.95 for quadriceps strengthening exercises (range 0-7), and 6.05 (range 0-7) for those who received the leaflet (more participants withdrew from the exercise groups, which might explain why, on average, they received fewer visits than those who received a leaflet, see accompanying clinical paper for further information14). The estimated unit cost per home visit was £54.60 for both the dietary intervention groups, and £44.60 for those who received the quadriceps strengthening exercises; the dyno bands cost £5.50. Over the two year trial period the estimated mean visit cost for those who received dietary intervention plus quadriceps strengthening exercises was £615.64 compared with £735.57 for the dietary intervention, £214.66 for the quadriceps strengthening exercises, and £0.00 for the leaflet (table 1)
.
|
To determine use of other health services, one year after randomisation we contacted 188 (82%) of the proposed subsample of 229 participants. There was no significant difference across each of the four intervention groups in the number of knee pain related visits to the general practitioner, nurse, other healthcare professionals, or hospital in the preceding four weeks (table 2).
|
Cost effectiveness
Comparison of the mean change in cost and mean QALY gain (table 1) across the four intervention groups showed that dietary intervention alone was dominated by dietary intervention plus quadriceps strengthening exercises.
Similarly, quadriceps strengthening exercises was not cost effective as it was subject to extended dominance (combinations of leaflet provision and dietary intervention plus quadriceps strengthening exercises could provide a higher benefit at equivalent cost). Compared with leaflet provision, dietary intervention plus quadriceps strengthening exercises was both more costly (mean incremental cost £646.71, 95% confidence interval £578.15 to £709.62) and more effective (mean incremental effect 0.062, –0.035 to 0.167), with an estimated incremental cost per QALY gain (incremental cost effectiveness ratio) of £10 469.44 (£3738.28 to dominates) (table 1). Thus, dietary intervention plus quadriceps strengthening exercises is likely to be deemed cost effective as it has an incremental cost effectiveness ratio that is more favourable than a threshold of £20 000-£30 000 per QALY.
Decision uncertainty
The cost effectiveness acceptability curves indicate that for threshold values
£5000 per QALY the probability of cost effectiveness was <30% for all four interventions, showing that there is a large level of uncertainty associated with the decision as to which intervention is the most cost effective (figure).
The probability that dietary intervention plus quadriceps strengthening exercises was the most cost effective intervention was 23.1% at
=£20 000 per QALY.
|
=£20 000/QALY.
Strengths and weaknesses
Though our two year follow-up period was longer than in many other clinical trials, we did not estimate the long term costs and benefits of these interventions. Furthermore, as we did not systematically monitor compliance with either the dietary plan or exercise advice, our ability to predict the long term effects of these interventions is diminished. That said, were the benefits of providing dietary intervention plus quadriceps strengthening exercises to be sustained beyond the two year follow-up period then it is likely that, had the analysis taken a lifetime perspective, the estimates as to the cost effectiveness of this intervention would have been more favourable. Similarly, within this study we did not evaluate the provision of group exercise programmes, which others have shown to be effective,3 and it might be that, because of economies of scale, it is more cost effective to use group based exercise classes rather than undertake one to one healthcare professional visits.
Comparison to other studies
We are aware of two studies that have estimated the cost effectiveness of different interventions for people with knee pain (in non-overweight populations),2 3 though only one of these studies measured effectiveness in terms of utility.3 Our results are in contrast with those of Hurley et al, who found that the provision of a rehabilitation programme by a physiotherapist (in addition to usual care) was less effective, in terms of QALYs gained, than usual primary care.3 Our results are more in line with those studies that have used WOMAC to measure effectiveness. Thomas et al found that, compared with either telephone contact or no intervention, an exercise programme was estimated to be more effective according to WOMAC but also more costly and was not associated with a reduction in other health costs.2 Hurley et al found that, compared with usual care, a greater proportion of those who received rehabilitation by a physiotherapist had a clinically meaningful improvement according to WOMAC but that this was also more costly.3
Explanations
The finding that dietary intervention plus quadriceps strengthening exercises was estimated to be cost effective aligns with the findings of the accompanying clinical paper,14 in which strengthening exercises were associated with a reduction in pain according to WOMAC and that both dietary intervention and strengthening exercises improved functioning according to WOMAC. Additionally, the high level of uncertainty associated with the estimates of cost effectiveness can be partially explained by the fact that less than two thirds of those in the dietary intervention plus quadriceps strengthening exercises group actually received a net QALY gain over the two year period.
Implications and future research
The provision of dietary intervention plus quadriceps strengthening exercises to individuals aged
45 with a BMI
28 is likely to represent a cost effective use of scarce NHS resources. There was, however, a large level of uncertainty associated with this decision, which was partially accounted for by the fact that there was a high level of variation in the benefits that different individuals received. Further research might therefore focus on the value of personalised knee pain interventions; some participants might feel they need a high level of support, whereas others, after initial instruction, might be quite able to adhere to the intervention without further support. Here, one might also consider a more thorough investigation of the impact that these interventions have on the number of visits to other healthcare professionals related to knee pain. Though we found no significant difference in this variable in a subsample of patients at a single time point (see table 2), it is conceivable that such services might be affected as it has previously been shown that patients with knee pain who received an exercise programme had both significantly fewer general practice consultations and used less pain relief than those who received only an advice leaflet.13
|
Cite this as: BMJ 2009;339:b2273
Funding: The study was funded by the UK Arthritis Research Campaign (ARC) (grant No 13550). ARC had no role in study design; in the collection, analysis, and interpretation of data; in the writing of the report; or in the decision to submit the paper for publication.
Competing interests: None declared.
Ethical approval: This study was approved by the Nottingham research ethics committee (REC Q1090219); all participants gave informed consent.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?