Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 16 April 2009, doi:10.1136/bmj.b1288
Cite this as: BMJ 2009;338:b1288
Nigel Armstrong, health economist1, Luke Vale, professor of health technology assessment2, Mark Deverill, senior research fellow1, Ghulam Nabi, clinical lecturer3, Samuel McClinton, consultant urologist3, James NDow, professor of urology3, Robert Pickard, senior clinical lecturer4, for the BPE Study Group
1 Institute of Health and Society, Newcastle University, Newcastle upon Tyne NE2 4AA, 2 Health Services Research Unit and Health Economics Research Unit, Institute of Applied Health Sciences, University of Aberdeen, Aberdeen AB25 2ZD, 3 Academic Urology Unit, Institute of Applied Health Sciences, University of Aberdeen, 4 Urology Research Group, Institute of Cellular Medicine, Newcastle University, Newcastle upon Tyne NE2 4HH
Correspondence to: R Pickard r.s.pickard{at}ncl.ac.uk
Design Care pathways describing credible treatment strategies were decided by consensus. Cost-utility analysis used Markov modelling and Monte Carlo simulation.
Data sources Clinical effectiveness data came from a systematic review and an individual level dataset. Utility values came from previous economic evaluations. Costs were calculated from National Health Service (NHS) and commercial sources.
Methods The Markov model included parameters with associated measures of uncertainty describing health states between which individuals might move at three monthly intervals over 10 years. Successive annual cohorts of 25 000 men were entered into the model and the probability that treatment strategies were cost effective was assessed with Monte Carlo simulation with 10 000 iterations.
Results A treatment strategy of initial diathermy vaporisation of the prostate followed by endoscopic holmium laser enucleation of the prostate in case of failure to benefit or subsequent relapse had an 85% probability of being cost effective at a willingness to pay value of £20 000 (
21 595, $28 686)/quality adjusted life year (QALY) gained. Other strategies with diathermy vaporisation as the initial treatment were generally cheaper and more effective than the current standard of transurethral resection repeated once if necessary. The use of potassium titanyl phosphate laser vaporisation incurred higher costs and was less effective than transurethral resection, and strategies involving initial minimally invasive treatment with microwave thermotherapy were not cost effective. Findings were unchanged by wide ranging sensitivity analyses.
Conclusion The outcome of this economic model should be interpreted cautiously because of the limitations of the data used. The finding that initial vaporisation followed by holmium laser enucleation for failure or relapse might be advantageous both to men with lower urinary tract symptoms and to healthcare providers requires confirmation in a good quality prospective clinical trial before any change in current practice. Potassium titanyl phosphate laser vaporisation was unlikely to be cost effective in our model, which argues against its unrestricted use until further evidence of effectiveness and cost reduction is obtained.
57m, $76m). Despite sustained effectiveness, transurethral resection carries the risk of major haemorrhage and myocardial stress.3 Consequently, alternative surgical options have been trialled to reduce treatment morbidity but maintain effectiveness. In a systematic review of effectiveness we concluded that newer technologies, such as microwave thermotherapy and diathermy or laser vaporisation, do improve symptoms and reduce risk but have higher rates of retreatment than transurethral resection.4 5 According to personal preference, men seeking treatment might trade off this reduced effectiveness for the reduced risk. For most this would result in successful treatment but a minority would have the inconvenience and exposure to risk of having to have a second more effective but potentially more morbid procedure. This might also give improvement from a healthcare perspective as use of the more morbid and costly treatments would be reduced. Such treatment sequences reflect current practice, particularly in the United States, where office based minimally invasive treatments are more widely used. Previous studies of health economics focused on single treatments without allowance for repeat or alternative treatment and provided only limited cost breakdown and sensitivity analysis, restricting generalisability across healthcare systems.6 7 8 We modelled the use of plausible strategies of sequential treatments to maintain symptom control over an appropriate time span to determine which is most likely to be cost effective.
Treatment options and care pathways
The standard procedure was transurethral resection, with failure to benefit or subsequent relapse managed by a second transurethral resection carried out only if urodynamics confirmed obstruction of the bladder outlet. Alternative treatments were categorised into three groups: minimally invasive, characterised by no tissue removal and ambulatory care; tissue ablative, signifying the use of differing energy sources to partially remove prostate tissue; and near total removal of prostate by holmium laser enucleation (HoLEP). Appraisal of the evidence base for effectiveness,4 5 current practice, and commercial availability identified transurethral microwave thermotherapy (TUMT) and diathermy vaporisation (TUVP) as typifying the minimally invasive and tissue ablative groups, respectively. We also included potassium titanyl phosphate (KTP) laser vaporisation in the model as a substitute for diathermy vaporisation given its current clinical popularity.10 A clinical expert group, consisting of four urologists from two centres, identified by consensus clinically appropriate sequences of escalating surgical intervention according to treatment mechanism and effect on remaining prostate tissue. Sequences were defined by a set of rules reflecting current and likely future use of each method: treatments always proceeded from less to more invasive; minimally invasive treatments could be repeated only once; tissue ablative and holmium laser enucleation procedures could not be repeated because of the effect on remaining prostate tissue and near total removal, respectively; and transurethral resection could be repeated only once and only after confirmation of obstruction of the bladder outlet (table 1
).11
|
Model structure
We constructed a Markov model describing the sequence of events and main health states that men might find themselves in after the defined treatment strategies. The cycle length was set at three months, the period over which benefit would occur and short term adverse events resolve. We chose a time horizon of 10 years as this was the period over which the population would be likely to seek active treatment and current technologies would remain relevant. The model was run by entering 10 successive annual cohorts of 25 000 men, the number receiving treatment each year in the NHS in England. We chose a multiple cohort design to better model the effects of applying sequences of escalating treatment and where progressively fewer members of a cohort would need additional surgery. The design also simulates the purchase of new equipment as required over the stated time horizon.
Definition of health states
We defined six health states: treatment, remission, no remission, remission with incontinence, no remission with incontinence, and death. Remission was defined as a more than 10% improvement in the international prostate symptom score, equivalent, for the population under study, to the 3 point reduction noticeable by men undergoing treatment for symptoms presumed to be caused by benign prostatic enlargement.12 The number of cycles spent by each individual in this state was determined by the probability of relapse after an initially successful treatment derived from long term observation data. The state of "no remission" was entered with the probability of initial failure or subsequent relapse for that particular treatment. Incontinence, defined as leakage of urine of sufficient degree to make an individual seek help and therefore result in additional treatment, was the only complication we included in the model. If this occurred no further treatment was possible and only transitions from remission to no remission or to death could occur. All other complications (urinary retention, bladder neck stenosis and/or urethral stricture, blood transfusion (a measure of severe bleeding), transurethral syndrome, and urinary infection) were considered as short term and were assumed to have been resolved within the three month treatment state. Retrograde ejaculation was not included as it is generally of little trouble to the population of men under study,13 and erectile dysfunction was not included as incidence was similar for all interventions and for untreated men.4 5 14 Death was modelled as an absorbing state with age dependent transition probabilities calculated from UK life tables without weighting according to procedure. If the state of no remission-no incontinence was entered and further treatments were possible in the defined sequence then transition to the next treatment was allowed. If the individual was in the no remission state at the end of the treatment sequence then the only transition possible was to death.
Data sources
Utility values
We derived utility values for each health state from previous studies that used time trade-off15 and standard gamble16 techniques, adjusted for total symptom score and for the presence of incontinence (table 2
).
|
|
|
Complications—We estimated probabilities for these complications after transurethral resection by summing events across the respective treatment arms of studies carried out in the UK. Probabilities for other treatments were calculated with the relative risk reported in the meta-analysis.
Mortality—Our meta-analysis22 and a previous systematic review17 showed that there was no evidence for different mortality rates after each procedure at 12 months, while age adjusted longer term rates after transurethral resection are known to be similar to those in the general population.23 The only trial comparing transurethral resection against advice on managing symptoms alone also showed no difference in mortality rates.24 We therefore applied age specific population mortality rates for English men, irrespective of treatment or treatment sequence in line with previous economic evaluations in this area.7
Costs
We considered only hospital costs because primary care costs would be low and similar for each procedure (tables 2, 3, 4).
Endoscopic procedures (diathermy or laser vaporisation, laser enucleation, and transurethral resection) were assumed to incur the same basic costs (2005 NHS reference costs for healthcare resource group (code L28), adjusted for differing length of stay by subtracting bed-day cost calculated from a non-operative code (L09). We added appropriate extra costs for equipment, such as optical fibres for laser transmission and tissue morcellators for laser enucleation, using data provided by UK based manufacturers or distributors. As a UK reference cost for microwave thermotherapy was unavailable we calculated it using manufacturers data from the US, day case procedure NHS reference costs, and clinical expert opinion. Capital costs of the relevant energy generator for microwave thermotherapy, laser vaporisation, and laser enucleation were derived from commercial sources. The costs of short term complications were calculated by summing costs of extra interventions, such as blood transfusion or bladder neck incision, and extra bed days calculated from the cost difference between L27 (transurethral resection with complications) and L28 (transurethral resection without complications). The cost of incontinence was derived from the drug tariff for oxybutynin multiplied by the proportion of men (95%) having urge incontinence as defined by the clinical expert group. For the 5% of men with stress incontinence the cost was that for insertion of an artificial urinary sphincter (£6000).
Sensitivity analysis
Probabilistic
To test for the effect of uncertainty in parameter estimates, we used Monte Carlo simulation to select values for each parameter within the model according to a distribution around each parameter. Limits of uncertainty were defined with 95% confidence intervals from meta-analysis, the individual dataset, NHS cost ranges, and expert opinion, with distribution shapes chosen according to standard practice (tables 2, 3, 4
).25 These values were then combined in the Markov model to estimate the outcome for each treatment strategy by repeating the process 10 000 times and calculating the expected cost and effectiveness of each treatment sequence as the mean across all samples. We chose the number of iterations by determining the point at which addition of further samples did not result in any change in the ranking. In table 5
, in addition to the expected cost and effectiveness results, the probability that a particular strategy was cost effective was defined as the proportion of all Monte Carlo simulations using that strategy meeting the willingness to pay criterion of £20 000/QALY.9 The figure shows results for various thresholds as a cost effectiveness acceptability curve (figure
) to illustrate uncertainty regarding assignment of threshold values for willingness to pay.
|
|
Sensitivity analysis
Model parameters
Tables 6, 7, and 8 show the results of one way sensitivity analyses
. If we derived the probability used to predict treatment failure from reoperation rates, as suggested by meta-analysis, then holmium laser enucleation as a single treatment became extendedly dominated by strategies starting with diathermy vaporisation. If length of stay for transurethral resection was reduced from three to two days then the current reference strategy of transurethral resection, repeated if needed, was no longer dominated by diathermy vaporisation. If performance of urodynamics was made mandatory for treatment failure after diathermy vaporisation then the standard strategy of transurethral resection, repeated if necessary, was not dominated but had an incremental cost per QALY gained of £230 608. Using a single cohort of 25 000 men generally showed similar incremental cost effectiveness ratios (ICER) for non-dominated strategies except for diathermy vaporisation followed by transurethral resection, repeated if necessary. Variation of all other parameters did not alter conclusions drawn from base case analysis.
|
|
|
|
The finding that potassium titanyl phosphate laser vaporisation was unlikely to be cost effective, either as a single treatment or within a treatment sequence, is important as the procedure has gained wide popularity around the world because of its perceived ease of use and reduced risk of bleeding and despite the lack of evidence of equivalent or improved effectiveness over transurethral resection. Although we obtained outcome parameters for this option from the single eligible published trial involving potassium titanyl phosphate laser vaporisation available at the time of our meta-analysis and from other trials involving vaporisation using alternative lasers, the finding was unchanged by sensitivity analysis around uncertainty in treatment benefit. In addition, a subsequent publication has noted reduced efficacy and increased retreatment rates compared with transurethral resection.29 This option was also associated with relatively high cost because of the need for one or more disposable optical fibres, but again the conclusions were not altered by sensitivity analysis around this variable and were not compensated by reduced length of stay or savings from the reduced complication rate. This result, based on current evidence, therefore does not support its current unrestricted use in clinical practice.
Use of strategies
Sequences of escalating treatments were more effective than single treatments, and this supports the need to compare clinically plausible strategies as well as one-off treatments in clinical trials. This policy of care would be particularly attractive for large centrally managed healthcare systems, such as the UK NHS, whereby widespread use of a less morbid, technically less demanding, and cheaper option, such as diathermy vaporisation, could be widely offered as the initial treatment in various settings, whereas holmium laser enucleation, with its need for highly skilled operators, would be available in a limited number of specialised units to treat the relatively small number of men who fail to benefit or relapse after a vaporisation procedure. The findings of our study and associated systematic reviews4 5 suggest the need for longer term high quality trials to test the worth of such sequences of newer treatment. A multicentre head-to-head randomised controlled trial of this strategy against the standard of transurethral resection, repeated as needed, followed by a longer term "tracker" trial of the newer technologies should particularly assess the need, reason, and chosen technique for retreatment after failure or relapse. The design would need to be flexible to encompass new technologies as they emerge and account for changes in current technology, such as increased power and reduced fibre cost for laser vaporisation, and should be sufficiently powered to reduce uncertainty regarding cost effectiveness. To better judge cost effectiveness it would be necessary to consider in more detail how symptom scores map to utility values and how QALY gains estimated by disease specific symptom scores compare with estimates by using a generic instrument such as the EQ-5D. Calculation of utility values would be strengthened by qualitative research components to record preferences of individual men concerning the trade-off between reduced treatment morbidity and increased risk of reoperation.
Uncertainties
Although we have used the best available methods to define the likely outcomes of each treatment, limitations in the current evidence base lead to inevitable uncertainty regarding parameter values. Reassuringly, sensitivity analysis around appropriately selected variables did not radically change key outcomes of the model. Calculation of the expected value of perfect information according to standard practice30 suggested that an upper overall limit of £5.3m should be spent on further research to give worthwhile benefit, with specific studies of vaporisation techniques and holmium laser enucleation having upper limits of £4.2m and £1.7m, respectively. These values are based on perfect rather than sample based evidence and therefore future trials should be carefully planned to deliver the required answer well within these financial constraints.
Strengths of the model
We have considered a wide variety of treatment sequences of relevance to healthcare consumers and providers in differing healthcare systems. The inclusion of minimally invasive treatments, for example, is most relevant to clinical practice in the US and Scandinavia, while holmium enucleation is mostly used in Europe and Australasia. We have also accounted for continued changes in clinical practice by including well researched but currently unpopular options such as diathermy vaporisation as well as recently introduced but less well evaluated procedures such as potassium titanyl phosphate laser vaporisation. Our model was based on a rigorous systematic review of the international literature. We also made strenuous efforts to be transparent in our reporting, which should allow researchers and decision makers to make judgments about the applicability of the work to their own settings. The use of a multiple cohort model allowed consideration of the diseconomies associated with using a costly, capital intensive second or third line treatment by simulating the purchasing of new equipment as required over the time horizon and avoided bias inherent in the allocation of capital costs across the whole population and time period using a single cohort technique. As a result, we believe that this model gives improved meaning regarding the effects of changing treatment policy for decision makers as well as clinicians.
Limitations of the model
Initially, we included in the model other procedures identified in the systematic review—such as bipolar diathermy resection and holmium laser vaporisation—but the number of possible treatment sequences became unmanageable and we therefore focused on technologies in current wide use or those with an extensive evidence base. Selection between vaporisation techniques with different energy sources presented a difficulty, with diathermy having the greatest evidence base but potassium titanyl phosphate laser currently being the most popular. Both were run in the model and the result in terms of cost effectiveness was markedly in favour of diathermy, despite its current unpopularity. Given that these techniques achieve the same surgical result in terms of tissue ablation it is likely that a future laser procedure, which replicates the treatment benefit and low cost of diathermy, could take its place within the sequence of cost effective treatment.
The probability of failure for treatments under study was a key parameter but difficult to quantify with certainty; lack of change in symptoms was the preferred definition but it was uncertain how this was reflected in reoperation rates published in the literature, which differed between studies. Our resolution was to use individual level data, and this seemed valid because a sensitivity analysis with a different approach gave largely consistent results. The use of a threshold of <10% improvement in symptoms reflected the definite need for further surgery as distinct from other definitions of treatment success used in trials of treatment. It would, however, be important to validate this threshold in future studies by prospectively recording reasons for retreatment. Mapping of symptom scores to utility values was another difficulty, which we resolved by synthesising available data. Again sensitivity analysis suggests that our approach was reasonable, although the need for further research in this area is acknowledged.
Costs were deliberately based on the setting of the NHS in England because this provided the most comprehensive source of data, and, again, sensitivity analysis suggests that the choices made were robust, although translation to other healthcare systems might not be clear cut. We did not consider costs associated with staff retraining and service reconfiguration required to change practice away from the standard of transurethral resection, but these are likely to be small if the cost effective strategy of vaporisation followed by holmium resection in the case of failure or relapse is adopted as sufficient capacity already exists. Any healthcare provider, however, would need to consider the opportunity cost of switching funding from another area to implement the policy change.
The population studied in the model was sufficiently healthy to undergo any of the procedures. In practice, men with comorbidities resulting in an excessive risk of bleeding or fluid imbalance tend to be advised against transurethral resection. For these men, less morbid procedures, such as microwave therapy and potassium titanyl phosphate laser vaporisation, offer the opportunity for treatment and indeed are in widespread use for this indication, but inclusion of this scenario would have greatly increased the complexity of our model. Our remit was focused on surgical treatment and we therefore assumed that men entering the model had already tried and failed conservative management in the form of advice on fluid management or drug treatment. In future research it would be useful to add these options at the start of treatment strategies to determine overall cost effectiveness of all options available for the management of this condition.
Conclusion
Current evidence suggests a sequence of treatments consisting of initial diathermy vaporisation followed by either holmium laser enucleation or transurethral resection, repeated if necessary on failure or relapse, are cost effective strategies for surgical treatment of symptoms presumed to be caused by benign enlargement of the prostate. Given uncertainty about the willingness to pay threshold for a gain in QALYs, single treatment with either diathermy vaporisation or holmium laser enucleation could also be cost effective. Limitations in available data might affect the results of the cost effectiveness analysis and additional opportunity costs might negate savings made by changing from the current highly clinically effective established standard of transurethral resection.
|
Cite this as: BMJ 2009;338:b1288
Contributors: NA coordinated the study, constructed the Markov model, carried out data analyses, cowrote the manuscript, and is guarantor. LV provided expert methodological and analytical advice and commented on drafts of the manuscript. MD provided methodological advice. GN and SM were members of the clinical expert group and commented on drafts of the manuscript. JND led and coordinated the BPE project, was a member of the clinical expert group, and commented on the manuscript. RP assisted in conceiving and constructing the model, coordinated the analysis, cowrote the manuscript, was a member of the clinical expert group, and is guarantor. All authors declare that they accept full responsibility for the conduct of the study, had access to the data, and controlled the decision to publish.
Funding: This study was funded by the Health Technology Assessment Programme (project No 04/38/03). The views expressed in this paper are those of the authors not the institutions providing funding. An extensive monograph describing the whole project of which this analysis is a part is available for open access (Lourenco T, Armstrong N, NDow J, Nabi G, Deverill M, Pickard R, et al. Systematic review and economic modelling of effectiveness and cost utility of surgical treatments for men with benign prostatic enlargement. Health Technol Assess 2008;12:1-516).
Competing interests: None declared.
Ethical approval: Not required.
© Armstrong et al 2009
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?
Read all Rapid Responses