Systematic review and economic evaluation of Helicobacter pylori eradication treatment for non-ulcer dyspepsia
(Published 16 September 2000)
Cite this as: BMJ 2000;321:659
- Paul Moayyedi, senior lecturera,
- Shelly Soo, research fellowa,
- Jonathan Deeks, headb,
- David Forman, professor of cancer epidemiologyc,
- James Mason, senior lecturer in health economicsd,
- Michael Innes, research fellowe,
- Brendan Delaney, senior lecturer on behalf of the Dyspepsia Review Group. ()e
- a Gastroenterology Unit, Centre for Digestive Diseases, General Infirmary at Leeds, Leeds LS1 3EX
- b Systematic Review Development Programme, ICRF/NHS Centre for Statistics in Medicine, Institute of Health Sciences, Oxford OX3 7LF
- c Cochrane Upper Gastrointestinal and Pancreatic Diseases Group, University of Leeds, Leeds LS29LN,
- d Centre for Health Economics, University of York, York YO1 5DD
- e Department of General Practice, University of Birmingham, Medical School, Birmingham B15 2TT
- Correspondence to: B Delaney
- Accepted 21 June 2000
Objectives: To evaluate efficacy and cost effectiveness of Helicobacter pylori eradication treatment in patients with non-ulcer dyspepsia infected with H pylori.
Design: Systematic review of randomised controlled trials comparing H pylori eradication with placebo or another drug treatment. Results were incorporated into a Markov model comparing health service costs and benefits of H pylori eradication with antacid treatment over one year.
Data sources: Six electronic databases were searched for randomised controlled trials from January 1966 to May 2000. Experts in the field, pharmaceutical companies, and journals were contacted for information on any unpublished trials. Trial reports were reviewed according to predefined eligibility and quality criteria.
Main outcome measures: Relative risk reduction for remaining dyspeptic symptoms (the same or worse) at 3-12 months. Cost per dyspepsia-free month estimated from Markov model based on estimated relative risk reduction.
Results: Twelve trials were included in the systematic review, nine of which evaluated dyspepsia at 3-12 months in 2541 patients. H pylori eradication treatment was significantly superior to placebo in treating non-ulcer dyspepsia (relative risk reduction 9% (95% confidence interval 4% to 14%)), one case of dyspepsia being cured for every 15 people treated. H pylori eradication cost £56 per dyspepsia-free month during first year after treatment.
Conclusion: H pylori eradication may be cost effective treatment for non-ulcer dyspepsia in infected patients but further evidence is needed on decision makers' willingness to pay for relief of dyspepsia.
There is unequivocal evidence that infection with Helicobacter pylori is the principal cause of peptic ulcer disease. The organism is present in 85-95% of patients with peptic ulcer disease, and treating the infection is effective in healing these ulcers.1 Treatment to eradicate H pylori results in permanent cure of peptic ulcer disease, whereas 60-80% of such patients relapse within a year if treated with antisecretory drugs alone.
The evidence for an association between H pylori and non-ulcer dyspepsia is more uncertain. Many trials evaluating the efficacy of H pylori eradication treatment for non-ulcer dyspepsia have been poorly designed and have given conflicting results.2 A recent review of the literature indicated that H pylori eradication treatment is effective in non-ulcer dyspepsia,3 but the results of other reviews that include more recent trials have been less clear. 4 5
Several well designed trials have been published in the past two years. These have also given conflicting results, suggesting that any effect of H pylori eradication treatment on non-ulcer dyspepsia is at best small and may not be an efficient use of resources. We have conducted a rigorous systematic review of available randomised trials and performed an economic analysis of the results to establish whether H pylori eradication is a cost effective treatment for non-ulcer dyspepsia.
Randomised controlled trials fulfilling the eligibility criteria listed in the box were suitable for inclusion in the review, regardless of language and publication status. We identified studies by searching six electronic databases using both subject terms and text words; by reviewing bibliographies of retrieved trials; by contacting experts in 15 countries and pharmaceutical companies; and by requesting information of articles in peer review or in press from editors of general medical and gastroenterology journals (full details of the searches are given on the BMJ's website). Electronic searches were initially undertaken in March 1999, and updated in May 2000. In addition, we routinely scanned general medical and major gastroenterology journals over the previous year to ensure inclusion of the most recent studies.
Eligibility and quality criteria
Randomised controlled trial
Patients with dyspepsia defined as “any upper gastrointestinal symptoms referable to the gastrointestinal tract,” which includes dyspepsia defined according to the working group criteria (1989)6 and the Rome criteria (1991).7 Trials that included only patients with heartburn and acid reflux were excluded
Peptic ulcer disease and oesophagitis were previously excluded in all participants by endoscopy or barium meal
Intervention group received effective H pylori eradication treatment (see below), while comparison group received placebo or other drugs known not to eradicate H pylori
Suitable H pylori eradication treatments were
Proton pump inhibitor dual treatment—Proton pump inhibitor plus either amoxicillin or clarithromycin for two weeks
New triple treatment—Proton pump inhibitor, H2 receptor antagonist, or ranitidine bismuth citrate with two out of three of amoxicillin, clarithromycin, and 5-nitroimidazole for at least one week
Standard triple treatment—Bismuth salt with two out of three of tetracycline, amoxicillin, and metronidazole for at least one week
Quadruple treatment—Proton pump inhibitor plus standard triple treatment
Dyspeptic symptoms or quality of life assessed as an outcome with previously validated measures
True random allocation
Concealment of allocation
Patient reliably blinded to treatment allocation
Investigator reliably blinded to treatment allocation
Analysis according to allocation, regardless of compliance (intention to treat)
Percentages of participants excluded from all analysis
Assessment of eligibility and trial quality
Dyspepsia was defined according to published definitions. 6 7 Two investigators independently reviewed all identified papers according to the eligibility and quality criteria. Abstracts were not included unless further details were available from the authors. Where disagreements occurred a third reviewer was involved and the majority view taken. The quality of trials was evaluated according to predefined criteria (see box). The quality assessment focused on whether the methods used for randomisation, concealment of allocation, and blinding of participants and investigators were stated. Use of intention to treat analyses and completeness of follow up were also recorded, and the use of validated dyspepsia and quality of life measures was noted. Trials described as randomised but which did not state a method of randomisation were included.
A single investigator extracted data from eligible trials on a standardised form, which was checked by a second investigator. Data from intention to treat analyses were used whenever they were provided, and outcomes were recorded for the final assessment. Where dyspepsia outcomes were recorded in categories they were regrouped into an a priori dichotomy of those with improved (mild symptoms) or resolved dyspepsia (no symptoms) versus those with the same or worse dyspepsia (moderate or severe symptoms). Dichotomies and scale measures of dyspepsia were recorded as reported, as were assessments of quality of life.
We expressed the effect of eradication in each trial as a relative risk, comparing the numbers remaining dyspeptic in the eradication group with those in the comparison group. We pooled relative risks using a fixed effect (Mantel-Haenszel) model, the appropriateness of which we assessed using a test of homogeneity and of funnel plot asymmetry.8 We then converted the outcome to relative risk reduction (100×(1−relative risk)%) and calculated the number needed to treat as: 100/((relative risk reduction)×(mean dyspepsia rate in placebo group)).
We estimated the impact of treatment on quality of life by combining standardised effect sizes because a mixture of instruments to measure quality of life had been used in the trials. All results were reported with 95% confidence intervals. We performed sensitivity analyses, using STATA (version 6.0), to investigate the impact of individual trials on the overall results. The review was undertaken according to a protocol published in the Cochrane Library and will be regularly updated as a Cochrane review as more information becomes available.
Using the computer program TreeAge version 3.5 (TreeAge Software, Williamstown, MA), we incorporated estimates from the systematic review into a Markov model (see BMJ's website for details) to establish the cost effectiveness of H pylori eradication treatment in non-ulcer dyspepsia.
Strategies compared in the model
The model compared H pylori eradication with one month of antacid treatment in patients with non-ulcer dyspepsia, with follow up over one year (the same duration as the trials). For the model, it was assumed that antacid treatment acted as an inexpensive placebo9 and that patients whose symptoms continued despite treatment would be given advice on lifestyle and reassurance by their general practitioner but no additional treatment beyond the first month.
Costs and benefits identified in the model
The model evaluated the impact of H pylori eradication from a health service perspective, incorporating the costs of drugs and visits to a general practitioner as given in published sources (table 1). The benefit of treatment was measured as the number of months of minimal or no dyspeptic symptoms during the year. The response rate at one year for those receiving antacids was estimated from the placebo group in the systematic review and converted into a monthly probability of recurrent dyspepsia. We applied the relative risk reduction from the review to estimate the response rate for those receiving H pylori eradication treatment. We tested the robustness of the results in one way sensitivity analyses.
The main areas of uncertainty in the model are the estimate of the relative risk reduction and the maximum willingness to pay for one month free of dyspepsia We assumed that the relative risk of dyspepsia in patients given H pylori eradication treatment had a log normal distribution with a mean and standard deviation derived from the pooled estimate from the meta-analysis. We then conducted a probabilistic sensitivity analysis using Monte Carlo simulation of 100013 and repeated this analysis for high and low cost eradication regimens. We used an Excel 97 spreadsheet to construct a set of cost effectiveness acceptability curves to reflect uncertainty in both effects and the maximum willingness to pay.14-16
Our initial search identified 5146 articles, but, after scanning titles and abstracts, we found only 47 trials that seemed to evaluate H pylori eradication treatment in non-ulcer dyspepsia. Twelve of these trials met the eligibility criteria and were included in the systematic review (see BMJ's website for details of studies). Ten trials compared H pylori eradication treatment with placebo or placebo plus a proton pump inhibitor with follow up of 3-12 months.17-26 We considered the other two trials 27 28 separately because they compared H pylori eradication treatment with an alternative drug treatment and followed patients for only three months or less.
Effect of H pylori eradication treatment on dyspepsia symptoms
One trial22 did not give results as dichotomous outcomes, and we could not obtain this information from the authors. This trial evaluated 84 patients and reported no change in mean dyspepsia score between those randomised to H pylori eradication treatment and those given placebo. The remaining nine trials 17-21 23-26 evaluated a total of 2541 patients and defined dyspepsia cure as no symptoms or mild symptoms not interfering with daily activities. The mean placebo response rate at one year was 28% (range 7-51%), and the mean H pylori eradication treatment response rate was 36% (range 21-58%). An unusually high placebo response rate was observed in two trials 21 26 and two others included some patients with predominant reflux symptoms, 17 24 but there was no significant heterogeneity between the trial results (heterogeneity test χ2=7.09, df=8, P=0.53). There was also no evidence of funnel plot asymmetry.
Overall, there was a small but significant benefit of H pylori eradication treatment at 12 months (relative risk reduction 9% (95% confidence interval 4% to 14%)) (fig 1). The number of patients needed to treat with H pylori eradication treatment to cure one extra case of non-ulcer dyspepsia was 15 (95% confidence interval 10 to 31). The point estimate of the relative risk reduction did not vary by more than 2% and remained significant when any one trial was omitted from the analysis. The meta-analysis included several studies that were available in abstract and for which there were no full papers to review. When these were excluded in a sensitivity analysis the effect of H pylori eradication on symptoms remained at a similar level (relative risk reduction 7% (1% to 12%)).
Of the other two trials, Sheu et al compared bismuth subcitrate, amoxicillin, and metronidazole with H2 receptor antagonist in 41 patients with non-ulcer dyspepsia,27 and Dhali et al compared bismuth subcitrate, tetracycline, and metronidazole with sucralfate in 62 patients.28 Both trials used scale measures of dyspeptic symptoms and showed significant benefits of H pylori eradication compared with the alternative treatment.
None of the trials formally evaluated individual dyspepsia symptoms, although two prospectively subdivided patients into the categories of ulcer-like and dysmotility-like dyspepsia. 20 21 Similar proportions of patients in these categories responded to H pylori eradication treatment.
Effect of H pylori eradication on quality of life
Three trials presented data on quality of life at 12 months that were suitable for meta-analysis. Two trials used the psychological general wellbeing index, 18 20 and one used the SF-36.17 Overall, H pylori eradication treatment had no significant effect on quality of life compared with placebo (standardised mean difference 0.01 (95% confidence interval −0.12 to 0.15)).
Quality of trials included in review
All the trials that compared H pylori eradication with placebo were double blind, placebo controlled, and with follow up of at least three months. Four trials described the population from which non-ulcer dyspepsia patients were recruited and stated the method of randomisation, 17 18 20 21 but only one mentioned the method used to conceal allocation at randomisation.18 All trials used validated dyspepsia questionnaires and excluded patients with confirmed peptic ulcer disease or oesophagitis before enrolment.
In four trials repeat endoscopy was performed at 12 months to ensure that patients remained free of peptic ulcer disease, 18 20 21 26 but only two reported these results: 6/164 (4%) and 7/143 (5%) of patients taking placebo developed peptic ulcer disease at 12 months' follow up compared with 1/164 (0.6%) and 3/150 (2%) in the treatment groups. 18 21 Although repeat endoscopy was not part of the protocol of the McColl trial,17 nine patients underwent endoscopy during follow up because of persistent symptoms: all three patients in the treatment group had normal results, whereas four of the six patients in the placebo group had peptic ulcer disease.
Two trials reported endoscopic oesophagitis as an outcome measure at 12 months, 18 29 and these found oesophagitis to be slightly more common in the patients allocated to H pylori eradication treatment. However, these events were relatively rare (17/297 (6%) in the treatment group and 9/306 (3%) in the placebo group), and the difference between the groups was not significant (relative risk 2.07 (0.94 to 4.56)).
Cost effectiveness analysis
Our cost effectiveness analysis estimated that H pylori eradication would be £31.76 more expensive per patient per year than the antacid strategy (cost of antacid strategy £55.25, cost of H pylori eradication strategy £87.01) but that patients receiving H pylori eradication treatment would benefit by an average of an extra 0.56 months free from dyspepsia than those given antacid. This yielded an incremental cost effectiveness ratio of £56 per extra month free from dyspepsia. This finding was robust to all one way sensitivity analyses except for the size of relative risk reduction (table 2).
The decision as to whether H pylori eradication treatment is cost effective in non-ulcer dyspepsia depends on the maximum willingness to pay for each month free of dyspepsia and the uncertainty that the decision maker is willing to tolerate. This is shown in the cost effectiveness acceptability curve (fig 2). If a decision maker is willing to accept a 20% chance of the policy being incorrect, then, for a maximum willingness to pay of £75 a month free of dyspepsia, the “base case scenario” would be acceptable. If the maximum acceptable cost were £25, then only cheaper eradication regimens would be cost effective.
The results of our systematic review are based on well designed and executed randomised trials. The trials were usually large, with no evidence of imbalance in baseline characteristics. Outcomes were assessed with validated dyspepsia questionnaires; drop out rates were low; and intention to treat analyses were reported for extended follow up.
The meta-analysis estimated a significant 9% reduction in the number of patients with non-ulcer dyspepsia remaining dyspeptic after the use of H pylori eradication treatment. Of the nine trials included in this analysis, only three reported a significant benefit of eradication treatment. 17 24 26 While there has been lively debate about the apparent differences in the results of these trials,30 there is in fact no evidence of statistical heterogeneity in their results so the differences may be explained by chance. None of the nine trials had sufficient power to detect treatment benefits as small as that observed in this meta-analysis. Our overall result is also supported by the two small trials that showed a benefit for H pylori eradication treatment at 2-3 months over H2 receptor antagonists27 or sucralfate28 in non-ulcer dyspepsia patients.
The mechanism by which H pylori eradication treatment reduces dyspepsia symptoms in patients with non-ulcer dyspepsia is unclear.31 H pylori causes most gastric and duodenal ulcers, and the therapeutic effect noted in this meta-analysis might be due to the treatment of undiagnosed peptic ulcer disease. All patients underwent endoscopy before entry into the trials to exclude peptic ulcer disease, but in this relapsing and remitting disorder patients with an ulcer diathesis do not always have an ulcer associated with their dyspepsia. 32 33 This is emphasised by the observation that 4% of the patients enrolled into the placebo groups of two of the trials we reviewed developed peptic ulcer disease during follow up. H pylori eradication treatment may therefore be effective only in treating the small subset of patients with peptic ulcer disease that has been misclassified as non-ulcer dyspepsia. This possibility does not invalidate our conclusion: pragmatically, patients with dyspepsia and normal results on endoscopy gain a modest benefit from H pylori eradication.
What is already known on this topic
The efficacy of H pylori eradication treatment for non-ulcer dyspepsia is controversial
Randomised controlled trials have given conflicting results
Previous systematic reviews have suggested that such treatment might be of benefit, but they did not include all relevant trials or evaluate cost effectiveness of treatment
What this study adds
H pylori eradication is of small but statistically significant benefit for dyspepsia symptoms of patients with non-ulcer dyspepsia
An estimated 15 infected patients would need H pylori eradication treatment to cure one extra case of non-ulcer dyspepsia
Despite the small clinical effect, H pylori eradication treatment might be a cost effective intervention for non-ulcer dyspepsia
Cost effectiveness of eradication
The effect of H pylori eradication treatment on dyspeptic symptoms in non-ulcer dyspepsia is small, and so it is important to evaluate whether it is cost effective. As a baseline estimate, our Markov model suggested H pylori eradication cost an extra £56 for each month free from dyspepsia in patients with non-ulcer dyspepsia. The model was constructed to provide a conservative estimate of cost effectiveness. We did not extend the effect of treatment beyond the length of the trials, although benefits should continue to accrue. The model compared H pylori eradication treatment with antacid, as definitive evidence for the effectiveness of more expensive treatments such as antisecretory or prokinetic treatment is lacking.34 We have also not assessed the potential for increasing antimicrobial resistance rates, as the additional impact of treating non-ulcer dyspepsia on the present rate of antibiotic prescribing in the community is likely to be small.35 The Markov model applies only to patients with non-ulcer dyspepsia diagnosed after endoscopy and should not be extrapolated directly to the management of undiagnosed dyspepsia.
Data from observational studies have suggested that H pylori eradication treatment may increase the incidence of reflux disease.36 However, the randomised controlled trials in our meta-analysis did not report a significant increase in reflux symptoms or oesophagitis with eradication treatment, and we did not include gastro-oesophageal reflux in the model.
Non-ulcer dyspepsia is a common problem that is distressing for patients and responsible for a substantial healthcare costs.37 Treating the infection could be cost effective provided a cost of £75 per month free from dyspepsia is acceptable. This cut off point is open to debate, and more research is needed into the willingness to pay for relief of dyspepsia symptoms. If cheaper H pylori eradication regimens were used the cost would be less than £25 per month free from dyspepsia. To place this in context, this is half the cost of long term treatment of gastro-oesophageal reflux disease with antisecretory treatment.38
The Dyspepsia Review Group comprised Adam Harris, Department of Gastroenterology, Kent and Sussex Hospital, Tunbridge Wells; Brendan Delaney, Michael Innes, Rachel Oakes, Richard Hobbs, and Sue Wilson, Department of Primary Care and General Practice, University of Birmingham; David Forman, Cochrane Upper Gastrointestinal and Pancreatic Diseases Group, University of Leeds; James Mason, Centre for Health Economics, University of York; James Raftery and Pelham Barton, Birmingham Health Economic Facility, Health Services Management Centre, Birmingham; Jonathan Deeks, ICRF/NHS Centre for Statistics in Medicine, Institute of Health Sciences, Oxford; Paul Moayyedi and Shelly Soo, Gastroenterology Unit, Centre for Digestive Diseases, The General Infirmary at Leeds.
Contributors: PM developed the protocol, assessed eligibility of trials, performed data extraction and the economic analysis, and co-wrote the manuscript. SS reviewed the literature, performed most of the eligibility assessments and data extraction, and reviewed the manuscript. JD developed the protocol, checked the eligibility assessments and data extraction, performed the statistical analyses, and co-wrote the manuscript. JM helped develop the economic model and co-wrote the manuscript. MI helped review the literature and reviewed the manuscript. DF developed the protocol and co-wrote the manuscript. BD was lead applicant, chaired the study group, developed the protocol, checked eligibility assessments, performed the economic modelling, and co-wrote the manuscript. PM and BD are guarantors for the study.
We thank all the experts in the field who responded to our request for information. We thank Professor Malfertheiner, Dr Fuchs, Dr Froehlich, and Dr Miwa for providing us with additional information about their trials and are particularly indebted to Dr Koeltz for providing details of the results of the FROSCH study. We thank Pelham Barton for his advice on conversion of risks to rates in the Markov model.
Funding The NHS Executive Research and Development, Health Technology Assessment Programme funded this review and modelling exercise (project No 96/37/01). The views expressed in the paper are the opinions of the authors and do not necessarily reflect those of the NHS Executive. PM holds a UK Medical Research Council Health Services Research Training Fellowship. BD holds an NHS R & D National Primary Care Career Scientist Award. The Cochrane UGPD Group is funded by the NHS R & D Directorate.
Competing interests PM is an independent medical adviser to AstraZeneca.
Details of search strategy and of trials identified in search appear on the BMJ's website