Cancer Drugs Fund requires further reform

BMJ 2016; 354 doi: https://doi.org/10.1136/bmj.i5090 (Published 27 September 2016) Cite this as: BMJ 2016;354:i5090
  1. Richard Grieve, professor1,
  2. Keith Abrams, professor2,
  3. Karl Claxton, professor3,
  4. Ben Goldacre, senior clinical research fellow4,
  5. Nicholas James, professor5,
  6. Jon Nicholl, professor6,
  7. Mahesh Parmar, professor7,
  8. Chris Parker, consultant oncologist8,
  9. Jasjeet S Sekhon, professor9,
  10. Liam Smeeth, professor10,
  11. David Spiegelhalter, professor11,
  12. Mark Sculpher, professor3
  1. 1Department of Health Services Research and Policy, London School of Hygiene and Tropical Medicine, London WC1H 9SH, UK
  2. 2Department of Health Sciences, University of Leicester, Leicester, UK
  3. 3Centre for Health Economics, University of York, York, UK
  4. 4Centre for Evidence-Based Medicine, University of Oxford, Oxford, UK
  5. 5University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
  6. 6School of Health and Related Research, University of Sheffield, Sheffield, UK
  7. 7Medical Research Council Clinical Trials Unit, University College London, London, UK
  8. 8Institute of Cancer Research: Royal Cancer Hospital, London, UK
  9. 9Travers Department of Political Science, Department of Statistics, University of California, Berkeley, CA, USA
  10. 10Department of Non-Communicable Disease Epidemiology, London School of Hygiene and Tropical Medicine
  11. 11Statistical Laboratory, Centre for Mathematical Sciences, Cambridge, UK
  1. Correspondence to: R Grieve richard.grieve{at}lshtm.ac.uk

Reliance on “real world” observational data undermines evidence base for clinical practice

The reforms to the Cancer Drugs Fund implemented in July were an excellent opportunity to generate evidence on the effectiveness of new cancer drugs.1 Unlike under the previous arrangements, data on patients’ outcomes will have to be collected for all drugs funded by the scheme. However, the reforms’ stated reliance on “real world” (observational) data will not generate reliable evidence of effectiveness. We propose an alternative model, using timely randomised controlled trials within routinely collected data sources, to establish which drugs are relatively effective. The current arrangement encourages early access to drugs, with high prices but uncertain benefits, whereas our proposal will provide high quality evidence for future decisions and therefore larger gains in population health.

The Cancer Drugs Fund was introduced in England in 2010-11 with a £50m (€58m; $65m) budget, which grew to £340m in 2015-16 without evidence of patient benefits.2 Since the reforms, the National Institute for Health and Care Excellence (NICE) is responsible for appraising all new cancer drugs, and the fund will pay for those drugs which have a chance of being judged cost effective, after two years of “real world” data collection. However, once a drug is recommended, precedent suggests it is difficult to stop its use. For example, NHS funding for β interferon for patients with multiple sclerosis continued after an independent evaluation that used “real world” data found it did not improve patient outcomes.3

The current reforms to the fund will not encourage manufacturers to conduct randomised trials, and NICE will have to make decisions without trial evidence. The central role given to “real world” data is a major cause for concern. Accurate estimates of relative effectiveness require that outcomes are compared for patients who do, and do not, take the new drug, but who have similar prognostic characteristics.4 However, in observational studies key characteristics are unmeasured and estimates of effectiveness are biased by residual confounding. Also, the conduct of observational studies is more prone to manipulation by those with vested interests than in randomised trials. The presumption that, without addressing these difficulties, “real world” data can provide unbiased evidence, ignores all we know about good research design for identifying causal effects, and the reasons why well designed randomised trials are the cornerstone of evidence based medicine.5

Instead, we propose that NICE makes “only in research” recommendations, whereby these drugs are available only within pragmatic, low cost, randomised trials. These studies should be designed to provide timely, unbiased estimates of effectiveness by routinely randomising patients to the new drug or current practice at the point of NHS care.6 This can be achieved only with strong support from funders, ethics committees, regulators, and central government, and if a research culture is embedded within the NHS.7 These trials require clinician time to recruit patients and investment in informatics,6 but the costs will be low compared with the drug fund’s budget. Furthermore, follow-up data can be collected from the UK’s high quality, routinely collected clinical datasets (including the world’s largest cancer registry) and linked to existing radiotherapy and chemotherapy datasets, such as the Systemic Anti-Cancer Therapy dataset,8 and to sources of electronic health records, such as the Clinical Practice Research Datalink. Future trials could be linked to cohorts with genetic information.

The trial designs can be flexible and provide a platform for new drugs as they emerge. Multi-arm, multistage trials, in particular, allow more treatments to be assessed than traditional two arm trials, and enable the range of patient subgroups and treatments to adapt as the data provide insights about which patients respond best to which drugs.9 These trials can recruit patients from within observational databases and include international centres to improve statistical power and generalisability.

For some new cancer drugs, an NHS funded randomised trial may provide insufficient additional value to justify the costs.10 If there is an ongoing trial for regulatory purposes it may be more efficient to delay a NICE decision pending evidence on long term outcomes from the regulatory trial. For drugs for which a trial is judged unethical or impractical, careful non-randomised studies should be conducted to minimise confounding, by collecting longitudinal data on all relevant prognostic characteristics and outcomes for patients receiving and not receiving the new drug. To reduce residual confounding further, studies should collect data on characteristics that predict treatment selection but are unrelated to outcomes.11

The reforms to the Cancer Drugs Fund, related initiatives such as the accelerated access review,12 and comparative effectiveness research using, for example, Surveillance, Epidemiology and End Results (SEER) data linked to Medicare,13 all rely on “real world” data. These initiatives will undermine the evidence base for clinical practice; once these products are widely used, randomisation will be impossible. Instead, we propose that expensive new agents are available only within rapid, flexible, and efficient randomised trials. Building NHS capacity for this programme would capitalise on the UK’s strength in trials, generate long term evidence of value worldwide, and yield large benefits to patients.


  • We thank Anirban Basu, John Cairns, Manuel Gomes, Neil Hawkins, Miguel Hernan, Noemi Krief, Alec Miners, Stephen O’Neill, and Bernard Rachet for helpful discussions.

  • Competing interests: We have read and understood BMJ policy on declaration of interests and declare the following interests: RG, KA, KC, CP, LS, JN, and MS have done consultancy or advisory board work for various drug companies. KA conducts research funded by Janssen; MP and JN have multiple educational or research grants from drug companies. RG, KA, and JN have undertaken consultancy for the NICE scientific advisory service, and MS undertakes NICE technology assessment reviews. BG receives income from speaking and writing for lay audiences on problems in science and medicine.

  • Provenance and peer review: Not commissioned, peer reviewed.


View Abstract