Intended for healthcare professionals

Feature Reporting Outcomes

Is this trial misreported? Truth seeking in the burgeoning age of trial transparency

BMJ 2016; 355 doi: https://doi.org/10.1136/bmj.i5543 (Published 24 October 2016) Cite this as: BMJ 2016;355:i5543
  1. Peter Doshi, associate editor, The BMJ
  1. pdoshi{at}bmj.com

One group’s efforts to monitor misreporting of outcomes has irritated several medical journals, which argue that the differences discovered are not clinically important. So how seriously should we be taking it? Peter Doshi reports

Glimpses inside SmithKline Beecham’s secret clinical trials programme for the antidepressant paroxetine began in the early 2000s. Amid a growing storm over the safety of selective serotonin reuptake inhibitors for children, a leaked memo revealed by the BBC’s Panorama programme1 depicted a company trying to manage the unfavourable results of two important trials. “It would be commercially unacceptable to include a statement that efficacy had not been demonstrated, as this would undermine the profile of paroxetine,” the memo read. A reviewer for the US Food and Drug Administration considered both trials as “failed.”2

But then there was the public face of the data. One of the two trials–Study 329–was published in the peer reviewed literature.3 The manufacturer told its sales representatives that the “landmark study … demonstrates REMARKABLE efficacy and safety.”4

Study 329 has become a classic example of what is known as outcome reporting bias, in which trial authors selectively present trial results leading, almost inevitably, to a rosier picture than would have occurred had the trial been reported according to the original protocol. The data showed no difference between paroxetine and placebo for all eight of the originally specified outcomes of interest, and an increase in harms.5 6 7 Yet the 2001 trial publication3 reported on four outcomes not specified in the protocol (all of which had statistically significant differences) and concluded that paroxetine was “generally well tolerated and effective.” Put simply, the goalposts set when the trial commenced had moved by the time the trial was reported.

Some may have suspected that Study 329 was an anomaly. …

View Full Text

Log in

Log in through your institution

Subscribe

* For online subscription