Restoring invisible and abandoned trials: a call for people to publish the findings
BMJ 2013; 346 doi: https://doi.org/10.1136/bmj.f2865 (Published 13 June 2013) Cite this as: BMJ 2013;346:f2865All rapid responses
Rapid responses are electronic comments to the editor. They enable our users to debate issues raised in articles published on bmj.com. A rapid response is first posted online. If you need the URL (web address) of an individual response, simply click on the response headline and copy the URL from the browser window. A proportion of responses will, after editing, be published online and in the print journal as letters, which are indexed in PubMed. Rapid responses are not indexed in PubMed and they are not journal articles. The BMJ reserves the right to remove responses which are being wilfully misrepresented as published articles or when it is brought to our attention that a response spreads misinformation.
From March 2022, the word limit for rapid responses will be 600 words not including references and author details. We will no longer post responses that exceed this limit.
The word limit for letters selected from posted responses remains 300 words.
On 15 July 2013, I signalled intent to work with a team of scientists to republish study 329 of paroxetine in children and adolescents, in accordance with the RIAT guidelines. Shortly afterwards GSK set up a process for researchers to ‘submit research proposals and request anonymised data from clinical studies’. Although they only included studies conducted since 2007, they offered the opportunity to ‘enquire about the availability of data from our clinical studies that are not listed on the site before they submit a research proposal’. I made such a query in relation to study 329 on 4 August. GSK’s website designates the status of my query as ‘under review’. It is not seem plausible that it would take 3 weeks to decide whether data is available.
In the absence of any apparent means to find anything more through the GSK website, I post this rapid response as an open letter to GSK seeking more information.
Competing interests: No competing interests
Dear BMJ Editors:
We believe as a Company that transparency of our clinical trial results and information deriving from our investigational clinical trials contributes to public confidence in medicines while improving public health and scientific knowledge. Increased transparency, in both the reactive and proactive disclosure contexts, must also be balanced with the legally required protection of personal data, intellectual property and confidential information. Appropriate consideration of these issues is important to safeguard our study subjects and patients’ personal information to help further our company’s innovation in research and development of new medicines.
In specific response to the article published in the British Medical Journal on June 13, 2013; it appears that the content found in the article’s Table 1 referencing the AstraZeneca Group’s clinical studies in fact are available in various formats of which a subset is found below:
• AstraZeneca, Quetiapine 015, 1995
o 5077IL/0015 Clinical Study Report Synopsis
o Does cognitive function improve with Quetiapine in comparison to haloperidol? Velligan DI, Newcomer J, Pultz J, Csernansky J, Hoff AL, Mahurin R, Miller AL. Schizophr Res. 2002;53(3):239-248.
• AstraZeneca, Quetiapine 041, 2002
o 5077IL/0041 Clinical Study Report
o The efficacy and tolerability of once-daily extended release quetiapine fumarate in hospitalized patients with acute schizophrenia: a 6-week randomized, double-blind, placebo-controlled study. Lindenmayer JP, Brown D, Liu S, Brecher M, Meulien D. Psychopharmacol Bull. 2008;41(3):11-35.
• AstraZeneca, Quetiapine 049, 2003
o 5077US/0049 Clinical Study Report Synopsis
o A randomized, double-blind, placebo-controlled trial of quetiapine in the treatment of bipolar I or II depression. Calabrese JR, Keck PE Jr, Macfadden W, Minkwitz M, Ketter TA, Weisler RH, Cutler AJ, McCoy R, Wilson E, Mullen J. Am J Psychiatry. 2005 Jul;162(7):1351-60.
• AstraZeneca, Quetiapine 135, 2005
o D1447C00135 Synopsis
o NCT00083954
o Efficacy of quetiapine monotherapy in bipolar I and II depression: A double-blind, placebo-controlled study (The BOLDER II Study).Thase ME, Macfadden W, Weisler RH, Chang W, Paulsson B, Khan A, Calabrese JR; for the BOLDER II Study Group. J Clin Psychopharmacol. 2006; 26(6):600-9. Erratum in: J Clin Psychopharmacol. 2007 Feb; 27(1):51.
• AstraZeneca, Quetiapine 125, 2005
o D1441C00125 Clinical Study Report
o NCT00214578
o A 24-week, multicenter, open-label, randomized study to compare changes in glucose metabolism in patients with schizophrenia receiving treatment with olanzapine, quetiapine and risperidone. Newcomer JW, Ratner RE, Eriksson JW, Emsley R, Meulien D, Miller F, Leonova-Edlund J, Leong RW, Brecher M. J Clin Psychiatry 2009; 70(4): 487-499
• AstraZeneca, Quetiapine 126, 2006
o D9770C00012 Clinical Study Report Synopsis
o Efficacy and safety of quetiapine in combination with lithium or divalproex for maintenance of patients with bipolar I disorder (international trial 126).Vieta E, Suppes T, Eggens I, Persson I, Paulsson B, Brecher M. J Affect Disord. 2008 Aug; 109(3):251-63. Epub 2008 Jun 24.
• AstraZeneca, Quetiapine 127, 2006
o D1447C00127 Clinical Study Report Synopsis
o NCT00081380
o Maintenance treatment for patients with bipolar I disorder: results from a North American study of quetiapine in combination with lithium or divalproex (trial 127) Suppes T, Vieta E, Liu S, Brecher M, Paulsson B; Trial 127 Investigators.. Am J Psychiatry. 2009 Apr;166(4):476-88. Epub 2009 Mar 16.
We have provided the information above for clarity and indicate that each one of the clinical studies as referenced in the British Medical Journal article are outside the legal requirements, and have been published in journals and Clinical Study Report Synopsis which are available on our company owned, publically accessible website.
Sincerely,
James J. Armbrust, Esq., CRCP
Head, Clinical Transparency & Risk Management, Compliance
Please direct all inquiries regarding this matter to:
Kate Farley
kate.farley@astrazeneca.com
+44 (0) 1582 836 360
Jim Minnick
jim.minnick@astrazeneca.com
+1 302 886 5135
Competing interests: Employee of AstraZeneca
Following the publication of the Restoring invisible and abandoned trials (RIAT) paper [1], GlaxoSmithKline (GSK) was notified by the RIAT authors by email on June 14 that study 329 was amongst the studies requiring correction. Study 329 was published in 2001 in the Journal of the American Academy of Child and Adolescent Psychiatry as ‘Efficacy of paroxetine in the treatment of adolescent major depression: a randomized, controlled trial’[2]. This paper seriously misrepresented the outcomes of study 329, as I and others have extensively documented.
GSK was asked to signal intent to publish a corrected version by sending an electronic response to the RIAT article within 30 days. Since they have not declared their intention to restore the record within this timeframe, I write to declare my intent to work with a team of scientists to republish study 329 of paroxetine in children and adolescents, in accordance with the RIAT guidelines. We plan to use the Clinical Study Report available on the GSK website [3], and other documents relating to Study 329 that are publically available through litigation [4] to prepare a report of outcomes for 93 adolescents treated with paroxetine, 95 with imipramine, and 87 with placebo.
1. Doshi P, Dickersin K, Healy D, Vedula SS, Jefferson T. Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ. 2013 Jun 13;346:f2865
2. Keller MB, Ryan ND, Strober M, Klein RG, Kutcher SP, Birmaher B, et al. Efficacy of paroxetine in the treatment of adolescent major depression: a randomized, controlled trial. J Am Acad Child Adolesc Psychiatry 2001;40:762-72.
3. http://www.gsk.com/media/resource-centre/paroxetine/paroxetine-paediatri...
4.http://www.healthyskepticism.org/global/news/int/hsin2010-01
Competing interests: No competing interests
While the impetus (scientific discovery and transparency) for this movement is noble, perhaps if the research community become more cognizant of the human toll of unpublished and abandoned studies we could eliminate a lot of this. Using the grandparent rule (e.g., would you want yours to participate), clinical researchers might give pause to consider whether frivolous or financially-motivated studies are truly in the best interest of subjects. Even simple procedures such as phlebotomy are not without risk, and we all know the potential outcomes related to exposure to xenobiotics. If the data generated will ultimately be filtered by corporate interests, we must ask ourselves if it is really worth it.
Competing interests: No competing interests
Dear Dr Godlee,
I applaud the RIAT concept developed by Doshi, Dickersin, Healy, Vedula and Jefferson (1)
I am a former scientist and information specialist who has carried out mediated literature searches for health professionals and taught information research skills to tertiary health science students and academics. It is clear, and has been for some years, that much of the published medical evidence base, but not all of course, is flawed (only partly because of unavailability of important unpublished clinical trial data) (2). In the light of this fact I believe that all health library professionals need to look to their sense of ethics and question the implications of their literature searching activities.
My main interest in RIAT stems from the well known issue of the massive consumption of antidepressants in many countries, and subsequent harms to many, something which has been debated recently in this journal(3). Therefore, I particularly noted the paper by Erick H. Turner and colleagues cited by Doshi et al (4). It examined the published and unpublished trial data submitted to the US FDA as required for the approval process for various antidepressants. For example, Pfizer’s Zoloft (sertraline) was approved as a treatment for depression in 1991, but of the five relevant clinical trials studied by Turner et al, only two were published and only one of the published trials (5) showed any evidence of a therapeutic effect. The data in the other published trial (6) was considered by the FDA to be negative or doubtful, but was eventually published as if it was positive. I hope that Dr Turner or one of his colleagues will act on RIAT. Interestingly, Doshi et al note that they have unpublished Pfizer sertraline trial documents (from study 206, dated 1983) in their possession. The sertraline studies examined by Turner were numbered 101, 103, 104, 310 and 315, and didn’t include study number 206.
Sincerely,
P. Jane Wilson
1. Doshi P et al Restoring invisible and abandoned trials: a call for people to publish the findings BMJ 2013;346:f2865
2. Scott IA, Glasziou PP. Improving the effectiveness of clinical medicine: the need for better science. Med J Aust. 2012 Mar 19;196(5):304-8
3. Spence D. Are antidepressants overprescribed? Yes. BMJ. 2013 Jan 22;346:f191
4. Turner EH, Matthews AM, Linardatos E, Tell RA, Rosenthal R. Selective publication of antidepressant trials and its influence on apparent efficacy. N Engl J Med. 2008 Jan 17;358(3):252-60.
5. Reimherr FW, Chouinard G, Cohn CK, Cole JO, Itil TM, LaPierre YD, Masco HL, Mendels J. Antidepressant efficacy of sertraline: a double-blind, placebo- and amitriptyline-controlled, multicenter comparison study in outpatients with major depression. J Clin Psychiatry. 1990 Dec;51 Suppl B:18-27.
6. Fabre LF, Abuzzahab FS, Amin M, Claghorn JL, Mendels J, Petrie WM, Dubé S,Small JG. Sertraline safety and efficacy in major depression: a double-blind fixed-dose comparison with placebo. Biol Psychiatry. 1995 Nov 1;38(9):592-602
Competing interests: I am a member of Healthy Skepticism, which aims to reduce harm from misleading health information.
In response to the proposal by Doshi and colleagues for restoring invisible and abandoned trials (RIAT), we wish to register that we are in possession of data sufficient for publication of nine placebo controlled trials of duloxetine for the treatment of major depressive disorder (see attached table for further details). We believe that there are incomplete primary publications for seven of these trials, and no primary publications for two trials.
Competing interests: No competing interests
Dear readers,
On June 19, we received an email from Matthew Cahill, Associate Vice President of Merck Global Scientific and Medical Publications, who pointed out that results from Merck's rofecoxib (Vioxx) study 078, which appears in our list of clinical study reports in our possession (http://www.bmj.com/content/346/bmj.f2865#T1), have been published in the following two articles:
1. Thal LJ, Ferris SH, Kirby L, Block GA, Lines CR, Yuen E, et al. A randomized, double-blind, study of rofecoxib in patients with mild cognitive impairment. Neuropsychopharmacology. 2005 Jun;30(6):1204–15. http://www.ncbi.nlm.nih.gov/pubmed/15742005
2. Aisen PS, Thal LJ, Ferris SH, Assaid C, Nessly ML, Giuliani MJ, et al. Rofecoxib in patients with mild cognitive impairment: further analyses of data from a randomized, double-blind, trial. Curr Alzheimer Res. 2008 Feb;5(1):73–82. http://www.ncbi.nlm.nih.gov/pubmed/18288935
Therefore we would like to alert readers to these two publications.
We are also aware of analyses that indicate the Thal et al. 2005 primary publication of study 078 was misreported and ghostwritten. On misreporting, see Madigan et al [1]. On ghostwriting, see Ross et al. [2].
Please note that Table 1 of our paper is a list of clinical study reports in our possession. While a great number of these studies remain unpublished many years after their completion, and others are documented to be misreported in journal publications, Table 1 is not a definitive list of abandoned studies. Determining abandonment takes time and effort, and we are offering the clinical study reports in our possession to authors committed to restoring abandoned trials to correct the scientific record where necessary.
Sincerely,
Peter Doshi, PhD
Kay Dickersin, MA, PhD
David Healy, MD
Swaroop Vedula, MD, PhD
Tom Jefferson, MD
References:
[1] Madigan D, Sigelman DW, Mayer JW, Furberg CD, Avorn J. Under-reporting of cardiovascular events in the rofecoxib Alzheimer disease studies. American Heart Journal. 2012 Aug;164(2):186–93.
[2] Ross JS, Hill KP, Egilman DS, Krumholz HM. Guest authorship and ghostwriting in publications related to rofecoxib: a case study of industry documents from rofecoxib litigation. JAMA. 2008 Apr 16;299(15):1800–12.
Competing interests: We are authors of the RIAT declaration.
There is very, very much "non-communicable knowledge" (NCK) in the field of health sciences, for example, in the science of salt.
In relation to entropy, sodium intake, sodium/potassium ratio and other ratios, energy expenditure of aerobic and anaerobic sodium-potassium pump, lactic acid, EKG (ECG), EEG, composition of human milk and natural selection
Some of them:
1965
Saulo Klahr and Neal S. Bricker
Energetics of Anaerobic Sodium Transport by the Fresh Water Turtle Bladder
J Gen Physiol. 1965 March 1; 48(4): 571–580
1985
Henningsen N.C.:
The sodium pump and energy regulation: some new aspects for essential hypertension, diabetes II and severe overweight.
Klinische Wochenschrift 63 Suppl 3:4-8. 1985.
1991
Maiken Nedergaard, Steven A. Goldman, Smita Desai, and William A. Pulsinelli
Acid-induced death in neurons and glia
The Journal of Neuroscience, August 1991, 11(8): 2489-2497
1998
Sandor Z.
Equivalency law in the metal requirement of the living organisms.
Acta Alimentaria 27 (4): 389-395. 1998.
2005
Yamawaki N, Yamada M, Kan-no T, Kojima T, Kaneko T, Yonekubo A.:
Macronutrient, mineral and trace element composition of breast milk from Japanese women.
J Trace Elem Med Biol. 2005; 19(2-3): 171-81.
2001
Toshimasa Osaka, Akiko Kobayashi, and Shuji Inoue
Thermogenesis induced by osmotic stimulation of the intestines in the rat
J Physiol. 2001 April 1; 532(Pt 1): 261–269.
(Nothing about Na/K pump, anaerobic glycolysis and lactic acid)
2010
Ram K. Mathur
Role of diabetes, hypertension, and cigarette smoking on atherosclerosis
J Cardiovasc Dis Res. 2010 Apr-Jun; 1(2): 64–68.
("The mechanism of thermogenesis is not clear. .. That is why we have not made any
progress even though we have worked on it for more than 50 years.")
etc., etc....
The scientific elite shows astonishing irresponsibility! Forgotten and/or ignored or not understood articles, works, facts, evidence and wrong education, etc. The blind watchmaker first learned physics well, then chemistry. And only then dealt with biochemistry. But he never forgot what he had already learned.
More references (and NCK) with links:
http://padre.uw.hu/ekvis/entropyobesity.htm
Competing interests: No competing interests
I agree that we should publish more data. It would be ideal if data were published as *Linked Data*. If I might, what are some current best practices for sharing data?
CKAN, “an open-source DMS (data management system) for powering data hubs and data portals”, is widely implemented with a GNU AGPL license. CKAN "powers the thedatahub.org, catalog.data.gov and data.gov.uk among many other sites."
Schema.org defines an ontology of search-engine compatible HTML tags and RDF/OWL schema. Schema.org / docs / meddocs.html (MedicalEntity) defines ontology terms for medicine and healthcare that [are compatible with] "existing controlled medical vocabularies (such as MeSH, SNOMED, ICD, RxNorm, UMLS, etc)".
There are a number of tools for producing Linked Data listed at schema.rdfs.org / tools.html
Schema.org is licensed with CC BY-SA 3.0.
Competing interests: No competing interests
Re: Restoring invisible and abandoned trials: a call for people to publish the findings
Following the publication of the Restoring invisible and abandoned trials (RIAT) paper [1], we notified 4 members of the Bendectin Peer Group on 8 August 2013 that we intend to publish the results of the unpublished 1970s study on the efficacy of doxylamine and pyridoxine (“8-way” Bendectin Study). As of 25 September 2013, 3 did not respond to our letter and 1 responded but did not register an intent to publish the trial. We are now publicly declaring our intention to publish the findings of this clinical trial.
Reference
1. Doshi P, Dickersin K, Healy D, Vedula SS, Jefferson T. Restoring invisible and abandoned trials: a call for people to publish the findings. BMJ. 2013 Jun 13;346:f2865 2.
Competing interests: No competing interests