Ioannidis’ recent BMJ editorial offers a stark commentary on the parlous state of clinical trial research and touches on a few potential solutions, including clinical trials registration. Clinical trial registration is pivotal to understanding the research landscape, and for ensuring accountability in research. But what do we do when there are protocols in place to ensure public access to information, but the chain of responsibility fails us?
Prospective clinical trial registration can limit the risk of non-publication of completed trials and selective outcome reporting. It is therefore mandated by the International Committee of Medical Journal Editors (ICMJE) Uniform Requirements for Manuscripts as a pre-condition for publication (Laine et al., 2007) .
For prospective registration to work trialists need to take responsibility for registering trials prior to inception, maintaining their registry entries as changes to the trial protocol are made, and ensuring that the contacts listed in their registry applications are available and responsive. However, the chain of accountability cannot end with the trialist; journal editors must play their part by ensuring compliance with the ICMJE registration mandate.
Increasingly, trial registries allow retrospective registration of trials. This shift in practice means that reporting registry identification numbers no longer provides journals with sufficient proof that a trial is registered in accordance with the ICMJE mandates (i.e., prospectively). As such, the onus to confirm that registration timing aligns with the mandate falls on journal editors.
A pilot study conducted at the South African Cochrane Centre, which hosts the Pan African Clinical Trials Registry (www.pactr.org), examined 68 RCTs published in the New England Journal of Medicine (30); Journal of the American Medical Association (8); PlosMed (5); Annals of Internal Medicine (6); and The Lancet (19) between October and December 2011. For three RCTs no trial registry information was available;of the remaining 65 trials, twenty-nine (45%) RCTs were registered prospectively. Of the 36 retrospectively registered RCTs , 21 registered after 1 July 2005 (the ICMJE amnesty deadline for prospective registration), and were therefore published in conflict with the ICMJE mandate. None of the journals reported that these trials were registered retrospectively. In addition, fourteen of 65 (21.6%) RCTs had a discrepancy in reported primary outcomes between published paper and registry. Of those, seven trials were retrospectively registered, three of which started after the 2005 cut-off for mandatory registration.
What are the implications of these findings? Ioannidis reminds us that publication of clinical trials offers journals “opportunities to accrue citations, influence, and reprint orders.” Under these circumstances it is easy to see how commercial interests could receive precedence over the ethical responsibility to ensure openness and transparency in science. However, it is equally plausible that journal editors may simply not be aware of the practice of registries providing trialists with registration numbers retrospectively. Those registries that are members of the World Health Organization’s Network of Registries are required to flag trials that are retrospectively registered. This is not the case with other registries. The onus therefore rests with journal editorial teams to check the registration timing against the trial’s registry profile. If international research governance protocols are to succeed the highest standards of responsibility and accountability are required from all parties involved.
References:
Laine C, De Angelis C, Delamothe T, et al. Clinical trial registration: looking back and moving ahead. Annals of internal medicine. 2007; 147: 275-7.
Competing interests:
Amber Abrams works for the South African Cochrane Centre which manages the Pan African Clinical Trials Registry (www.pactr.org). Amber was the project manager for the PACTR project from 2009 - 2012.
11 March 2015
Amber L Abrams
Senior Scientist/Researcher
Editorial input from Prof. J Volmink and Dr. T Kredo
South African Cochrane Centre at the South African Medical Research Council, University of Kent, University of Cape Town
Rapid Response:
Re: Clinical trials: what a waste
Journal Editors Must Play Their Part
Ioannidis’ recent BMJ editorial offers a stark commentary on the parlous state of clinical trial research and touches on a few potential solutions, including clinical trials registration. Clinical trial registration is pivotal to understanding the research landscape, and for ensuring accountability in research. But what do we do when there are protocols in place to ensure public access to information, but the chain of responsibility fails us?
Prospective clinical trial registration can limit the risk of non-publication of completed trials and selective outcome reporting. It is therefore mandated by the International Committee of Medical Journal Editors (ICMJE) Uniform Requirements for Manuscripts as a pre-condition for publication (Laine et al., 2007) .
For prospective registration to work trialists need to take responsibility for registering trials prior to inception, maintaining their registry entries as changes to the trial protocol are made, and ensuring that the contacts listed in their registry applications are available and responsive. However, the chain of accountability cannot end with the trialist; journal editors must play their part by ensuring compliance with the ICMJE registration mandate.
Increasingly, trial registries allow retrospective registration of trials. This shift in practice means that reporting registry identification numbers no longer provides journals with sufficient proof that a trial is registered in accordance with the ICMJE mandates (i.e., prospectively). As such, the onus to confirm that registration timing aligns with the mandate falls on journal editors.
A pilot study conducted at the South African Cochrane Centre, which hosts the Pan African Clinical Trials Registry (www.pactr.org), examined 68 RCTs published in the New England Journal of Medicine (30); Journal of the American Medical Association (8); PlosMed (5); Annals of Internal Medicine (6); and The Lancet (19) between October and December 2011. For three RCTs no trial registry information was available;of the remaining 65 trials, twenty-nine (45%) RCTs were registered prospectively. Of the 36 retrospectively registered RCTs , 21 registered after 1 July 2005 (the ICMJE amnesty deadline for prospective registration), and were therefore published in conflict with the ICMJE mandate. None of the journals reported that these trials were registered retrospectively. In addition, fourteen of 65 (21.6%) RCTs had a discrepancy in reported primary outcomes between published paper and registry. Of those, seven trials were retrospectively registered, three of which started after the 2005 cut-off for mandatory registration.
What are the implications of these findings? Ioannidis reminds us that publication of clinical trials offers journals “opportunities to accrue citations, influence, and reprint orders.” Under these circumstances it is easy to see how commercial interests could receive precedence over the ethical responsibility to ensure openness and transparency in science. However, it is equally plausible that journal editors may simply not be aware of the practice of registries providing trialists with registration numbers retrospectively. Those registries that are members of the World Health Organization’s Network of Registries are required to flag trials that are retrospectively registered. This is not the case with other registries. The onus therefore rests with journal editorial teams to check the registration timing against the trial’s registry profile. If international research governance protocols are to succeed the highest standards of responsibility and accountability are required from all parties involved.
References:
Laine C, De Angelis C, Delamothe T, et al. Clinical trial registration: looking back and moving ahead. Annals of internal medicine. 2007; 147: 275-7.
Competing interests: Amber Abrams works for the South African Cochrane Centre which manages the Pan African Clinical Trials Registry (www.pactr.org). Amber was the project manager for the PACTR project from 2009 - 2012.