BMJ 1999;319:865-866 ( 2 October )

Editorials

Time to register randomised trials

The case is now unanswerable

The case for registering all clinical trials---first advanced a decade ago1---is now unanswerable. The public has the right to know what research is being funded. Researchers and research funders don't want to waste resources repeating trials already under way. And those conducting systematic reviews need to be able to identify all trials begun on a subject to avoid the problem of publication bias. Otherwise, clinicians may be deceived on what the evidence shows. Next week the Lancet, the Association of the British Pharmaceutical Industry, and the BMJ Publishing Group will hold a joint conference to promote the registering of trials.

Each year a vast financial investment is made by national funding agencies, medical research charities, and drug and device manufacturers in randomised controlled trials. Unfortunately the process is chaotic and takes little account of concurrent research. Several case studies have shown how the manipulation of trial data can provide a seriously misleading picture of an intervention's effectiveness. In a systematic review of trials using ondansetron to treat postoperative nausea and vomiting Tramer et al2 found that "a false impression of ondansetron's efficacy may arise because a quarter of all relevant published reports are duplicates." Huston and Moher found it almost impossible to complete a systematic review of risperidone's efficacy in schizophrenia for the same reason.3 These studies show that we have to find better ways of identifying and tracking clinical trials.

The history of this effort shows much good intention but only limited progress. One attempt to link research to practice in the setting of an entire health service began in the United Kingdom in 1991 with the launch of the NHS research and development initiative.4 That programme placed the systematic collection of data from randomised trials at its intellectual centre. The Cochrane Collaboration has been its most important and successful partner and has focused its work on published clinical trials. But this leaves untackled the large amount of unpublished trials.5 Chalmers famously described this underreporting of research as scientific misconduct,6 and publication bias remains a pervasive problem. The medical editors' trials amnesty tried to flush out that evidence, with only partial success.7

Rather than treat the problem of hidden research retrospectively, a more sensible approach might be to prevent it.1 Based on their original investigations of publication bias, Dickersin and Min have argued that one "possibility is to require registration of all clinical trials prior to initiation. While this is widely agreed to be a good approach, widespread registration has not yet been effected....Who will take the lead?"8

Apart from the NHS national research register and the Cochrane controlled trials register, the most significant recent lead has been taken by the pharmaceutical industry. For example, Schering Health Care and GlaxoWellcome have committed themselves to registering information about their own trials. Richard Sykes (chairman of GlaxoWellcome) argued that he and his colleagues understood "the value of information, and we want to create a climate of openness where the evidence for prescribing our products is clear."9 Not all in the pharmaceutical sector agree, and Sykes has been ridiculed by some who see his step as opening up a window of vulnerability in GlaxoWellcome's commercial armour. But how can this be so when all that GlaxoWellcome is doing is releasing administrative information about continuing work (objective of the trial, end points, numbers, groups, and expected data of closure), not the actual data?

Editors also have a part to play. During peer review, editors increasingly find themselves requesting copies of the original trial protocol to check against the final submitted report. That "protocol culture" has led one of us to begin (and the other to plan) a protocol registration scheme.10 Editors are unwilling to fill their journals with promises of what might be, but they can publish these protocols on their web sites, perhaps linking them to a central registry.

Publishers could also help this process by collaborating with one another to construct such a free online database. The lead here has been taken by Current Science, which launched a metaregister of randomised controlled trials in October 1998. Trials depend on patient participation and are often funded with public money. Publishers make money from reprints of clinical trials, so it is reasonable to expect them to contribute to an initiative from which they ultimately benefit. A valuable partner might be PubMed Central, a project launched by director of the National Institutes of Health to create a free electronic archive of biomedical research.11

The pressure to register trials will rise when research ethics committees, medical research charities, and drug and device manufacturers start to encourage trialists to register, especially since the responsibility for not publishing trial results seems to rest more with investigators than editors.8 A further challenge is to devise an internationally agreed method for assigning each trial a unique identifier. One such scheme is being piloted in cancer, with the help of the Cochrane cancer network.

Taken together, these efforts might bring shape to a presently formless clinical research enterprise. Such a structure should help to deliver high quality evidence to the clinical setting.

Richard Horton, editor, Lancet
Richard Smith, editor

BMJ

Footnotes

   A version of this editorial also appears in the Lancet this week.12



1. Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 1986; 4: 1529-1541[Abstract/Free Full Text].
2. Tramer MR, Moore RA, Reynolds JM, McQuay HJ. A quantitative systematic review of ondansetron in treatment of established postoperative nausea and vomiting. BMJ 1997; 314: 1088-1092[Abstract/Free Full Text].
3. Huston P, Moher D. Redundancy, disaggregation, and the integrity of medical research. Lancet 1996; 347: 1024-1026[Medline].
4. Peckham M. Research and development for the National Health Service. Lancet 1991; 338: 367-371[Medline].
5. Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR. Publication bias in clinical research. Lancet 1991; 337: 867-872[Medline].
6. Chalmers I. Underreporting research is scientific misconduct. JAMA 1990; 263: 1405-1408[Abstract].
7. Roberts I. An amnesty for unpublished trials. BMJ 1998; 317: 763-764[Free Full Text].
8. Dickersin K, Min Y-I. Publication bias: the problem that won't go away. In: Warren KS, Mosteller F., eds. Doing more good than harm: the evaluation of health care interventions. New York: New York Academy of Sciences, 1993.
9. Sykes R. Being a modern pharmaceutical company. BMJ 1998; 317: 1172[Free Full Text].
10. McNamee D. Protocol reviews at The Lancet. Lancet 1997; 350: 6.
11. Marshall E. NIH's online publishing venture ready for launch. Science 1999; 285: 1466.
12. Horton R, Smith R. Time to register randomised trials. Lancet 1999; 354: 1138-1139[Medline].


© BMJ 1999

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Related Articles

Fate of biomedical research protocols and publication bias in France: retrospective cohort study
Evelyne Decullier, Véronique Lhéritier, and François Chapuis
BMJ 2005 331: 19. [Abstract] [Full Text] [PDF]

Registering clinical trials
Maurizio Bonati, Piero Impicciatore, Chiara Pandolfini, Giovanna Scroccaro, Francesca Venturini, Chiara Alberti, Maria Paola Alberti, and Fabio Caliumi
BMJ 2000 320: 1339. [Extract] [Full Text]

Registering trials is not enough to counter perceived irrelevance of much research
Selwyn St Leger
BMJ 2000 320: 443. [Extract] [Full Text]

This article has been cited by other articles:

  • Santoro, E., Rossi, V., Pandolfini, C., Bonati, M. (2006). DEC-net: the development of the European register of clinical trials on medicines for children. Clin Trials 3: 366-375 [Abstract]  
  • Decullier, E., Lheritier, V., Chapuis, F. (2005). Fate of biomedical research protocols and publication bias in France: retrospective cohort study. BMJ 331: 19- [Abstract] [Full text]  
  • Dickersin, K., Davis, B. R, Dixon, D. O, George, S. L, Hawkins, B. S, Lachin, J., Peduzzig, P., Pocock, S. (2004). The Society for Clinical Trials supports United States legislation mandating trials registration. Clin Trials 1: 417-420 [Abstract]  
  • Abbasi, K. (2004). Compulsory registration of clinical trials. BMJ 329: 637-638 [Full text]  
  • Dickersin, K., Rennie, D. (2003). Registering Clinical Trials. JAMA 290: 516-523 [Abstract] [Full text]  
  • Lexchin, J., Bero, L. A, Djulbegovic, B., Clark, O. (2003). Pharmaceutical industry sponsorship and research outcome and quality: systematic review. BMJ 326: 1167-1170 [Abstract] [Full text]  
  • Tonks, A. (2002). A clinical trials register for Europe. BMJ 325: 1314-1315 [Full text]  
  • Spence, D. (2002). Interpreting the evidence. BMJ 325: 587-587 [Full text]  
  • Manheimer, E., Anderson, D. (2002). Survey of public information about ongoing clinical trials funded by industry: evaluation of completeness and accessibility. BMJ 325: 528-531 [Abstract] [Full text]  
  • DeMets, D. L., Califf, R. M. (2002). Lessons Learned From Recent Cardiovascular Clinical Trials: Part II. Circulation 106: 880-886 [Full text]  
  • Halpern, S. D., Karlawish, J. H. T., Berlin, J. A. (2002). The Continuing Unethical Conduct of Underpowered Clinical Trials. JAMA 288: 358-362 [Abstract] [Full text]  
  • McCray, A. T. (2000). Better Access to Information about Clinical Trials. ANN INTERN MED 133: 609-614 [Abstract] [Full text]  
  • Sutton, A. J, Song, F., Gilbody, S. M, Abrams, K. R (2000). Modelling publication bias in meta-analysis: a review. Stat Methods Med Res 9: 421-445 [Abstract]  
  • Fay, M., Buckner, Z., Symon, B., Marley, J., Martin, J., Wolke, D., Wiggs, L., Stores, G., Ramchandani, P., Webb, V. (2000). Treating children with sleep disorders. BMJ 320: 1667-1667 [Full text]  
  • Bernhardt, H., Panzer, H., Schneider, L. S., Wager, E., Tumas, J. A., Field, E. A., Glazer, N. B., Schulz, G., Grossman, L., Johansen, H. K., Gotzsche, P. C., Rennie, D. (2000). Improving the Conduct and Reporting of Clinical Trials. JAMA 283: 2787-2790 [Full text]  
  • Bonati, M., Impicciatore, P., Pandolfini, C., Scroccaro, G., Venturini, F., Alberti, C., Alberti, M. P., Caliumi, F. (2000). Registering clinical trials. BMJ 320: 1339-1339 [Full text]  
  • Leger, S. S. (2000). Registering trials is not enough to counter perceived irrelevance of much research. BMJ 320: 443a-443 [Full text]  
  • Hailey, D. (2000). Scientific harassment by pharmaceutical companies: time to stop. CMAJ 162: 212-213 [Full text]  
  • Delamothe, T., Smith, R., Keller, M. A, Sack, J., Witscher, B. (1999). Netprints: the next phase in the evolution of biomedical publishing. BMJ 319: 1515-1516 [Full text]  
  • Tonks, A. (1999). Registering clinical trials. BMJ 319: 1565-1568 [Full text]  

Rapid Responses:

Read all Rapid Responses

Registration of Trials - The system is already there!
Terence W Wiseman
bmj.com, 4 Oct 1999 [Full text]
Why the secrecy? Publish all research protocols.
Brian Morgan
bmj.com, 5 Oct 1999 [Full text]
The difficulties in obtaining copies of research protocols
Penny Mellor
bmj.com, 5 Oct 1999 [Full text]
Time to register randomised trials
Selwyn St Leger
bmj.com, 6 Oct 1999 [Full text]
A good idea that doesn''t go far enough
Adam Jacobs
bmj.com, 8 Oct 1999 [Full text]



Student BMJ

Risk of surgery for inflammatory bowel disease: record linkage studies

What can you learn from this BMJ paper? Read Leanne Tite's Paper+

www.student.bmj.com

Listen to the latest BMJ Interview