BMJ 1998;317:1181-1184 ( 31 October )

Papers

Content and quality of 2000 controlled trials in schizophrenia over 50 years

Ben Thornley, research assistant,  Clive Adams, coordinating editor. 

Cochrane Schizophrenia Group, Summertown Pavilion, Oxford OX2 7LG

Correspondence to: Dr Adams clive.adams{at}psych.ox.ac.uk


    Abstract
Top
Abstract
Introduction
Methods
Results
Discussion
References

Objective To provide a comprehensive survey of the content and quality of intervention studies relevant to the treatment of schizophrenia.
Design Data were extracted from 2000 trials on the Cochrane Schizophrenia Group's register.
Main outcome measures Type and date of publication, country of origin, language, size of study, treatment setting, participant group, interventions, outcomes, and quality of study.
Results Hospital based drug trials undertaken in the United States were dominant in the sample (54%). Generally, studies were short (54%<6 weeks), small (mean number of patients 65), and poorly reported (64% had a quality score of =<2 (maximum score 5)). Over 600 different interventions were studied in these trials, and 640 different rating scales were used to measure outcome.
Conclusions Half a century of studies of limited quality, duration, and clinical utility leave much scope for well planned, conducted, and reported trials. The drug regulatory authorities should stipulate that the results of both explanatory and pragmatic trials are necessary before a compound is given a licence for everyday use.

Key messages

  • The advent of randomised controlled trials coincided with many new drug treatments for schizophrenia

  • This survey of 2000 randomised controlled trials of treatment for schizophrenia found that the reporting of key aspects of trial methods could easily be improved

  • The consistently poor quality of reporting is likely to have resulted in an overoptimistic estimation of the effects of treatments

  • Large studies, of long duration, investigating outcomes of importance to clinicians and patients are needed


    Introduction
Top
Abstract
Introduction
Methods
Results
Discussion
References

The advent of randomised controlled trials coincided with a revolution in the care of people with schizophrenia. Drug treatments were developed that dramatically improved the mental state of those for whom little hope had previously existed.1 Psychiatrists welcomed the randomised trial, and a tradition of evaluative research was strengthened.

The creation of registers of randomised controlled trials, such as that developed by the Cochrane Schizophrenia Group,2 affords an opportunity to assess the quality and content of evaluative research in well defined sampling frames. There are now many examples of such surveys in specific journals,3-5 including the pilot study for this work,6 but research into the quality and content of trials in specific healthcare specialties is less common. We focused on the care of patients with schizophrenia or other non-affective psychoses to replicate and expand work in other specialties.7-11

    Methods
Top
Abstract
Introduction
Methods
Results
Discussion
References

Inclusion criteria--- Every report of the first 2000 trials on the Cochrane Schizophrenia Group's register was eligible. The register contains reports of published and unpublished randomised controlled trials and controlled clinical trials (parallel group comparative studies in which allocation of treatment is not explicitly stated to be random). These studies relate to the care of those with schizophrenia and other non-affective psychoses.

Identification and selection of studies--- Key journals were identified and hand searched from 1948 to December 1997. Conference proceedings were also hand searched. We comprehensively searched

Biological Abstracts (1982-96), CINAHL (1980-96), the Cochrane Library (issue 3, 1997), Embase (1980-96), LILACS (1980-96), Psyc/Lit (1974-96), PSYNDEX (1980-95), Medline (1966-96), and Sociofile (1985-96).12 The resulting 30 000 electronic records were checked for duplicates before we highlighted studies that were possibly relevant. We obtained 6000 full copies, which were added to the register if they met the inclusion criteria as outlined above. The final sample was 3181 publications (around 2500 trials). Time constraints forced us to survey so the first 2000 trials (reported in 2275 publications).

Extraction and analysis of data--- We recorded the type and date of publication, country of origin, and language of each study. We used a measure of methodological quality based on each trial's description of randomisation, blinding, and withdrawal from treatment.13 The maximum score was 5, for which the report had to have given appropriate methods of generating random assignment, appropriate blinding of participants and raters, and details on those who withdrew from the trial before its conclusion. This measure was chosen for its validity13 and ease of use and because low scores, indicating poor quality of reporting, are associated with an increased estimate of benefit.14 It does not specifically rate concealment of allocation, which is also related to trial outcome.15 We also recorded the size of the study, treatment setting, participants, interventions, and outcomes, and all data were stored in spreadsheets. BT coded most of the reports. CA recoded a 10% sample to test and ensure reliability. Data were analysed with Microsoft Excel.

    Results
Top
Abstract
Introduction
Methods
Results
Discussion
References

Coding of variables was reliable. There was over 90% agreement in all but the numbers completing the study (70%) and listing of outcome instruments; in about 10% of reports the principal rater (BT) failed to identify one of the scales, often among several used.

                              
View this table:
[in this window]
[in a new window]
 

Table 1. Interventions investigated in 2000 controlled trials of schizophrenia treatment

Over 95% (1954) of the 2000 trials were in people with schizophrenia, serious or chronic mental illness, psychosis, or movement disorders. Most of the 2275 reports were fully published in journals (1940, 85%), while the remainder were presented at conferences (253, 11%) or published as letters, in books, as chapters in books, or as product monographs (82, 4%). The BMJ and Lancet publish a few more schizophrenia trials than JAMA and the New England Journal of Medicine (21, 33, 6, 2 respectively), but all these widely read journals were limited sources of trials on this most serious, costly illness. Most trials were published in general psychiatric journals.

The number of trials relevant to schizophrenia rose steadily with time, from about 20 per year in the 1950s and 1960s to an average of nearly 75 per year in the past decade (beta =1.9, r2=0.59, P<0.001, where beta  is the estimated yearly change and r2 the yearly data explained by a linear trend).

Most (2214, 97%) of the reports were published in English. Most (1238, 54%) were from North America, with 37% (849) from Europe and 8% (188) from the rest of the world. Trial output from North America increased at a faster rate than that from Europe and the rest of the world (0.9, 0.7, and 0.3 extra trials per year respectively).

The quality of reporting was poor. Only 4% (80) of the trials clearly described the methods of allocation. Explicit descriptions of blinding were adequate in only 22% (440) of trials, while some description of treatment withdrawals was given in 42% (840). One per cent (20) of the 2000 trials achieved a maximum quality score of 5. Just under two thirds (1280) scored 2 or less, which means that they barely, if at all, described any attempt to reduce the potential for introduction of bias at allocation or rating of outcome, placebo effects, or the fate of all participants. A score of 3 or more was predefined as better quality. Just 33% (354/1062) of North American trials achieved this, compared with 36% (262/724) of European trials and 43% (77/180) of those from the rest of the world (chi 2=9.23, P<0.01). Studies from Canada (n=103) and a combined group of the Middle East and Asia (n=109) were particularly well reported (98, 46% scoring 3 or higher). We found little evidence that the quality of trial reporting improved with time. From 1950 to 1997 the mean quality score was consistently under 2.5.

The average number of trial participants was 65, with no discernible change over time (beta =0.2, r2=0.7, P=0.4). Only 20 trials (1%) raised the issue of the statistical power of the study. The average size of schizophrenia trials was small. For an outcome such as clinically important improvement in mental state to show a 20% difference between groups a study would have to have 150 participants in each arm (alpha =0.05, power 85%). Only 3% (60) of studies were of this size or greater. More than 50% of trials had 50 or fewer participants (figure).


View larger version (24K):
[in this window]
[in a new window]
  		Size of trials (n=1941; 59 studies did not report study size)

On average, just under 12% of participants left the studies early, although the trend was towards increasing loss to follow up (beta =0.01, r2=0.6, P<0.001). Over half of the trials lasted six weeks or less (1082, 54%), and less than one fifth allowed more than six months to evaluate the treatments (382, 19%).

Only 272 (14%) of the total sample of trials were clearly community based, but the proportion increased (beta =0.1, r2=0.92, P<0.01). Even in the 1990s, however, the proportion was still small (23%, 135/587).

Interventions were classed as drug treatment, psychotherapy (any treatment based on talking), physical treatment (electroconvulsive therapy, psychosurgery), policy or care packages (case management, team treatment), and other (table 1). Overall, 1725 (86%) of the 2000 trials evaluated the effects of 437 different drugs. Haloperidol was an increasingly frequent comparator (beta =0.5, r2=0.6, P<0.001). Overall, the proportion of drug trials declined somewhat over time (beta =-0.002, r2=0.5, P=0.03), with studies of psychotherapy and policy or care packages increasing.

In all, 510 (25%) studies did not use rating scales to measure outcomes. The remaining 1490 trials used 640 different instruments. These were broadly classified; table 2 lists the most popular. Overall, 369 scales were used only once. Most trials used between one and five instruments, but greater numbers were not uncommon, with one trial using 17 different outcome scales.

                              
View this table:
[in this window]
[in a new window]
 

Table 2. Outcome instruments used in 2000 controlled trials of schizophrenia treatment



    Discussion
Top
Abstract
Introduction
Methods
Results
Discussion
References

Sampling biases
Our sample of 2000 trials is likely to be biased in some respects. The searching was largely, but not exclusively, in English, and our ability to code articles in languages other than English was limited. An undiscovered body of large, high quality trials published in languages other than English is unlikely as researchers everywhere are conscious that the common language of the scientific community is English. The first 2000 trials on the Cochrane Schizophrenia Group's register were a subsample of around 2500 eventually identified by the search. High availability of a report would probably have increased the chance of early entry on to the register and so of being within the survey sample. However, this potential selection bias would have been offset by our limited efficiency. The register was compiled over two years, so we had a mixture of easily acquired reports and those that had been difficult to find. The study sample, however, may well incorporate less selection biases than the trials readily available through Medline and is representative of those on the Cochrane controlled trials register, the most comprehensive source of randomised controlled trials and controlled clinical trials.16

The profile of trials
Most schizophrenia trials are undertaken in North America. The United States, in particular, has a strong tradition of evaluative research in randomised controlled trials, but only 2% of the world's population of people with schizophrenia live in North America. How applicable the findings of these trials are to the 43 million other patients in Africa, Australasia, and Europe is difficult to assess. Further problems with generalisability arise from the fact that most participants in trials were people in hospital, even in the 1990s.

The quality of reporting in this large sample of trials was poor and showed no sign of improvement over time. As low quality scores are associated with an increased estimate of benefit,14 schizophrenia trials may well have consistently overestimated the effects of experimental interventions. We hope that this will change with wider adoption of the CONSORT recommendations.17 However, although quality of reporting has been a proxy measure of methodological quality of a trial, 14 15 18 cosmetic adherence to CONSORT requirements might mask low grade studies.

Drug treatments are the bulwark of treatment of schizophrenia, so it is not surprising that drug trials dominate the sample. Most important drug trials in recent years (mostly of the new atypical generation of antipsychotic drugs, such as risperidone and olanzapine) use haloperidol as the control. This drug is likely to give obvious side effects that render successful blinding difficult, if not impossible, probably making the outcomes used more vulnerable to bias. In addition, because haloperidol is also a potent cause of adverse effects, most drugs to which it is compared will have favourable side effect profiles. Therefore, so long as the new experimental drug has moderate antipsychotic properties, favourable outcomes can be expected. Comparisons with other old, but less toxic, antipsychotic drugs, such as medium doses of thioridazine or sulpiride, are rare.

The lack of statistical power was reflected in the use of an extraordinary number of rating scales. It is often possible to achieve significance on these fine measures with small numbers. These devices by researchers leave unaddressed the clinical interpretation of these measures and the fact that scales are rarely used in clinical practice. To complicate matters further scales, and subscales, were often used at frequent intervals within the trial. The sheer quantity of data testing will then result in misleading, significant findings appearing by chance. The use of scales in schizophrenia trials is the focus of ongoing work. Further difficulties with using the evidence generated by this mass of research are that the studies are of limited duration for an illness that often lasts decades.

Room for improvement
The findings of this survey are as bad, if not worse, as those for other disciplines of health care. 8-11 14 15 Certainly, there is a long way to go before all interventions for patients with schizophrenia have been adequately evaluated and systematically reviewed and some of the enduring questions about the efficacy of treatment are answered. There is great scope for well conceived, conducted, and reported trials. The use of haloperidol as a control and rating scales of little clinical utility may well be fostered by the stipulations of various drug regulatory bodies. It should not be beyond the ability of a well motivated pharmaceutical industry to negotiate with these bodies to ensure that both explanatory and pragmatic studies19 are required for licensing.

    Acknowledgments

We thank Iain Chalmers, Helen Philpott, and Leanne Roberts for help with the manuscript; Jon Deeks for statistical advice; the ever-patient librarians of the Warneford Hospital, Doreen Ledgard, Marie Montague, Sarah Old, and Libby Taylor; Pam Bachelor, Mark Fenton, Claire Joy, Rachel Lee, and Rochelle Seifas for their work on the register; and the medical students of the Warneford search parties. Contributors: BT discussed core ideas, helped formulate electronic searches, managed the register of trials, undertook the bulk of the data collection and analysis, and helped interpret the data and write the paper. CA initiated the project, discussed core ideas, designed the protocol, formulated and coordinated electronic and hand searches, participated in and supervised data collection and analysis, and took the lead in interpreting and writing the paper. CA is guarantor for this work.

Funding: This work was made possible by a Medical Research Council grant (G9503134) and a small donation from Janssen-Cilag UK.

Competing interests: None declared.

    References
Top
Abstract
Introduction
Methods
Results
Discussion
References

  1. Freeman H. The tranquilizing drugs. In: Bellek L, ed. Schizophrenia: a review of the syndrome. New York: Logos, 1958:473-500.
  2. Adams CE, Duggan L, Whalbeck K, White P. The Cochrane Schizophrenia Group. Schizophr Res (in press).
  3. Fahey T, Hyde C, Milne R, Thorogood M. The type and quality of randomized controlled trials (RCTs) published in UK public health journals. J Public Health Med 1995; 17: 469-474[Abstract/Free Full Text].
  4. Lent V, Langenbach A. A retrospective quality analysis of 102 randomized trials in four leading urological journals from 1984-1989. Urol Res 1996; 24: 119-122[Medline].
  5. Silagy CA. Developing a register of randomised controlled trials in primary care. BMJ 1993; 306: 897-900.
  6. Ahmed I, Soares KVS, Seifas R, Adams CE. Randomized controlled trials in Archives of General Psychiatry (1959-1995): a prevalence study. Arch Gen Psychiatry 1998; 55: 754-755[Free Full Text].
  7. Chalmers I. A register of controlled trials in perinatal medicine. WHO Chron 1986; 40: 61-65[Medline].
  8. Chalmers I, Hetherington J, Newdick M, Mutch L, Grant A, Enkin M, et al. The Oxford Database of Perinatal Trials: developing a register of published reports of controlled trials. Control Clin Trials 1986; 7: 306-324[Medline].
  9. Cheng K, Ashby D, O'Hea U, Smyth R. The epidemiology of randomised controlled trials in cystic fibrosis. Israel J Med Sci 1996; 32: S260.
  10. Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A. Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA 1989; 262: 2101-2107[Abstract].
  11. Vandekerckhove P, O'Donovan PA, Lilford RJ, Harada TW. Infertility treatment: from cookery to science. The epidemiology of randomised controlled trials. Br J Obstet Gynaecol 1993; 100: 1005-1036[Medline].
  12. Adams CE, Duggan L, Roberts L, Wahlbeck K, White P. The schizophrenia module. Cochrane Library [database on disk and CD ROM]. Cochrane Collaboration; 1997, Issue 1. Oxford: Update Software , 1997Updated quarterly.
  13. Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials 1996; 17: 1-12[Medline].
  14. Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet 1998; 352: 609-613[Medline].
  15. Schulz KF, Chalmers I, Altman DG, Grimes DA, Dore CJ. The methodologic quality of randomization as assessed from reports of trials in specialist and general medical journals. Online J Curr Clin Trials 1995;Doc No 197:[81 paragraphs].
  16. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA 1996; 276: 637-639[Medline].
  17. Chalmers TC, Celano P, Sacks HS, Smith Jr H. Bias in treatment assignment in controlled clinical trials. N Engl J Med 1983; 309: 1358-1361[Abstract].
  18. Cochrane Controlled Trials Register. The Cochrane Library [database on disk and CD ROM]. Cochrane Collaboration. Oxford: Update Software , 1996(Updated quarterly.)
  19. Roland M, Torgerson DJ. What are pragmatic trials? BMJ 1998; 316: 285[Free Full Text].

(Accepted 29 September 1998)

© BMJ 1998
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Articles

How can we regulate medicines better?
Silvio Garattini and Vittorio Bertele'
BMJ 2007 335: 803-805. [Extract] [Full Text] [PDF]

Effectiveness of antipsychotic treatments in a nationwide cohort of patients in community care after first hospitalisation due to schizophrenia and schizoaffective disorder: observational follow-up study
Jari Tiihonen, Kristian Walhbeck, Jouko Lönnqvist, Timo Klaukka, John P A Ioannidis, Jan Volavka, and Jari Haukka
BMJ 2006 333: 224. [Abstract] [Full Text] [PDF]

Trial protocols: time for more than tinkering
James Penston
BMJ 2005 330: 421. [Extract] [Full Text]

Practical problems in recruiting patients with schizophrenia into randomised controlled trials
Helen Lester and Sue Wilson
BMJ 1999 318: 1075. [Extract] [Full Text]

Fifty years of randomised controlled trials
BMJ 1998 317: 0. [Full Text] [PDF]

Two thousand schizophrenia trials, 1948-97---and still much room for improvement
BMJ 1998 317: 0. [Full Text]

This article has been cited by other articles:

  • Bollini, P., Pampallona, S., Nieddu, S., Bianco, M., Tibaldi, G., Munizza, C. (2008). Indicators of Conformance With Guidelines of Schizophrenia Treatment in Mental Health Services. Psychiatr. Serv. 59: 782-791 [Abstract] [Full text]  
  • Mohamed, S., Rosenheck, R., McEvoy, J., Swartz, M., Stroup, S., Lieberman, J. A. (2008). Cross-sectional and Longitudinal Relationships Between Insight and Attitudes Toward Medication and Clinical Outcomes in Chronic Schizophrenia. Schizophr Bull 0: sbn067v1-sbn067 [Abstract] [Full text]  
  • Wykes, T., Steel, C., Everitt, B., Tarrier, N. (2008). Cognitive Behavior Therapy for Schizophrenia: Effect Sizes, Clinical Models, and Methodological Rigor. Schizophr Bull 34: 523-537 [Abstract] [Full text]  
  • Leucht, S., Heres, S., Hamann, J., Kane, J. M. (2008). Methodological Issues in Current Antipsychotic Drug Trials. Schizophr Bull 34: 275-285 [Abstract] [Full text]  
  • Adams, C. E., Coutinho, E. S. F., Davis, J., Duggan, L., Leucht, S., Li, C., Tharyan, P. (2008). Cochrane Schizophrenia Group. Schizophr Bull 34: 259-265 [Full text]  
  • Calton, T., Ferriter, M., Huband, N., Spandler, H. (2008). A Systematic Review of the Soteria Paradigm for the Treatment of People Diagnosed With Schizophrenia. Schizophr Bull 34: 181-192 [Abstract] [Full text]  
  • Garattini, S., Bertele', V. (2007). How can we regulate medicines better?. BMJ 335: 803-805 [Full text]  
  • Lawlor, D. A (2007). Quality in epidemiological research: should we be submitting papers before we have the results and submitting more hypothesis-generating research?. Int J Epidemiol 36: 940-943 [Full text]  
  • Gravel, J., Opatrny, L., Shapiro, S. (2007). The intention-to-treat approach in randomized controlled trials: Are authors saying what they do and doing what they say?. Clin Trials 4: 350-356 [Abstract]  
  • Hodgson, R., Bushe, C., Hunter, R. (2007). Measurement of long-term outcomes in observational and randomised controlled trials. Br. J. Psychiatry 191: s78-s84 [Abstract] [Full text]  
  • Tiihonen, J., Walhbeck, K., Lonnqvist, J., Klaukka, T., Ioannidis, J. P A, Volavka, J., Haukka, J. (2006). Effectiveness of antipsychotic treatments in a nationwide cohort of patients in community care after first hospitalisation due to schizophrenia and schizoaffective disorder: observational follow-up study. BMJ 333: 224- [Abstract] [Full text]  
  • Geddes, J. (2006). Meta-analysis in the assessment of treatment outcome.. J Psychopharmacol 20: 67-71 [Abstract]  
  • Burns, T., THE UK SCHIZOPHRENIA CARE AND ASSESSMENT PROGRAMME, (2006). NICE guidance in schizophrenia: how generalisable are drug trials?. Psychiatr. Bull. 30: 210-212 [Abstract] [Full text]  
  • Heres, S., Davis, J., Maino, K., Jetzinger, E., Kissling, W., Leucht, S. (2006). Why Olanzapine Beats Risperidone, Risperidone Beats Quetiapine, and Quetiapine Beats Olanzapine: An Exploratory Analysis of Head-to-Head Comparison Studies of Second-Generation Antipsychotics. Am. J. Psychiatry 163: 185-194 [Abstract] [Full text]  
  • Williamson, P R, Gamble, C, Altman, D G, Hutton, J L (2005). Outcome selection bias in meta-analysis. Stat Methods Med Res 14: 515-524 [Abstract]  
  • Contopoulos-Ioannidis, D. G., Gilbody, S. M., Trikalinos, T. A., Churchill, R., Wahlbeck, K., Ioannidis, J. P.A., The EU-PSI Project, (2005). Comparison of Large Versus Smaller Randomized Trials for Mental Health-Related Interventions. Am. J. Psychiatry 162: 578-584 [Abstract] [Full text]  
  • Cure, S., Chua, W. L., Duggan, L., Adams, C. (2005). Randomised controlled trials relevant to aggressive and violent people, 1955-2000: a survey. Br. J. Psychiatry 186: 185-189 [Abstract] [Full text]  
  • Penston, J. (2005). Trial protocols: time for more than tinkering. BMJ 330: 421-421 [Full text]  
  • Papanikolaou, P. N., Churchill, R., Wahlbeck, K., Ioannidis, J. P.A., The EU-PSI Project, (2004). Safety Reporting in Randomized Trials of Mental Health Interventions. Am. J. Psychiatry 161: 1692-1697 [Abstract] [Full text]  
  • Smith, R. (2004). Travelling but never arriving: reflections of a retiring editor. BMJ 329: 242-244 [Full text]  
  • Wykes, T., Marshall, M. (2004). Reshaping mental health practice with evidence: the Mental Health Research Network. Psychiatr. Bull. 28: 153-155 [Full text]  
  • Delucchi, K. L. (2004). Sample Size Estimation in Research With Dependent Measures and Dichotomous Outcomes. Am. J. Public Health 94: 372-377 [Abstract] [Full text]  
  • Harrison, J. E. (2003). Clinical trials in orthodontics II: assessment of the quality of reporting of clinical trials published in three orthodontic journals between 1989 and 1998. J. Orthod. 30: 309-315 [Abstract] [Full text]  
  • Smith, R. (2002). New BMJ policy on economic evaluations. BMJ 325: 1124-1124 [Full text]  
  • Zygmunt, A., Olfson, M., Boyer, C. A., Mechanic, D. (2002). Interventions to Improve Medication Adherence in Schizophrenia. Am. J. Psychiatry 159: 1653-1664 [Abstract] [Full text]  
  • Hotopf, M. (2002). The pragmatic randomised controlled trial. Adv. Psychiatr. Treat. 8: 326-333 [Full text]  
  • GILBODY, S. M., HOUSE, A. O., SHELDON, T. A. (2002). Outcomes research in mental health: Systematic review. Br. J. Psychiatry 181: 8-16 [Abstract] [Full text]  
  • van Beinum, M., Thomas, P., Faulkner, A. (2002). User-led research and evidence in psychiatry * Authors' reply. Br. J. Psychiatry 180: 549-550 [Full text]  
  • Juni, P., Holenstein, F., Sterne, J., Bartlett, C., Egger, M. (2002). Direction and impact of language bias in meta-analyses of controlled trials: empirical study. Int J Epidemiol 31: 115-123 [Abstract] [Full text]  
  • McDonald, S., Westby, M., Clarke, M., Lefebvre, C. (2002). Number and size of randomized trials reported in general health care journals from 1948 to 1997. Int J Epidemiol 31: 125-127 [Abstract] [Full text]  
  • Elbourne, D. R, Altman, D. G, Higgins, J. P., Curtin, F., Worthington, H. V, Vail, A. (2002). Meta-analyses involving cross-over trials: methodological issues. Int J Epidemiol 31: 140-149 [Abstract] [Full text]  
  • GILBODY, S., WHITTY, P. (2002). Improving the delivery and organisation of mental health services: beyond the conventional randomised controlled trial. Br. J. Psychiatry 180: 13-18 [Abstract] [Full text]  
  • Cohen, D., McCubbin, M., Collin, J., Perodeau, G. (2001). Medications as Social Phenomena. Health (London) 5: 441-469 [Abstract]  
  • ADAMS, C. E., FENTON, M. K. P., QURAISHI, S., DAVID, A. S. (2001). Systematic meta-review of depot antipsychotic drugs for people with schizophrenia. Br. J. Psychiatry 179: 290-299 [Abstract] [Full text]  
  • Moher, D., Schulz, K. F., Altman, D. G. (2001). The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials. J. Am. Podiatr. Med. Assoc. 91: 437-442 [Abstract] [Full text]  
  • Adams, C. E., Gilbody, S. (2001). ""Nobody ever expects the Spanish Inquisition"" (Python, 1991). Psychiatr. Bull. 25: 291-292 [Full text]  
  • GEDDES, J., GOODWIN, G. (2001). Bipolar disorder: clinical uncertainty, evidence-based medicine and large-scale randomised trials. Br. J. Psychiatry 178 : s191-s194 [Abstract] [Full text]  
  • Moher, D., Schulz, K. F., Altman, D., for the CONSORT Group, (2001). The CONSORT Statement: Revised Recommendations for Improving the Quality of Reports of Parallel-Group Randomized Trials. JAMA 285: 1987-1991 [Abstract] [Full text]  
  • Cullum, N. (2001). Evaluation of studies of treatment or prevention interventions. Part 2: applying the results of studies to your patients. Evid. Based Nurs. 4: 7-8 [Full text]  
  • Adams, C., Wilson, P., Gilbody, S., Bagnall, A.-M., Lewis, R. (2000). Drug treatments for schizophrenia. Qual Saf Health Care 9: 73-79 [Full text]  
  • Geddes, J., Wessely, S. (2000). Clinical standards in psychiatry. How much evidence is required and how good is the evidence base?. Psychiatr. Bull. 24: 83-84 [Full text]  
  • Adetugbo, K., Williams, H. (2000). How Well Are Randomized Controlled Trials Reported in the Dermatology Literature?. Arch Dermatol 136: 381-385 [Abstract] [Full text]  
  • EISENBERG, L. (2000). Is psychiatry more mindful or brainier than it was a decade ago?. Br. J. Psychiatry 176: 1-5 [Full text]  
  • Lester, H., Wilson, S. (1999). Practical problems in recruiting patients with schizophrenia into randomised controlled trials. BMJ 318: 1075-1075 [Full text]  
  • Chalmers, I. (1998). Unbiased, relevant, and reliable assessments in health care. BMJ 317: 1167-1168 [Full text]  

Rapid Responses:

Read all Rapid Responses

Practical Problems in Recruiting Patients with Schizophrenia into RCTs
Helen Lester
bmj.com, 10 Nov 1998 [Full text]
Re: Practical Problems in Recruiting Patients with Schizophrenia into RCTs
Ben Thornley, et al.
bmj.com, 9 Dec 1998 [Full text]

Student BMJ

Asylum seekers' care

UK medical students have published unreleased government plans to restrict failed asylum seekers' access to medical care

www.student.bmj.com

Listen to the latest BMJ Interview