Abstract
The objective of the present study was to analyse critically the quality of the reporting in 102 randornized trials from four leading urological journals from 1984 to 1989 on the basis of an evaluation system we have developed. This comprises 21 principal parameters selected in terms of their significance for the validity of the studies. These parameters were evaluated by two readers independently of each other as to whether they were specified, not specified, could not be evaluated or were not applicable. The study score of each paper resulted from the sum of all specified criteria. In the 102 studies, out of 21 criteria 69.1% and 69.8% (investigators A and B, respectively) were reported: 29.8% and 29.4%, respectively were not reported. 0.4% and 0.1%, respectively, could not be evaluated and 0.7% did not apply. Such important principal parameters as the sample size (6.9% and 7.8%, respectively), statistical power (11.8%), method of randomization (22.5% and 23.5%, respectively), patient blinding (30.4%), investigator blinding (33.3%), loss to follow-up (34.8% and 35.3%, respectively) and rate of discontinuation (36.0% and 37.7%, respectively) were mentioned least often. The study score of all investigations ranged from 20.5 (97.6%) to 9.0 (42.9%) points. Most (60/59% and 62/61%, respectively) attained values between 16 (76.2%) and 13 (61.9%). Accordingly, randomized trials in urological journals show similar deficits to those in internal medicine, surgery and intensive care medicine. A particular problem is that they concern the most important techniques for systematic reduction of inadvertent errors (bias), and thus doubt is cast upon the hardcore of controlled studies. If it is possible for many authors to mention individual criteria completely, this should also apply (and in particular) to the most critical parameters. In our opinion, the 21 criteria selected for an evaluation system constitute a practical compromise between the 3 and 38 criteria alternatively suggested by other authors. Moreover, use of a comprehensive check list should be the precondition for acceptance of papers for publication.
Similar content being viewed by others
References
Altmann DG, Dorè CJ (1990) Randomisation and baseline comparisons in clinical trials. Lancet 335:149
Brown CG, Kelen GD, Moser M, Moeschberger ML, Rund DA (1985) Methodology reporting in three acute care journals: replication and reliability. Ann Emerg Med 14:986
Chalmers TC, Smith H Jr, Blackburn B, Silverman B, Schroeder B, Reitman D, Ambroz A (1981) A method for assessing the quality of a randomized control trial. Controlled Clin Trials 2:31
DerSimonian R, Charette J, McPeek B, Mosteller F (1982) Exporting on methods in clinical trials. N Engl J Med 306:1332
Emerson JD, McPeek B, Mosteller F (1984) Reporting clinical trials in general surgical journals. Surgery 95:572
Evans M, Pollock AV (1985) A score system for evaluating random control clinical trials of prophylaxis of abdominal surgical wound infection. Br J Surg 72:572
Evans M, Pollock AV (1987) The inadequacy of published random control trials of antibacterial prophylaxis in colorectal surgery. Dis Col Rect 30:743
Jacobsen BS, Meininger JC (1985) Randomized experiments in nursing: the quality of reporting. Methodology Corner 35:379
Kelen GD, Brown CG, Moser M, Ashoton J, Rund DA (1985) Reporting methodology protocols in three acute care journals. Ann Emerg Med 9:880
Liberati A, Himel HN, Chalmers TC (1986) A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol 4:942
Mosteller F, Gilbert JP, McPeek B (1980) Reporting standards and research strategies for controlled trials. Controlled Clin Trials 1:37
Rohde H, Otterbach C, Pütz T, Mizrahi M (1988) Reporting on randomised surgical trials from German as compared with English and American surgeons. Theor Surg 3:118
Solomon MJ, McLeod RS (1993) Clinical studies in surgical journals—have we improved? Dis Colon Rectum 36:43
Valleron AJ, Grimfeld A (1992) Evaluation of clinical trials of immunomodulators for prevention of recurrent respiratory infections in children. Develop Biol Stand 77:149
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Lent, V., Langenbach, A. A retrospective quality analysis of 102 randomized trials in four leading urological journals from 1984–1989. Urol. Res. 24, 119–122 (1996). https://doi.org/10.1007/BF00431090
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/BF00431090