Indirect Comparison in Evaluating Relative Efficacy Illustrated by Antimicrobial Prophylaxis in Colorectal Surgery
Introduction
In evaluating the relative efficacy of treatment options, the most reliable evidence comes from randomized controlled trials in which the potential for patient allocation bias is minimized [1]. However, it is not unusual that different treatment options have not been compared directly within randomized controlled studies, and conclusions on relative efficacy have been based on indirect comparison of different interventions [2].
In a systematic review of antibiotic prophylaxis for preventing surgical wound infection after colorectal surgery [3], we identified 147 randomized trials in which more than 70 different antibiotics or combinations of antibiotics were assessed. Only a limited number of antibiotics were directly compared within the trials. If all 70 options were directly compared, over 2400 trials would have been required, without considering different dosages, routes, and timing of administration of the same drug.
Using our systematic review as an example, this paper aims to explore the potential usefulness and limitations of indirect comparison in evaluating the relative efficacy of competing interventions.
Section snippets
Method
Suppose that interventions A and C were directly compared in randomized trial 1 (with groups a1 and c1), and that interventions B and C were directly compared in trial 2 (with groups b2 and c2). If there is no trial available to compare interventions A and B directly, it is possible to have a simple “indirect” comparison of group a1 in trial 1 and group b2 in trial 2. However, the power of randomization is lost in such a simple indirect comparison, and any difference between a1 and b2 may be
Results
Results presented in Figure 1 indicate that considerable discrepancies exist between the direct and indirect comparisons. In each set of trials, the discrepancies between the direct and the adjusted indirect method were the same in three different comparisons. On the other hand, the discrepancies between the direct and the simple indirect comparisons were unpredictable and varied greatly across the different comparisons.
The discrepancies between the direct and the simple indirect comparisons
Discussion
When no direct comparison has been carried out, the indirect comparison may have to be used to assess different treatment options. As compared with the simple indirect comparison, the adjusted indirect comparison has the advantages that the baseline risk and other prognostic factors of participants in different trials have been partially taken into account. As a consequence there is greater uncertainty about the result, indicated by a wider confidence interval [2]. Nevertheless, even the
Summary
The adjusted method of indirect comparison partially takes into account the baseline risk and other prognostic factors of participants in different trials and provides an appropriately wider confidence interval than the simple indirect comparison of single arms from different trials. However, the adjusted indirect comparison may not give results similar to the direct comparison.
When there is no direct comparison, the adjusted indirect method may be useful to obtain some indirect evidence of the
References (17)
- et al.
The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials
J Clin Epidemiol
(1997) - et al.
An observer blind trial of co-amoxiclav versus cefuroxime plus metronidazole in the prevention of postoperative wound infection after general surgery
J Hosp Infec
(1994) - et al.
Randomization and baseline comparisons in clinical trials
Lancet
(1990) - et al.
A trial of mezlocillin versus cefuroxime with or without metronidazole for the prevention of wound sepsis after biliary and gastrointestinal surgery
J Hosp Infec
(1988) - et al.
A prospective randomized trial to compare triple dose mezlocillin with triple dose cefuroxime plus metronidazole as prophylaxis in colorectal surgery
J Hosp Infec
(1988) - et al.
Single dose mezlocillin versus three dose cefuroxime plus metronidazole for the prophylaxis of wound infection after large bowel surgery
J Hosp Infec
(1987) - et al.
Meta-analysis in clinical trials
Control Clin Trials
(1986) Clinical TrialsA Practical Approach
(1996)