BMJ 2003;326:472 ( 1 March )

Papers

Validity of indirect comparison for estimating efficacy of competing interventions: empirical evidence from published meta-analyses

Fujian Song, senior research fellow, ^a Douglas G Altman, professor of statistics in medicine, ^b Anne-Marie Glenny, lecturer in evidence based oral health care, ^c Jonathan J Deeks, senior medical statistician. ^b

^a Department of Public Health and Epidemiology, University of Birmingham, Birmingham B15 2TT, ^b Centre for Statistics in Medicine, Institute of Health Sciences, Oxford OX3 7LF, ^c Cochrane Oral Health Group, University Dental Hospital of Manchester, Manchester M15 6FH

Correspondence to: F Song f.song{at}bham.ac.uk

Objective: To determine the validity of adjusted indirect comparisons by using data from published meta-analyses of randomised trials.
Design: Direct comparison of different interventions in randomised trials and adjusted indirect comparison in which two interventions were compared through their relative effect versus a common comparator. The discrepancy between the direct and adjusted indirect comparison was measured by the difference between the two estimates.
Data sources: Database of abstracts of reviews of effectiveness (1994-8), the Cochrane database of systematic reviews, Medline, and references of retrieved articles.
Results: 44 published meta-analyses (from 28 systematic reviews) provided sufficient data. In most cases, results of adjusted indirect comparisons were not significantly different from those of direct comparisons. A significant discrepancy (P<0.05) was observed in three of the 44 comparisons between the direct and the adjusted indirect estimates. There was a moderate agreement between the statistical conclusions from the direct and adjusted indirect comparisons ( 0.51). The direction of discrepancy between the two estimates was inconsistent.
Conclusions: Adjusted indirect comparisons usually but not always agree with the results of head to head randomised trials. When there is no or insufficient direct evidence from randomised trials, the adjusted indirect comparison may provide useful or supplementary information on the relative efficacy of competing interventions. The validity of the adjusted indirect comparisons depends on the internal validity and similarity of the included trials.

What is already known on this topic Many competing interventions have not been compared in randomised trials Indirect comparison of competing interventions has been carried out in systematic reviews, often implicitly Indirect comparison adjusted by a common control can partially take account of prognostic characteristics of patients in different trials What this study adds Results of adjusted indirect comparison usually, but not always, agree with those of head to head randomised trials The validity of adjusted indirect comparisons depends on the internal validity and similarity of the trials involved

---

© 2003 BMJ Publishing Group Ltd
CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

Related Articles

Telemonitoring or structured telephone support programmes for patients with chronic heart failure: systematic review and meta-analysis

Robyn A Clark, Sally C Inglis, Finlay A McAlister, John G F Cleland, and Simon Stewart
BMJ 2007 334: 942. [Abstract] [Full Text] [PDF]

Simultaneous comparison of multiple treatments: combining direct and indirect evidence

Deborah M Caldwell, A E Ades, and J P T Higgins
BMJ 2005 331: 897-900. [Extract] [Full Text] [PDF]

Is adjusted indirect comparison valid?
BMJ 2003 326: 0. [Full Text]

Related external webpages:

NHS Health Technology Assessment Programme

This article has been cited by other articles:

• Sare, G. M., Gray, L. J., Bath, P. M.W. (2008). Association between hormone replacement therapy and subsequent arterial and venous vascular events: a meta-analysis. Eur Heart J 0: ehn299v1-11 [Abstract] [Full text]  
• Akl, E. A., Terrenato, I., Barba, M., Sperati, F., Sempos, E. V., Muti, P., Cook, D. J., Schunemann, H. J. (2008). Low-Molecular-Weight Heparin vs Unfractionated Heparin for Perioperative Thromboprophylaxis in Patients With Cancer: A Systematic Review and Meta-analysis. Arch Intern Med 168: 1261-1269 [Abstract] [Full text]  
• Salanti, G., Higgins, J. P., Ades, A., Ioannidis, J. P. (2008). Evaluation of networks of randomized trials. Stat Methods Med Res 17: 279-301 [Abstract]  
• Testa, L., van Gaal, W.J., Biondi-Zoccai, G.G.L., Abbate, A., Agostoni, P., Bhindi, R., Banning, A.P. (2008). Repeat thrombolysis or conservative therapy vs. rescue percutaneous coronary intervention for failed thrombolysis: systematic review and meta-analysis. QJM 101: 387-395 [Abstract] [Full text]  
• Thijs, V., Lemmens, R., Fieuws, S. (2008). Network meta-analysis: simultaneous meta-analysis of common antiplatelet regimens after transient ischaemic attack or stroke. Eur Heart J 29: 1086-1092 [Abstract] [Full text]  
• Koshman, S. L., Charrois, T. L., Simpson, S. H., McAlister, F. A., Tsuyuki, R. T. (2008). Pharmacist Care of Patients With Heart Failure: A Systematic Review of Randomized Trials. Arch Intern Med 168: 687-694 [Abstract] [Full text]  
• Billinger, M., Beutler, J., Taghetchian, K. R., Remondino, A., Wenaweser, P., Cook, S., Togni, M., Seiler, C., Stettler, C., Eberli, F. R., Luscher, T. F., Wandel, S., Juni, P., Meier, B., Windecker, S. (2008). Two-year clinical outcome after implantation of sirolimus-eluting and paclitaxel-eluting stents in diabetic patients. Eur Heart J 29: 718-725 [Abstract] [Full text]  
• Clark, R. A, Inglis, S. C, McAlister, F. A, Cleland, J. G F, Stewart, S. (2007). Telemonitoring or structured telephone support programmes for patients with chronic heart failure: systematic review and meta-analysis. BMJ 334: 942-942 [Abstract] [Full text]  
• Cooper, N. J., Sutton, A. J., Lu, G., Khunti, K. (2006). Mixed comparison of stroke prevention treatments in individuals with nonrheumatic atrial fibrillation.. Arch Intern Med 166: 1269-1275 [Abstract] [Full text]  
• Stettler, C, Allemann, S, Egger, M, Windecker, S, Meier, B, Diem, P (2006). Efficacy of drug eluting stents in patients with and without diabetes mellitus: indirect comparison of controlled trials. Heart 92: 650-657 [Abstract] [Full text]  
• Elliott, R. A., Hooper, L., Payne, K., Brown, T. J., Roberts, C., Symmons, D. (2006). Preventing non-steroidal anti-inflammatory drug-induced gastrointestinal toxicity: are older strategies more cost-effective in the general population?. Rheumatology (Oxford) 45: 606-613 [Abstract] [Full text]  
• FURUKAWA, T. A., WATANABE, N., CHURCHILL, R. (2006). Psychotherapy plus antidepressant for panic disorder with or without agoraphobia: Systematic review. Br. J. Psychiatry 188: 305-312 [Abstract] [Full text]  
• Clark, A. M., Hartling, L., Vandermeer, B., McAlister, F. A. (2005). Meta-Analysis: Secondary Prevention Programs for Patients with Coronary Artery Disease. ANN INTERN MED 143: 659-672 [Abstract] [Full text]  
• Caldwell, D. M, Ades, A E, Higgins, J P T (2005). Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ 331: 897-900 [Full text]  
• Biondi-Zoccai, G. G.L., Agostoni, P., Abbate, A., Airoldi, F., Colombo, A. (2005). Critical role of bare-metal stent controls in trials of drug-eluting stents. Eur Heart J 26: 1686-1687 [Full text]  
• Chou, R., Huffman, L. H., Fu, R., Smits, A. K., Korthuis, P. T. (2005). Screening for HIV: A Review of the Evidence for the U.S. Preventive Services Task Force. ANN INTERN MED 143: 55-73 [Abstract] [Full text]  
• Bansback, N J, Brennan, A, Ghatnekar, O (2005). Cost effectiveness of adalimumab in the treatment of patients with moderate to severe rheumatoid arthritis in Sweden. Ann Rheum Dis 64: 995-1002 [Abstract] [Full text]  
• Santaguida, P. L., Helfand, M., Raina, P. (2005). Challenges in Systematic Reviews That Evaluate Drug Efficacy or Effectiveness. ANN INTERN MED 142: 1066-1072 [Abstract] [Full text]  
• Hosking, D.J., Geusens, P., Rizzoli, R. (2005). Osteoporosis therapy: an example of putting evidence-based medicine into clinical practice. QJM 98: 403-413 [Abstract] [Full text]  
• Hayden, J. A., van Tulder, M. W., Malmivaara, A. V., Koes, B. W. (2005). Meta-Analysis: Exercise Therapy for Nonspecific Low Back Pain. ANN INTERN MED 142: 765-775 [Abstract] [Full text]  
• Brophy, J. M., Joseph, L. (2005). Medical Decision Making with Incomplete Evidence--Choosing a Platelet Glycoprotein IIbIIIa Receptor Inhibitor for Percutaneous Coronary Interventions. Med Decis Making 25: 222-228 [Abstract]  
• Bjordal, J. M., Ljunggren, A. E., Klovning, A., Slordal, L. (2004). Non-steroidal anti-inflammatory drugs, including cyclo-oxygenase-2 inhibitors, in osteoarthritic knee pain: meta-analysis of randomised placebo controlled trials. BMJ 329: 1317- [Abstract] [Full text]  
• Strippoli, G. F M, Craig, M., Deeks, J. J, Schena, F. P., Craig, J. C (2004). Effects of angiotensin converting enzyme inhibitors and angiotensin II receptor antagonists on mortality and renal outcomes in diabetic nephropathy: systematic review. BMJ 329: 828- [Abstract] [Full text]  
• Kranke, P., Eberhart, L. H., Roewer, N., Tramer, M. R. (2004). Single-Dose Parenteral Pharmacological Interventions for the Prevention of Postoperative Shivering: A Quantitative Systematic Review of Randomized Controlled Trials. Anesth. Analg. 99: 718-727 [Abstract] [Full text]  
• McAlister, F. A., Stewart, S., Ferrua, S., McMurray, J. J.J.V. (2004). Multidisciplinary strategies for the management of heart failure patients at high risk for admission: A systematic review of randomized trials. J Am Coll Cardiol 44: 810-819 [Abstract] [Full text]  
• (2004). Grading quality of evidence and strength of recommendations. BMJ 328: 1490- [Abstract] [Full text]  
• Mason, L., Moore, R A., Derry, S., Edwards, J. E, McQuay, H. J (2004). Systematic review of topical capsaicin for the treatment of chronic pain. BMJ 328: 991- [Abstract] [Full text]  
• Habib, A. S., El-Moalem, H. E., Gan, T. J. (2004). The efficacy of the 5-HT3 receptor antagonists combined with droperidol for PONV prophylaxis is similar to their combination with dexamethasone. A meta-analysis of randomized controlled trials: [L'efficacite de la combinaison des antagonistes des recepteurs 5-HT3 et du droperidol ou de la dexame- thasone est similaire pour prevenir les NVPO. Une meta-analyse d'essais randomises et controles]. Canadian J. Anesthesia 51: 311-319 [Abstract] [Full text]  
• Yazdanpanah, Y., Sissoko, D., Egger, M., Mouton, Y., Zwahlen, M., Chene, G. (2004). Clinical efficacy of antiretroviral combination therapy based on protease inhibitors or non-nucleoside analogue reverse transcriptase inhibitors: indirect comparison of controlled trials. BMJ 328: 249- [Abstract] [Full text]  
• Lim, E., Ali, Z., Ali, A., Routledge, T., Edmonds, L., Altman, D. G, Large, S. (2003). Indirect comparison meta-analysis of aspirin therapy after coronary surgery. BMJ 327: 1309- [Abstract] [Full text]  
• Marshall, T. (2003). Coronary heart disease prevention: insights from modelling incremental cost effectiveness. BMJ 327: 1264- [Abstract] [Full text]  
• Antman, E. M., Ferguson, J. J. (2003). Should Evidence-Based Proof of Efficacy as Defined for a Specific Therapeutic Agent be Extrapolated to Encompass a Therapeutic Class of Agents?. Circulation 108: 2604-2607 [Full text]  
• Hochberg, M C, Tracy, J K, Hawkins-Holt, M, Flores, R H (2003). Comparison of the efficacy of the tumour necrosis factor {alpha} blocking agents adalimumab, etanercept, and infliximab when added to methotrexate in patients with active rheumatoid arthritis. Ann Rheum Dis 62: ii13-16 [Abstract] [Full text]  
• Psaty, B. M., Lumley, T., Furberg, C. D., Schellenbaum, G., Pahor, M., Alderman, M. H., Weiss, N. S. (2003). Health Outcomes Associated With Various Antihypertensive Therapies Used as First-Line Agents: A Network Meta-analysis. JAMA 289: 2534-2544 [Abstract] [Full text]  

Rapid Responses:

Read all Rapid Responses

Indirect comparisons: a new sacrilege in clinical research?

Jose A Sacristan, et al.
bmj.com, 8 Apr 2003 [Full text]

Adjusted indirect comparison is a logical extension of utilising data from RCTs

Fujian Song, et al.
bmj.com, 17 Apr 2003 [Full text]