BMJ  2005;330:1179 (21 May), doi:10.1136/bmj.38446.498542.8F (published 13 May 2005)

Paper

Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey

R Brian Haynes, chief1, K Ann McKibbon, doctoral candidate4, Nancy L Wilczynski, doctoral candidate2, Stephen D Walter, professor3, Stephen R Werre, research associate1, for the Hedges Team

1 Health Information Research Unit, McMaster University, Hamilton, ON, Canada L8N 3Z5, 2 School of Graduate Studies, McMaster University, 3 Department of Clinical Epidemiology and Biostatistics, McMaster University, 4 Center for Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA, USA

Correspondence to: R B Haynes bhaynes{at}mcmaster.ca

Objective To develop and test optimal Medline search strategies for retrieving sound clinical studies on prevention or treatment of health disorders.

Design Analytical survey.

Data sources 161 clinical journals indexed in Medline for the year 2000.

Main outcome measures Sensitivity, specificity, precision, and accuracy of 4862 unique terms in 18 404 combinations.

Results Only 1587 (24.2%) of 6568 articles on treatment met criteria for testing clinical interventions. Combinations of search terms reached peak sensitivities of 99.3% (95% confidence interval 98.7% to 99.8%) at a specificity of 70.4% (69.8% to 70.9%). Compared with best single terms, best multiple terms increased sensitivity for sound studies by 4.1% (absolute increase), but with substantial loss of specificity (absolute difference 23.7%) when sensitivity was maximised. When terms were combined to maximise specificity, 97.4% (97.3% to 97.6%) was achieved, about the same as that achieved by the best single term (97.6%, 97.4% to 97.7%). The strategies newly reported in this paper outperformed other validated search strategies except for two strategies that had slightly higher specificity (98.1% and 97.6% v 97.4%) but lower sensitivity (42.0% and 92.8% v 93.1%).

Conclusion New empirical search strategies have been validated to optimise retrieval from Medline of articles reporting high quality clinical studies on prevention or treatment of health disorders.


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to StumbleUpon StumbleUpon   Add to Technorati Technorati    What's this?

Relevant Articles

Filtering Medline for a clinical discipline: diagnostic test assessment framework
Amit X Garg, Arthur V Iansavichus, Nancy L Wilczynski, Monika Kastner, Leslie A Baier, Salimah Z Shariff, Faisal Rehman, Matthew Weir, K Ann McKibbon, and R Brian Haynes
BMJ 2009 339: b3435. [Abstract] [Full Text] [PDF]

Hit parade
BMJ 2005 331: 115. [Extract] [Full Text]

Try the new optimal strategy for searching Medline
BMJ 2005 330: 0. [Full Text] [PDF]

Clever searching for evidence
Sharon Sanders and Chris Del Mar
BMJ 2005 330: 1162-1163. [Extract] [Full Text] [PDF]

Optimal search strategies for retrieving systematic reviews from Medline: analytical survey
Victor M Montori, Nancy L Wilczynski, Douglas Morgan, R Brian Haynes for the Hedges Team
BMJ 2005 330: 68. [Abstract] [Full Text] [PDF]

Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey
R Brian Haynes and Nancy L Wilczynski
BMJ 2004 328: 1040. [Abstract] [Full Text] [PDF]

This article has been cited by other articles:

  • Garg, A. X, Iansavichus, A. V, Wilczynski, N. L, Kastner, M., Baier, L. A, Shariff, S. Z, Rehman, F., Weir, M., McKibbon, K A., Haynes, R B. (2009). Filtering Medline for a clinical discipline: diagnostic test assessment framework. BMJ 339: b3435-b3435 [Abstract] [Full text]  
  • Chase, H. S., Kaufman, D. R., Johnson, S. B., Mendonca, E. A. (2009). Voice Capture of Medical Residents' Clinical Information Needs During an Inpatient Rotation. J. Am. Med. Inform. Assoc. 16: 387-394 [Abstract] [Full text]  
  • Poolman, R. W., Swiontkowski, M. F., Fairbank, J. C.T., Schemitsch, E. H., Sprague, S., de Vet, H. C.W. (2009). Outcome Instruments: Rationale for Their Use. JBJS 91: 41-49 [Abstract] [Full text]  
  • Donaldson, M. G., Sobolev, B., Cook, W. L., Janssen, P. A., Khan, K. M. (2009). Analysis of recurrent events: a systematic review of randomised controlled trials of interventions to prevent falls. Age Ageing 38: 151-155 [Abstract] [Full text]  
  • Thijs, V., Lemmens, R., Fieuws, S. (2008). Network meta-analysis: simultaneous meta-analysis of common antiplatelet regimens after transient ischaemic attack or stroke. Eur Heart J 29: 1086-1092 [Abstract] [Full text]  
  • Cucherat, M. (2007). Quantitative relationship between resting heart rate reduction and magnitude of clinical benefits in post-myocardial infarction: a meta-regression of randomized clinical trials. Eur Heart J 28: 3012-3019 [Abstract] [Full text]  
  • Taylor, B., Wylie, E., Dempster, M., Donnelly, M. (2007). Systematically Retrieving Research: A Case Study Evaluating Seven Databases. Research on Social Work Practice 17: 697-706 [Abstract]  
  • Bainbridge, D., Cheng, D., Martin, J. (2007). Reply to the Editor. J. Thorac. Cardiovasc. Surg. 134: 548-549 [Full text]  
  • Poolman, R. W., Abouali, J. A.K., Conter, H. J., Bhandari, M. (2007). Overlapping Systematic Reviews of Anterior Cruciate Ligament Reconstruction Comparing Hamstring Autograft with Bone-Patellar Tendon-Bone Autograft: Why Are They Different?. JBJS 89: 1542-1552 [Abstract] [Full text]  
  • O'Leary, N., Tiernan, E., Walsh, D., Lucey, N., Kirkova, J., Davis, M. P. (2007). The Pitfalls of a Systematic MEDLINE Review in Palliative Medicine: Symptom Assessment Instruments. AM J HOSP PALLIAT CARE 24: 181-184 [Abstract]  
  • Wilczynski, N. L., Marks, S., Haynes, R. B. (2007). Search Strategies for Identifying Qualitative Studies in CINAHL. Qual Health Res 17: 705-710 [Abstract]  
  • Goss, C., Lowenstein, S., Roberts, I., DiGuiseppi, C. (2007). Identifying controlled studies of alcohol-impaired driving prevention: designing an effective search strategy. Journal of Information Science 33: 151-162 [Abstract]  
  • LEWISON, G., THORNICROFT, G., SZMUKLER, G., TANSELLA, M. (2007). Fair assessment of the merits of psychiatric research. Br. J. Psychiatry 190: 314-318 [Abstract] [Full text]  
  • Wilczynski, N. L., Haynes, R. B. (2007). Response to Corrao et al.: Improving Efficacy of PubMed Clinical Queries for Retrieving Scientifically Strong Studies on Treatment. J. Am. Med. Inform. Assoc. 14: 247-248 [Full text]  
  • Bardia, A., Wahner-Roedler, D. L., Erwin, P. L., Sood, A. (2006). Search Strategies for Retrieving Complementary and Alternative Medicine Clinical Trials in Oncology. Integr Cancer Ther 5: 202-205 [Abstract]  
  • Corrao, S., Colomba, D., Arnone, S., Argano, C., Di Chiara, T., Scaglione, R., Licata, G. (2006). Improving Efficacy of PubMed Clinical Queries for Retrieving Scientifically Strong Studies on Treatment. J. Am. Med. Inform. Assoc. 13: 485-487 [Abstract] [Full text]  
  • Hammerstrom, K. (2006). Atypical Antipsychotic Drugs, Dementia, and Risk of Death. JAMA 295: 496-496 [Full text]  
  • Mayosi, B. M., Burgess, L. J., Doubell, A. F. (2005). Tuberculous Pericarditis. Circulation 112: 3608-3616 [Abstract] [Full text]  
  • Verbeek, J, Salmi, J, Pasternack, I, Jauhiainen, M, Laamanen, I, Schaafsma, F, Hulshof, C, van Dijk, F (2005). A search strategy for occupational health intervention studies. Occup. Environ. Med. 62: 682-687 [Abstract] [Full text]  
  • (2005). Hit parade. BMJ 331: 115-115 [Full text]  
  • Sanders, S., Del Mar, C. (2005). Clever searching for evidence. BMJ 330: 1162-1163 [Full text]  
Access jobs at BMJ Careers
Whats new online at Student BMJ