BMJ, doi: 10.1136/bmj.38068.557998.EE, (Published 8 April 2004)

PAPERS

Optimal search strategies for retrieving scientifically strong studies of diagnosis from Medline: analytical survey

R Brian Haynes 1 Nancy L Wilczynski 1

1 Health Information Research Unit, Department of Clinical Epidemiology and Biostatistics, McMaster University Faculty of Health Sciences, 1200 Main Street West, Hamilton, ON, Canada L8N 3Z5

Objective To develop optimal search strategies in Medline for retrieving sound clinical studies on the diagnosis of health disorders.

Design Analytical survey.

Setting Medline, 2000.

Participants 170 journals for 2000 of which 161 were indexed in Medline.

Main outcome measures The sensitivity, specificity, precision ("positive predictive value"), and accuracy of 4862 unique terms in 17 287 combinations were determined by comparison with a hand search of all articles (the "gold standard") in 161 journals published during 2000 (49 028 articles).

Results Only 147 (18.9%) of 778 articles about diagnostic tests met basic criteria for scientific merit. Combinations of search terms reached peak sensitivities of 98.6% at a specificity of 74.3%. Compared with best single terms, best multiple terms increased sensitivity for sound studies by 6.8% (absolute increase), while also increasing specificity (absolute increase 6.0%) when sensitivity was maximised. When terms were combined to maximise specificity, the single term, specificity.tw. (98.4%), outperformed combinations of terms. The strategies newly reported in this paper outperformed other validated search strategies except for one strategy that had slightly higher sensitivity (99.3% v 98.6%) but lower specificity (54.7% v 74.3%).

Conclusion New empirical search strategies in Medline can optimise retrieval of articles reporting high quality clinical studies of diagnosis.

(Accepted 18 March 2004)
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to StumbleUpon StumbleUpon   Add to Technorati Technorati    What's this?

Relevant Articles

Bridging the gaps in evidence based diagnosis
Sharon E Straus
BMJ 2006 333: 405-406. [Extract] [Full Text] [PDF]

Clever searching for evidence
Sharon Sanders and Chris Del Mar
BMJ 2005 330: 1162-1163. [Extract] [Full Text] [PDF]

Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey
R Brian Haynes, K Ann McKibbon, Nancy L Wilczynski, Stephen D Walter, Stephen R Werre for the Hedges Team
BMJ 2005 330: 1179. [Abstract] [Full Text] [PDF]

New search strategies retrieve morefrom Medline
BMJ 2004 328: 0. [Full Text]

This article has been cited by other articles:

  • Chase, H. S., Kaufman, D. R., Johnson, S. B., Mendonca, E. A. (2009). Voice Capture of Medical Residents' Clinical Information Needs During an Inpatient Rotation. J. Am. Med. Inform. Assoc. 16: 387-394 [Abstract] [Full text]  
  • Leeflang, M. M.G., Deeks, J. J., Gatsonis, C., Bossuyt, P. M.M., on behalf of the Cochrane Diagnostic Test Accuracy, (2008). Systematic Reviews of Diagnostic Test Accuracy. ANN INTERN MED 149: 889-897 [Abstract] [Full text]  
  • Coiera, E., Westbrook, J. I., Rogers, K. (2008). Clinical Decision Velocity is Increased when Meta-search Filters Enhance an Evidence Retrieval System. J. Am. Med. Inform. Assoc. 15: 638-646 [Abstract] [Full text]  
  • Astin, M. P., Brazzelli, M. G., Fraser, C. M., Counsell, C. E., Needham, G., Grimshaw, J. M. (2008). Developing a Sensitive Search Strategy in MEDLINE to Retrieve Studies on Assessment of the Diagnostic Performance of Imaging Techniques. Radiology 247: 365-373 [Abstract] [Full text]  
  • Fletcher, J. W., Djulbegovic, B., Soares, H. P., Siegel, B. A., Lowe, V. J., Lyman, G. H., Coleman, R. E., Wahl, R., Paschold, J. C., Avril, N., Einhorn, L. H., Suh, W. W., Samson, D., Delbeke, D., Gorman, M., Shields, A. F. (2008). Recommendations on the Use of 18F-FDG PET in Oncology. JNM 49: 480-508 [Abstract] [Full text]  
  • Hegedus, E J, Goode, A, Campbell, S, Morin, A, Tamaddoni, M, Moorman, C T III, Cook, C (2008). Physical examination tests of the shoulder: a systematic review with meta-analysis of individual tests. Br. J. Sports. Med. 42: 80-92 [Abstract] [Full text]  
  • Schmitt, B., Baugh, M., Scaglione, S. (2007). Practice corner: Chair's rounds. Evid. Based Med. 12: 133-134 [Full text]  
  • Staunton, M. (2007). Evidence-based Radiology: Steps 1 and 2--Asking Answerable Questions and Searching for Evidence. Radiology 242: 23-31 [Abstract] [Full text]  
  • McKibbon, K. A., Wilczynski, N. L., Haynes, R. B. (2006). Developing Optimal Search Strategies for Retrieving Qualitative Studies in PsycINFO. Eval Health Prof 29: 440-454 [Abstract]  
  • Cheng, A., Bell, D. (2006). Evidence Behind the WHO Guidelines: Hospital Care for Children: What is the Precision of Rapid Diagnostic Tests for Malaria?. J Trop Pediatr 52: 386-389 [Full text]  
  • Guha, I N, Parkes, J, Roderick, P R, Harris, S, Rosenberg, W M (2006). Non-invasive markers associated with liver fibrosis in non-alcoholic fatty liver disease.. Gut 55: 1650-1660 [Full text]  
  • Bardia, A., Wahner-Roedler, D. L., Erwin, P. L., Sood, A. (2006). Search Strategies for Retrieving Complementary and Alternative Medicine Clinical Trials in Oncology. Integr Cancer Ther 5: 202-205 [Abstract]  
  • Straus, S. E (2006). Bridging the gaps in evidence based diagnosis.. BMJ 333: 405-406 [Full text]  
  • Walters, L. A., Wilczynski, N. L., Haynes, R. B. (2006). Developing Optimal Search Strategies for Retrieving Clinically Relevant Qualitative Studies in EMBASE. Qual Health Res 16: 162-168 [Abstract]  
  • Verbeek, J, Salmi, J, Pasternack, I, Jauhiainen, M, Laamanen, I, Schaafsma, F, Hulshof, C, van Dijk, F (2005). A search strategy for occupational health intervention studies. Occup. Environ. Med. 62: 682-687 [Abstract] [Full text]  
  • Tatsioni, A., Zarin, D. A., Aronson, N., Samson, D. J., Flamm, C. R., Schmid, C., Lau, J. (2005). Challenges in Systematic Reviews of Diagnostic Technologies. ANN INTERN MED 142: 1048-1055 [Abstract] [Full text]  
  • Sanders, S., Del Mar, C. (2005). Clever searching for evidence. BMJ 330: 1162-1163 [Full text]  
  • Haynes, R B., McKibbon, K A., Wilczynski, N. L, Walter, S. D, Werre, S. R, for the Hedges Team, (2005). Optimal search strategies for retrieving scientifically strong studies of treatment from Medline: analytical survey. BMJ 330: 1179- [Abstract] [Full text]  
  • Hamilton, W., Sharp, D. (2004). Diagnosis of lung cancer in primary care: a structured review. Fam Pract 21: 605-611 [Abstract] [Full text]  
  • Wilczynski, N. L., Haynes, R. B., Lavis, J. N., Ramkissoonsingh, R., Arnold-Oatley, A. E., The HSR Hedges Team, (2004). Optimal search strategies for detecting health services research studies in MEDLINE. CMAJ 171: 1179-1185 [Abstract] [Full text]  
  • Onady, G. M., Raslich, M. A. (2004). Evidence-based Medicine: Searching Literature and Databases for Clinical Evidence (Search Tools). Pediatr. Rev. 25: 358-363 [Full text]  
  • Pai, M., McCulloch, M., Enanoria, W., Colford, J. M Jr (2004). Systematic reviews of diagnostic test evaluations: what's behind the scenes?. Evid. Based Med. 9: 101-103 [Full text]  

Rapid Responses:

Read all Rapid Responses

Does it help to use the best search strategy?
Jos H Verbeek, et al.
bmj.com, 14 Apr 2004 [Full text]
Network of expertise
Sara J Stock
bmj.com, 30 Apr 2004 [Full text]
New search filter for diagnostic studies: Ovid and PubMed versions not the same
Yngve T Falck-Ytter, et al.
bmj.com, 28 May 2004 [Full text]
Response to letter: New search filter for diagnostic studies: Ovid and PubMed versions not the same
Nancy L Wilczynski, et al.
bmj.com, 25 Jan 2006 [Full text]
Response to letter: Does it help to use the best search strategy?
Nancy L. Wilczynski, et al.
bmj.com, 3 Feb 2006 [Full text]
Response to letter: Network of expertise
Nancy L. Wilczynski, et al.
bmj.com, 3 Feb 2006 [Full text]
Access jobs at BMJ Careers
Whats new online at Student BMJ