Problems of spectrum and bias in evaluating the efficacy of diagnostic tests

N Engl J Med. 1978 Oct 26;299(17):926-30. doi: 10.1056/NEJM197810262991705.

Abstract

To determine why many diagnostic tests have proved to be valueless after optimistic introduction into medical practice, we reviewed a series of investigations and identified two major problems that can cause erroneous statistical results for the "sensitivity" and "specificity" indexes of diagnostic efficacy. Unless an appropriately broad spectrum is chosen for the diseased and nondiseased patients who comprise the study population, the diagnostic test may receive falsely high values for its "rule-in" and "rule-out" performances. Unless the interpretation of the test and the establishment of the true diagnosis are done independently, bias may falsely elevate the test's efficacy. Avoidance of these problems might have prevented the early optimism and subsequent disillusionment with the diagnostic value of two selected examples: the carcinoembryonic antigen and nitro-blue tetrazolium tests.

Publication types

  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Bacterial Infections / diagnosis
  • Carcinoembryonic Antigen / analysis
  • Clinical Laboratory Techniques / standards*
  • Colonic Neoplasms / diagnosis
  • Humans
  • Tetrazolium Salts

Substances

  • Carcinoembryonic Antigen
  • Tetrazolium Salts