Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies

BMC Med Res Methodol. 2016 Aug 12;16(1):97. doi: 10.1186/s12874-016-0196-1.

Abstract

Background: In meta-analyses of diagnostic test accuracy, routinely only one pair of sensitivity and specificity per study is used. However, for tests based on a biomarker or a questionnaire often more than one threshold and the corresponding values of true positives, true negatives, false positives and false negatives are known.

Methods: We present a new meta-analysis approach using this additional information. It is based on the idea of estimating the distribution functions of the underlying biomarker or questionnaire within the non-diseased and diseased individuals. Assuming a normal or logistic distribution, we estimate the distribution parameters in both groups applying a linear mixed effects model to the transformed data. The model accounts for across-study heterogeneity and dependence of sensitivity and specificity. In addition, a simulation study is presented.

Results: We obtain a summary receiver operating characteristic (SROC) curve as well as the pooled sensitivity and specificity at every specific threshold. Furthermore, the determination of an optimal threshold across studies is possible through maximization of the Youden index. We demonstrate our approach using two meta-analyses of B type natriuretic peptide in heart failure and procalcitonin as a marker for sepsis.

Conclusions: Our approach uses all the available information and results in an estimation not only of the performance of the biomarker but also of the threshold at which the optimal performance can be expected.

Keywords: Biomarker; Diagnostic accuracy study; Meta-analysis; ROC curve; Threshold.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Biomarkers
  • Calcitonin / blood
  • Heart Failure / blood
  • Heart Failure / diagnosis
  • Humans
  • Linear Models
  • Meta-Analysis as Topic*
  • Natriuretic Peptide, Brain / blood
  • Normal Distribution
  • ROC Curve
  • Reproducibility of Results
  • Sepsis / blood
  • Sepsis / diagnosis

Substances

  • Biomarkers
  • Natriuretic Peptide, Brain
  • Calcitonin