Intended for healthcare professionals

CCBYNC Open access
Research

Outcomes of non-invasive diagnostic modalities for the detection of coronary artery disease: network meta-analysis of diagnostic randomised controlled trials

BMJ 2018; 360 doi: https://doi.org/10.1136/bmj.k504 (Published 21 February 2018) Cite this as: BMJ 2018;360:k504
  1. George CM Siontis, consultant cardiologist1,
  2. Dimitris Mavridis, assistant professor of statistics2,
  3. John P Greenwood, professor of cardiology3,
  4. Bernadette Coles, information specialist4,
  5. Adriani Nikolakopoulou, research associate in biostatistics5,
  6. Peter Jüni, professor of medicine6,
  7. Georgia Salanti, associate professor of biostatistics and epidemiology5,
  8. Stephan Windecker, professor of cardiology1
  1. 1Department of Cardiology, Bern University Hospital, Inselspital, Bern, Switzerland
  2. 2Department of Primary Education, University of Ioannina, Ioannina, Greece
  3. 3Leeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds, Leeds, UK
  4. 4Cancer Research Wales Library, Velindre National Health Trust, Cardiff, UK
  5. 5Institute of Social and Preventive Medicine, University of Bern, Bern, Switzerland
  6. 6Applied Health Research Centre, Li Ka Shing Knowledge Institute, St Michael’s Hospital, University of Toronto, Toronto, Canada
  1. Correspondence to: S Windecker stephan.windecker{at}insel.ch
  • Accepted 16 January 2018

Abstract

Objective To evaluate differences in downstream testing, coronary revascularisation, and clinical outcomes following non-invasive diagnostic modalities used to detect coronary artery disease.

Design Systematic review and network meta-analysis.

Data sources Medline, Medline in process, Embase, Cochrane Library for clinical trials, PubMed, Web of Science, SCOPUS, WHO International Clinical Trials Registry Platform, and Clinicaltrials.gov.

Eligibility criteria for selecting studies Diagnostic randomised controlled trials comparing non-invasive diagnostic modalities in patients presenting with symptoms suggestive of low risk acute coronary syndrome or stable coronary artery disease.

Data synthesis A random effects network meta-analysis synthesised available evidence from trials evaluating the effect of non-invasive diagnostic modalities on downstream testing and patient oriented outcomes in patients with suspected coronary artery disease. Modalities included exercise electrocardiograms, stress echocardiography, single photon emission computed tomography-myocardial perfusion imaging, real time myocardial contrast echocardiography, coronary computed tomographic angiography, and cardiovascular magnetic resonance. Unpublished outcome data were obtained from 11 trials.

Results 18 trials of patients with low risk acute coronary syndrome (n=11 329) and 12 trials of those with suspected stable coronary artery disease (n=22 062) were included. Among patients with low risk acute coronary syndrome, stress echocardiography, cardiovascular magnetic resonance, and exercise electrocardiograms resulted in fewer invasive referrals for coronary angiography than coronary computed tomographic angiography (odds ratio 0.28 (95% confidence interval 0.14 to 0.57), 0.32 (0.15 to 0.71), and 0.53 (0.28 to 1.00), respectively). There was no effect on the subsequent risk of myocardial infarction, but estimates were imprecise. Heterogeneity and inconsistency were low. In patients with suspected stable coronary artery disease, an initial diagnostic strategy of stress echocardiography or single photon emission computed tomography-myocardial perfusion imaging resulted in fewer downstream tests than coronary computed tomographic angiography (0.24 (0.08 to 0.74) and 0.57 (0.37 to 0.87), respectively). However, exercise electrocardiograms yielded the highest downstream testing rate. Estimates for death and myocardial infarction were imprecise without clear discrimination between strategies.

Conclusions For patients with low risk acute coronary syndrome, an initial diagnostic strategy of stress echocardiography or cardiovascular magnetic resonance is associated with fewer referrals for invasive coronary angiography and revascularisation procedures than non-invasive anatomical testing, without apparent impact on the future risk of myocardial infarction. For suspected stable coronary artery disease, there was no clear discrimination between diagnostic strategies regarding the subsequent need for invasive coronary angiography, and differences in the risk of myocardial infarction cannot be ruled out.

Systematic review registration PROSPERO registry no CRD42016049442.

Introduction

Chest pain is a leading cause for physician consultation that leads to several million office and emergency department visits as well as hospital admissions yearly.12 Despite the use of clinical decision rules345 and the improved sensitivity of cardiac biomarkers,678 many patients who are admitted to the emergency department in order to exclude an acute coronary syndrome are ultimately found not to have a cardiac cause of their symptoms. Conversely, patients with symptoms who undergo cardiac investigations because of chest pain and are diagnosed with non-cardiac causes or in whom the cause of chest pain remains undetermined are at increased risk of subsequent cardiovascular events and death.910

Guidelines published in 2012 by the American College of Cardiology Foundation/American Heart Association recommended the use of functional testing, mainly on the basis of evidence derived from studies of diagnostic accuracy (because the vast majority of diagnostic randomised trials were published after these guidelines).11 However, recent audits in large numbers of patients showed only a modest effect on subsequent diagnostic findings.12 Currently, functional and anatomical non-invasive tests are widely available and used according to locally available resources and expertise (box): exercise electrocardiograms, single photon emission computed tomography (CT)-myocardial perfusion imaging, stress echocardiography, real time myocardial contrast echocardiography, coronary CT angiography, and cardiovascular magnetic resonance. Among these, coronary CT angiography as the only non-invasive anatomical diagnostic modality has been suggested to overcome limitations of traditional functional testing and has undergone close scrutiny in recent years.1314 So far, diagnostic randomised controlled trials do not provide conclusive evidence as to whether a non-invasive anatomical or functional testing strategy gives the best results for subsequent downstream testing or clinical outcomes. Therefore, we summarised the available evidence and evaluated clinical endpoints of different non-invasive diagnostic modalities in patients with symptoms suggestive of coronary artery disease through network meta-analysis.

Box

Key features of widely used functional and anatomical tests for non-invasive diagnosis of coronary artery disease

Exercise electrocardiograms

This test aims to detect myocardial ischaemia indirectly through electrocardiographic changes during exercise and recovery, which is the physiological consequence of a mismatch between myocardial oxygen supply (coronary blood flow) and myocardial oxygen demand (myocardial work). It is a well validated tool for the assessment of functional capacity and chronotropic response to exercise.

Stress echocardiography

Cardiac ultrasound (echocardiography) is used to evaluate myocardial function (contractility) at rest, and during exercise or pharmacological stress. It can detect the presence and extent of coronary artery disease by provoking regional ischaemia with resulting wall motion abnormalities. Myocardial ischaemia is provoked either by exercise (treadmill or bicycle) or pharmacological agents (predominantly dobutamine).

Real time myocardial contrast echocardiography

This test uses an intravenous echocardiographic contrast agent during stress echocardiography. While echo-contrast agents can be used to improve endocardial border definition in patients with suboptimal echocardiographic images, they also allow visualisation of myocardial tissue perfusion.

Single photon emission computed tomography-myocardial perfusion imaging

This technique uses intravenous administration of a radioactive myocardial perfusion tracer (radioisotope) to evaluate cardiac perfusion and function at rest and during dynamic exercise or pharmacological stress. The technique provides information on the presence or absence of myocardial ischaemia, myocardial infarction (and viability), and ventricular function.

Coronary computed tomographic angiography

This test allows direct visualisation of the coronary artery lumen and wall using an intravenous contrast agent to produce a computed tomographic coronary angiogram. Preceding non-contrast scans can assess the presence and extent of coronary artery calcium in the vessel wall, which is a marker of extent of coronary atherosclerosis and future risk, but not necessarily related to the severity of coronary artery narrowing.

Stress cardiovascular magnetic resonance imaging

This advanced cross sectional imaging procedure acquires two or three dimensional images of the heart. Using a contrast agent during pharmacological stress, first pass perfusion images can be used to identify areas of low myocardial blood flow (ischaemia) or stress induced regional wall motion abnormalities. During a single study, information is also provided on regional or global resting ventricular function, myocardial infarction (and viability), and proximal coronary artery anatomy.

RETURN TO TEXT

Methods

The detailed protocol that follows the template of a Cochrane review for multiple interventions is available in PROSPERO registry (CRD42016049442),15 and was prepared according to the guidelines of the Cochrane Multiple Interventions Methods Group.16

Data sources and searches

We performed a broad literature search in Medline, Medline in process, Embase, Cochrane Library for clinical trials, PubMed, Web of Science, SCOPUS, WHO International Clinical Trials Registry Platform, and Clinicaltrials.gov (appendix 1). A search algorithm was developed and adapted for each database, without language or sample size restrictions.

Study selection

We included diagnostic randomised controlled trials comparing any non-invasive anatomical (evaluation of coronary anatomy) or functional (detection of myocardial ischaemia) diagnostic strategy for the detection of coronary artery disease in patients without previously known coronary artery disease but presenting with symptoms suggestive of low risk acute coronary syndrome or stable coronary artery disease. Low risk acute coronary syndrome was defined as patients typically presenting with chest pain (or anginal equivalent) for at least 5 minutes at rest within the past 24 hours, without history of known coronary artery disease, without diagnostic ischaemic changes on electrocardiogram, without haemodynamic or clinical instability, and an initial troponin level lower than the 99th percentile of the used assay. These patients typically do not need immediate assessment by invasive coronary angiography.

We also considered trials comparing any diagnostic strategy with a standard of care as defined by the authors, and trials that allowed in the same arm any diagnostic test of the same testing group (that is, functional testing). We included trials in which at least one comparative pair non-invasive diagnostic tests was available, irrespective of the number of trial arms. As a condition, we consider that within each patient group, any of the diagnostic approaches could have been applied and hence they can be considered “jointly randomiseable.”17

Data extraction and quality assessment

Characteristics of trials, patients, and diagnostic strategies, were summarised. Details of the extracted items are available in the online protocol. Following the index diagnostic strategy, we considered as primary endpoints the subsequent referral to invasive coronary angiography and any coronary revascularisation. We considered the rate of invasive coronary angiography as an indicator of downstream testing, and the rate of revascularisation as surrogate for clinically significant coronary artery disease. Downstream testing is the need for additional diagnostic investigations that are performed (invasive or non-invasive (or both)) after the initial diagnostic test or strategy. Typically, this might occur after test failure or diagnostic uncertainty in relation to the index test result.

The outcome parameters were chosen on the basis of the hypothesis that a non-invasive, anatomically driven strategy might be more sensitive to identify non-clinically significant coronary artery disease (as suggested by previous studies), which in turn could have a prognostic effect.1819 We also collected information on patient oriented outcomes (myocardial infarction and death), and overall downstream testing (including the number of additional diagnostic tests after the index diagnostic intervention during follow-up). In case of missing outcomes in the main and subsequent publications of the included trials, we contacted the principal investigator of each trial to provide additionally required information.

We evaluated the internal validity of the trials by using the Cochrane risk of bias tool.20 Each item was described as being at low, high, or unclear risk of bias for random sequence generation, allocation concealment, blinding (participants/personnel and outcomes), incomplete outcome data, and selective outcome reporting. We evaluated the risk of bias in each trial and pairwise comparison overall for the outcome of referral to invasive coronary angiography as low, moderate, or high risk of bias, based on our judgments for allocation concealment and blinding of outcome assessment.

Data synthesis and analysis

We performed the predefined analyses separately for each group of study population as defined according to clinical presentation, and for each outcome according to established meta-analytical methods.2122 The detailed analysis plan is available in PROSPERO (CRD42016049442). Study specific odds ratios were synthesised by use of random effects pairwise and network meta-analysis.2324252627 A treatment hierarchy was obtained according to ranking probabilities summarised with the surface under the cumulative ranking curve.28 We estimated a common heterogeneity by using restricted maximum likelihood and evaluated its magnitude by comparing the estimated variance (𝜏2) to its empirical distribution for pharmacological interventions and semiobjective outcomes. According to the empirical distribution, the median is 0.04 (interquartile range 0-1.58).29 Estimates around 0.04, 0.16, and 0.36 can be considered to represent a low, moderate, and high degree of heterogeneity, respectively.30 To evaluate the assumption of consistency,31 we compared the direct and indirect evidence within each loop of evidence32 and used a design by treatment test.33 In case of important heterogeneity or inconsistency, we planned to explore sources using potential effect modifiers as described in the protocol, but this was not possible owing to the low number of trials.

In primary analyses, we considered each individual diagnostic strategy separately as applied in each trial. Two trials, CRESCENT34 and PROMISE,35 randomised patients to an anatomical versus a functional diagnostic strategy using functional tests that are widely available in clinical practice (exercise electrocardiograms, stress echocardiography, and single photon emission CT-myocardial perfusion imaging). For the primary analysis, these trials were assigned as having randomised the patients to exercise electrocardiograms34 and to single photon emission CT-myocardial perfusion imaging,35 which were the most frequently used tests in each trial.

In secondary analyses, we grouped traditional functional tests in a single node and compared them with coronary CT angiography as a purely anatomical test and cardiovascular magnetic resonance as an advanced imaging modality. Cardiovascular magnetic resonance was not included in the node of functional tests because of the different nature and availability of this advance imaging modality. This merging of tests is expected to increase the power of the analysis.36 Finally, we did a sensitivity analysis by excluding the two trials3435 that did not randomise the patients to an individual diagnostic strategy.

We calculated numbers needed to treat and numbers needed to harm for each outcome and each group of patients after grouping for functional testing as mentioned above, by applying the estimated odds ratios and confidence intervals to the odds of events estimated in patients randomly allocated to an anatomical based strategy (coronary CT angiography). For this purpose, we considered a baseline risk based on the event rates in the ACRIN-PA3738 and PROMISE35 trials for patients presenting with low risk acute coronary syndrome and suspected of stable coronary artery disease, respectively. Both trials were the largest in each group of patients (low risk acute coronary syndrome and stable coronary artery disease) and examined the role of an anatomical testing strategy.

Analyses were performed in Stata (network and network graph packages).39 To illustrate the assessments of risk of bias for the primary outcome of referral to invasive coronary angiography, we produced a bar graph showing how much information came from high, moderate, and low risk of bias trials for each network estimate by using CINeMA (Confidence in Network Meta-Analysis) software.40 We assessed the effect of study limitations in all network meta-analysis estimates using graphs based on the contribution matrix.31

Patient involvement

No patients were involved in the development of the research question, development of outcome measures, design, or conduct of this study. No patients were asked to advise on interpretation or writing up of results. There are no plans to involve patients in the dissemination of the results of this study.

Results

Our search yielded 19 674 citations, which were initially screened on abstract level for eligibility; 101 reports were retrieved and reviewed in full text. Finally, 30 diagnostic randomised controlled trials (34 reports) including 33 391 patients (16 083 women) and six different imaging modalities were deemed eligible (box, fig 1, appendices 1 and 2). Appendix 3 shows the diagnostic accuracy of the evaluated imaging modalities based on previously published studies (appendix 4 lists abbreviations used). Figure 2shows the diagnostic pathways chosen following the index diagnostic intervention across the trials. Descriptive details of the included trials and resulting networks are provided in table 1, figure 1, and appendix 5.

Fig 1
Fig 1

Network plots of examined diagnostic strategies across different patient groups. Network plots show comparisons across the available diagnostic strategies for each group of study populations (A and C), and consider stress echocardiography, single photon emission computed tomography-myocardial perfusion imaging, exercise electrocardiograms, or real time myocardial contrast echocardiography in the same group of diagnostic modalities of traditional functional testing (B and D). Anatomical testing pertains to coronary computed tomographic angiography. ECG=electrocardiogram; echo=echocardiography; RTMCE=real time myocardial contrast echocardiography; SPECT-MPI=single photon emission computed tomography-myocardial perfusion imaging; CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

Fig 2
Fig 2

Pathways taken following the index diagnostic intervention across included diagnostic randomised controlled trials for patients with (A) low risk acute coronary syndrome and (B) suspected stable coronary artery disease. Numbers indicate total number of trials in which each index diagnostic strategy (arm of randomisation) was applied. The final list of diagnostic strategies in each graph refer to downstream tests performed after the index diagnostic strategy. *Information on downstream testing is missing from one trial. ICA=invasive coronary angiography; ECG=electrocardiogram; echo=echocardiography; RTMCE=real time myocardial contrast echocardiography; SPECT-MPI=single photon emission computed tomography-myocardial perfusion imaging; CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

Table 1

Diagnostic randomised controlled trials and characteristics

View this table:

Eligible trials included patients with low risk acute coronary syndrome (18 trials, 11 329 patients)373841424344454647484950515253545556575859 and suspected stable coronary artery disease (12 trials, 22 062 patients34356061626364656667686970; table 1). The recruitment period for most of the trials was completed during the last 10 years. Seven trials reported industry related funding, 17 obtained exclusively non-industry funding, and six disclosed no funding. Fifteen trials were multicentre and two included three arm comparisons. In only three414346 trials of patients with low risk acute coronary syndrome, the authors clarified the use of a high sensitive troponin assay. A diagnostic strategy based on the recommended standard of care was included in 11 trials on acute coronary syndrome and two on stable coronary artery disease. Appendix 5 provides event rates for each assessed outcome parameter. We obtained unpublished outcome data from 11 trials3435414244565761626366 by contacting the principal investigators.

Most trials were considered to be at low risk in five of the assessed areas of potential bias, whereas no trial blinded the participants and personnel to the allocated diagnostic interventions (appendix 6). One trial43 was judged to be at high risk of bias related to random sequence generation and allocation concealment, one44 was considered high risk in relation to the blinding of outcome assessment, and one51 had possible incomplete data reporting. The risk of bias was frequently unclear, owing to limited reporting in the publications. Appendix 6 details the results of the risk of bias assessment and the contribution of comparisons with low, moderate, and high risk of bias to each network meta-analysis estimate.

Comparative efficacy of non-invasive diagnostic strategies

Patients with low risk acute coronary syndrome

Patients initially evaluated by stress echocardiography, cardiovascular magnetic resonance, or exercise electrocardiograms to exclude coronary artery disease among patients with low risk acute coronary syndrome were less likely to be referred to invasive coronary angiography compared with coronary CT angiography (odds ratio 0.28 (95% confidence 0.14 to 0.57), 0.32 (0.15 to 0.71), and 0.53 (0.28 to 1.00), respectively). However, differences were marginal for single photon emission CT-myocardial perfusion imaging (0.78 (0.58 to 1.03)) and standard of care (0.85 (0.69 to 1.05)) compared with coronary CT angiography (fig 1A, fig 3). Heterogeneity was low (𝜏2=0.023; fig 3, appendix 7). Initial evaluation by coronary CT angiography yielded more frequent downstream invasive coronary angiography and ranked as the diagnostic strategy resulting in most referrals to invasive coronary angiography. There was no evidence of inconsistency (P=0.64). Most of the evidence contributing to these treatment effects was based on low to moderate risk of bias (appendix 6).

Fig 3
Fig 3

Νetwork meta-analysis effects of examined individual diagnostic strategies versus coronary computed tomographic angiography (anatomical testing), for study group of patients with low risk acute coronary syndrome. Forest plot considers individual diagnostic strategies, as shown in figure 1A. Index test indicates any diagnostic modality other than coronary computed tomographic angiography (anatomical testing). Network meta-analysis for the outcome of death was not feasible because of missing data and zero events. ECG=electrocardiogram; echo=echocardiography; SPECT-MPI=single photon emission computed tomography-myocardial perfusion imaging; CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

Patients evaluated by cardiovascular magnetic resonance were less likely to undergo revascularisation than those assessed by stress echocardiography (ranked as first and second diagnostic strategies, respectively). Fewer revascularisation procedures were observed among patients who were initially evaluated by cardiovascular magnetic resonance, single photon emission CT-myocardial perfusion imaging, or the standard care than by coronary CT angiography (odds ratio 0.17 (95% confidence 0.04 to 0.65), 0.57 (0.41 to 0.79), and 0.68 (0.53 to 0.88), respectively; fig 3), with consistent findings between direct and indirect evidence.

Despite the differences between the diagnostic modalities in referrals for invasive coronary angiography and revascularisation, none of the strategies affected the rate of subsequent myocardial infarction, although the derived estimates were not precise. In terms of overall downstream testing, all diagnostic strategies (apart from cardiovascular magnetic resonance) were statistically significant better than a standard of care approach, which resulted in the highest rate of downstream testing (appendix 7). Significant disagreement between direct and indirect estimates was not identified, but heterogeneity was high (𝜏2=1.21).

After grouping of widely available functional tests (including exercise electrocardiograms, stress echocardiography, or single photon emission CT-myocardial perfusion imaging; fig 1B), a functional testing strategy and cardiovascular magnetic resonance were less likely than an anatomical testing (coronary CT angiography) strategy to lead to referrals for invasive coronary angiography (odds ratio 0.71 (95% confidence interval 0.53 to 0.96) and 0.32 (0.15 to 0.72), respectively; 𝜏2=0.032; fig 4, appendix 8). Considering overall downstream testing, a functional testing strategy was ranked first but without significant difference compared with an anatomical testing strategy. For both outcomes of downstream testing and myocardial infarction, the derived estimates were imprecise.

Fig 4
Fig 4

Νetwork meta-analysis effects of examined grouped diagnostic strategies versus coronary computed tomographic angiography (anatomical testing), for study group of patients with low risk acute coronary syndrome. Forest plot considers grouping of functional tests, as shown in figure 1B. Index test indicates any diagnostic modality other than coronary computed tomographic angiography (anatomical testing). Network meta-analysis for the outcome of death was not feasible because of missing data and zero events. CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

Table 2 presents the estimated numbers needed to treat to prevent one event and numbers needed to harm to cause one event for different outcomes after grouping of functional diagnostic strategies. For example, in the comparison of functional testing versus anatomical testing in terms of risk of myocardial infarction, the number needed to harm was 133. The 95% confidence interval indicated that results were compatible with both a beneficial effect of a strategy based on functional versus anatomical testing, resulting in a number needed to treat to prevent one event of 194 or more. The confidence interval also indicated that results were compatible with a harmful effect of functional testing, resulting in a number needed to harm to cause one event of 25 or more.

Table 2

Estimated numbers needed to treat (NNT) and numbers needed to harm (NNH) for assessed outcomes in network meta-analysis for anatomical versus functional testing. Data in brackets are 95% confidence intervals

View this table:

Patients with suspected stable coronary artery disease

Seven individual non-invasive diagnostic strategies were examined and constitute the network of patients with symptoms assessed for suspected stable coronary artery disease (fig 1C). For the outcomes of invasive coronary angiography referral and revascularisation, no individual diagnostic strategy differed from an anatomical strategy (coronary CT angiography), apart from single photon emission CT-myocardial perfusion imaging that marginally yielded less invasive coronary angiography (odds ratio 0.54 (95% confidence interval 0.30 to 0.98)) and subsequent revascularisations (0.57 (0.37 to 0.87); fig 5). There was no evidence of inconsistency (P=0.62) and heterogeneity was moderate to high (𝜏2=0.336) for referrals to invasive coronary angiography. Overall, downstream testing favoured an initial diagnostic strategy with stress echocardiography (0.24 (0.08 to 0.74)) or single photon emission CT-myocardial perfusion imaging (0.57 (0.37 to 0.87)), but not cardiovascular magnetic resonance (0.95 (0.41 to 2.22)) compared with coronary CT angiography (fig 5, appendix 9). Exercise electrocardiograms were ranked last, with the highest rate of downstream testing compared with any other diagnostic strategy. The overall heterogeneity was moderate (τ2=0.137).

Fig 5
Fig 5

Νetwork meta-analysis effects of examined individual diagnostic strategies versus coronary computed tomographic angiography (anatomical testing), for study group of patients with stable coronary artery disease. Forest plot consider individual diagnostic strategies, as shown in figure 1C. Index test indicates any diagnostic modality other than coronary computed tomographic angiography (anatomical testing). Real time myocardial contrast echocardiography was not included in the network meta-analysis for outcome of downstream testing because of unavailable data. ECG=electrocardiogram; echo=echocardiography; RTMCE=real time myocardial contrast echocardiography; SPECT-MPI=single photon emission computed tomography-myocardial perfusion imaging; CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

We detected inconsistency in the loop of coronary CT angiography, exercise electrocardiograms, and single photon emission CT-myocardial perfusion imaging, which was also verified with the sidesplit approach (P=0.48 for the inconsistency model overall). In the main analysis, we did not obtain a clear discrimination for most of the individual diagnostic strategies (imprecise estimates with broad confidence intervals and visually flat rankograms) for the clinical outcomes of myocardial infarction and death (fig 5, appendix 9).

In pairwise meta-analysis, functional testing resulted in fewer referrals for invasive coronary angiography (odds ratio 0.65 (95% confidence interval 0.58 to 0.74), τ2<0.001) than non-invasive anatomical testing (coronary CT angiography), with a similar estimate (0.63 (0.44 to 0.90)) from network meta-analysis after grouping of the functional tests (fig 1D). Cardiovascular magnetic resonance ranked first with regards to fewer referrals for invasive coronary angiography (with an estimate of 0.37 (0.19 to 0.72)) compared with standard of care in indirect comparisons (appendix 10), although with detectable inconsistency (P<0.05 in sidesplit approach). In the network of strategies, functional testing resulted in fewer revascularisation procedures than anatomical testing (0.57 (0.41 to 0.78); fig 6), and this finding was consistent between direct and indirect evidence with low heterogeneity (τ2=0.029). Despite differences in referrals for invasive assessment and subsequent revascularisation, no statistical significant difference was observed for the outcome of myocardial infarction for patients who were initially evaluated with a functional or anatomical based strategy (appendix 10). However, there was a trend towards favouring an anatomical testing strategy (fig 6).

Fig 6
Fig 6

Νetwork meta-analysis effects of examined grouped diagnostic strategies versus coronary computed tomographic angiography (anatomical testing), for study group of patients with stable coronary artery disease. Forest plot considers grouping of functional tests, as shown in figure 1D. Index test indicates any diagnostic modality other than coronary computed tomographic angiography (anatomical testing). CCTA=coronary computed tomographic angiography; CMR=cardiovascular magnetic resonance

In a sensitivity analysis excluding two trials (CRESCENT34 and PROMISE35) that randomised the patients to a non-specific functional test, the obtained estimates did not allow for any clear discrimination between the individual diagnostic strategies (appendix 11). By comparison of functional with anatomical testing in terms of risk of myocardial infarction, the number needed to harm was 480. The 95% confidence interval indicated that results were compatible with a beneficial effect of a strategy based on functional compared with anatomical testing, resulting in a number needed to treat to prevent one event of 1289 or more. The confidence interval also indicated that results were compatible with a harmful effect of functional testing, resulting in a number needed to harm to cause one event of 155 or more (table 2).

Discussion

Main findings

This study assesses the available evidence derived from diagnostic randomised controlled trials of strategies to detect coronary artery disease in a systematic and comprehensive way in two different clinical settings. Firstly, among patients with low risk acute coronary syndrome not required to undergo early invasive assessment, initial functional testing in terms of stress echocardiography or cardiovascular magnetic resonance was most strongly associated with a reduction of referrals for downstream invasive coronary angiography and revascularisation procedures, compared with anatomical testing using coronary CT angiography. No diagnostic strategy had an apparent effect on the subsequent risk of myocardial infarction, although estimates were imprecise.

Secondly, among patients with symptoms suggestive of stable coronary artery disease, no clear discrimination was seen across individual diagnostic strategies for the primary outcome of invasive coronary angiography referrals, mainly because of the limited number of trials contributing to each comparison. Stress echocardiography and single photon emission CT-myocardial perfusion imaging resulted in less overall downstream testing than coronary CT angiography, whereas exercise electrocardiograms required the most further downstream testing. After grouping of widely available functional tests, a functional testing approach yielded fewer referrals for invasive coronary angiography and subsequent revascularisations than anatomical testing. Again, estimates were imprecise for the outcome of myocardial infarction, and any differences could not be ruled out.

Implications for patients with low risk acute coronary syndrome

Among patients with suspected acute coronary syndrome without relevant electrocardiographic changes and negative biomarkers, several different non-invasive modalities have been tested in trials to detect clinically relevant coronary artery disease. In this clinical setting, coronary CT angiography has shown high sensitivity and negative predictive value, although the positive predictive value using invasive coronary angiography as reference standard has been shown to be moderate.7172

In our meta-analysis, a diagnostic strategy based on anatomical testing with use of coronary CT angiography was associated with increased referral rates for downstream invasive coronary angiography and revascularisation, some of which could have occurred in the absence of evidence of ischaemia. High sensitivity troponin assays, which were used in a minority of the included trials in our meta-analysis, are currently available and negative test results can serve as an efficient gatekeeper of unnecessary downstream diagnostic testing in this group of patients. However, non-coronary diseases might also cause elevated levels of high sensitivity troponin and subsequently subject patients with low pretest probability for coronary artery disease to unnecessary interventions. Therefore, the selection of patients with a higher pretest probability presenting in the emergency department, the definition of higher initial cutoff values, and the focus on dynamic changes over time are key points of the appropriate diagnostic testing in this clinical setting by increasing the positive predictive value of high sensitivity cardiac troponin.73 In our analysis, the rate of clinical events was low and our estimates are therefore imprecise for risk estimates of myocardial infarction, and with wide 95% confidence intervals, cannot rule out relevant increases or reductions in the risk of myocardial infarction associated with functional testing.

Economic resources are becoming more constrained while healthcare demands are increasing in this clinical setting. Therefore, it is important to assess the comparative effectiveness of such diagnostic strategies not only in terms of safety and diagnostic accuracy, but also in terms of efficiency and cost. To this effect, we found no difference in rates of overall downstream testing between anatomical and functional based strategies, while a standard of care approach was the strategy with the highest rates of downstream testing. This result could be attributed to the fact that doctors make the final decision to refer patients for further invasive testing on the basis of factors other than initial non-invasive imaging, such as clinical presentation, persistence of symptoms, repeated clinical encounters, and patient preference.7475 A functional testing strategy might provide important cost benefits, owing to fewer referrals for invasive coronary angiography and revascularisation and lower radiation and contrast agent exposure while resulting in similar clinical outcomes.76 Such benefits could reduce healthcare expenditure in this common clinical scenario in appropriately selected patients with low risk acute coronary syndrome. However, the availability and rapid access to functional imaging modalities (such as stress echocardiography or cardiovascular magnetic resonance) in the acute coronary syndrome setting might be limited.

Implications for patients with suspected stable coronary artery disease

For outpatients with suspected stable angina, our comprehensive synthesis of diagnostic randomised controlled trials indicates that an initial strategy based on functional testing might be preferable, resulting in fewer referrals for invasive coronary angiography and revascularisation. However—as was the case for the group with acute coronary syndrome—our estimates for the risk of myocardial infarction and death were imprecise, and wide 95% confidence intervals again cannot rule out relevant increases or reductions in the risk of myocardial infarction or death associated with functional testing.

Guidelines published in 2012 by the American College of Cardiology Foundation/American Heart Association recommend functional testing as the initial strategy.11 However, a concurrent use of functional and anatomical testing has been proposed on the basis of findings from two landmark trials (PROMISE35 and SCOT-HEART6364) that evaluated the role of coronary CT angiography in patients with suspected stable coronary artery disease.77 Our results agree with these guidelines, but contradict the recently updated guidelines from the National Institute for Health and Care Excellence (NICE). The NICE guidelines advise a non-invasive anatomical approach (coronary CT angiography) as first line diagnostic strategy with subsequent functional testing only in case of inconclusive results of the initial diagnostic test, without considering the individual pretest probability of coronary artery disease.78

In a nationwide cohort study,79 Jorgensen and colleagues found a diagnostic approach based on non-invasive anatomical testing to be associated with modifications to cardiovascular related drug treatments, increased downstream invasive coronary testing and subsequent revascularisation, and a lower risk of myocardial infarction (hazard ratio 0.71, 95% confidence interval 0.61 to 0.82) compared with functional testing. Similarly, a conventional meta-analysis including three trials in the corresponding analysis showed a borderline significant reduction of myocardial infarction with coronary CT angiography compared with a mixture of functional testing and standard care (odds ratio 0.69 (95% confidence interval 0.49 to 0.98)).80

In our network meta-analysis, we found a statistically non-significant signal of a similar magnitude. Results in figure 6 correspond to an odds ratio of myocardial infarction of 0.74 favouring coronary CT angiography over functional testing (95% confidence interval 0.48 to 1.15). However, our network meta-analysis made full use of all available evidence from 12 randomised trials comparing seven different diagnostic strategies within one analysis, appropriately quantifying the uncertainty of hard clinical outcomes associated with these strategies. Nevertheless, both the direction and magnitude of effects in our analysis are comparable with the large cohort study by Jorgensen and colleagues79 and the conventional meta-analysis.80

A decrease in the risk of subsequent myocardial infarction related to an anatomical testing strategy is indeed possible and cannot be ruled out based on our results. However, whether intensification of medical treatment (primary or secondary prevention) or the increased rate of subsequent coronary revascularisation (or both) affect the prognosis of patients undergoing coronary CT angiography remains unknown. Finally, the baseline risk of myocardial infarction in the landmark PROMISE trial35 and the cohort study by Jorgensen and colleagues79 were low (0.6% and 0.8% for up to one month, respectively). This resulted in absolute risk differences between functional testing and coronary CT angiography of about 0.2%, with a corresponding number needed to harm around 500 for this outcome (table 2), which is arguably irrelevant to raise safety concerns.

Implications for clinicians, policymakers, and other researchers

Diagnostic tests are critical components of an effective healthcare system. Diagnostic randomised controlled trials should become the default evaluation tool for new imaging modalities and clinical outcomes.818283 Our systematic evaluation show that the low event rates have resulted in sample sizes of thousands of patients in recent trials but without allowing for a clear discrimination between the individual diagnostic strategies. Along the same lines, the use of broader clinical (composite) endpoints might be clinically meaningful in future trials. More importantly, the resulting networks of trials suggest that each technological innovation became the standard for subsequent future trials (that is, coronary CT angiography), although no clear advantage in terms of clinical outcomes had been shown compared with previous diagnostic strategies. Future adequately powered clinical trials should aim to clarify the differential effects on more broadly defined clinical outcomes (which could occur during longer follow-up periods), and subsequent use of hospital resources and cost effectiveness aspects of implemented strategies, which are representative of current clinical practice.

Currently, there is a broad range of non-invasive imaging modalities to investigate patients with suspected low risk acute coronary syndrome or stable coronary artery disease, with further studies required to determine how to best integrate these tests in the patient care pathway. Several parameters such as locally available technology and expertise, patient’s preferences, and relevant contraindications for each test should be taken into account when deciding on the appropriate imaging modality. Any potential benefits of the applied diagnostic test should be carefully evaluated in the context of its risks (that is, radiation exposure for coronary CT or invasive coronary angiography).

Study limitations

This study had several limitations. Firstly, access to individual patient data that would have allowed us to identify potential differential effects in specific subgroups of patients was not available. Secondly, the low event rate of clinical outcomes (such as myocardial infarction and death) reflective of low risk populations and the sparse data for some comparisons (that is, those informed only by one trial) might have not provided enough power to clearly discriminate diagnostic strategies, especially within the stable coronary artery disease group. Thirdly, information on cost effectiveness as part of the downstream testing among the identified strategies was not given in most of the individual studies; therefore, we were not able to evaluate this aspect. Fourthly, the primary endpoints of invasive coronary angiography and revascularisation is partly attributed to physician judgment, which is not the case for the patient oriented outcomes of death and myocardial infarction. Finally, the standard of care, which was often a comparator in our study, has substantially evolved over the years. Earlier trials might not be directly relevant to present practice. However, the vast majority of the studies had been conducted in the past decade, and no differences during that period or compared with present practice are expected to have affect the results.

What is already known on this topic

  • Information on diagnostic accuracy is important for decisions on the usefulness of a diagnostic test, which might not translate into patient benefits

  • Diagnostic randomised controlled trials provide the most conclusive evidence regarding patient outcomes, and represent a rigorous approach to diagnostic test evaluation

  • Several non-invasive imaging modalities can be used to investigate patients with suspected low risk acute coronary syndromes or stable coronary artery disease, but their effect on downstream testing and clinical outcomes remains unknown and inconsistent

What this study adds

  • In patients with low risk acute coronary syndrome, functional testing (stress echocardiography and cardiovascular magnetic resonance) is associated with fewer referrals for downstream invasive coronary angiography than coronary computed tomographic angiography, without apparent impact on subsequent risk of myocardial infarction

  • Among patients with suspected stable coronary artery disease, functional testing (stress echocardiography and single photon emission computed tomography-myocardial perfusion imaging) is associated with less requirement for additional diagnostic investigations (overall downstream testing) than coronary computed tomographic angiography, although the estimates cannot rule out a significant effect on the risk of myocardial infarction associated with individual tests

  • Future adequately powered clinical trials should evaluate more broadly defined clinical outcomes, subsequent use of hospital resources, and cost effectiveness aspects of implemented strategies, which are representative of current clinical practice

Acknowledgments

We thank Konstantinos Siontis (Division of Cardiovascular Medicine, University of Michigan, Ann Arbor) for his insightful comments on the protocol of the study, and the principal investigators of individual diagnostic randomised controlled trials who contributed to this study by providing additional unpublished data related to the outcomes of interest: Marisa Lubbers (Department of Cardiology, Erasmus Medical Centre, Rotterdam, Netherlands); Admir Dedic (Department of Cardiology, Erasmus University Medical Centre, Rotterdam, Netherlands); Roxy Senior (Department of Cardiovascular Medicine and Institute for Medical Research, Northwick Park Hospital, Harrow, UK; Centre for Health Informatics and Multi-Professional Education, University College London, London, UK; Cardiovascular, Biomedical Research Unit, Department of Cardiology, Royal Brompton Hospital, London, UK; Department of Cardiology, Imperial College London, London, UK); Pamela S Douglas (Duke University School of Medicine, Duke University Medical Center, Durham, USA); David Newby (British Heart Foundation Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK) on behalf of the SCOTHEART Investigators; Jeffrey M Levsky (Department of Radiology, Montefiore Medical Center/Albert Einstein College of Medicine, Bronx, NY, USA); Peter McKavanagh (Cardiology Department, Ulster Hospital, South Eastern Health and Social Care Trust, Dundonald, Belfast, UK; Centre for Vision and Vascular Science, Queen’s University Belfast, Royal Victoria Hospital Belfast, Belfast, UK); Jesper James Linde (Department of Cardiology, Hvidovre Hospital, University of Copenhagen, Denmark); Michel M Lièvre (Lyon 1 University, Louis Pradel Hospital, Bron, France); Frans J Th Wackers (Yale University School of Medicine, Section of Cardiovascular Medicine, New Haven, USA); Gaetano Nucifora (Azienda Ospedaliero-Universitaria di Udine, Udine, Italy).

Footnotes

  • Contributors: GCMS, DM, PJ, GS, and SW designed the study. BC built the search strategy. GCMS and DM screened the articles for eligibility and extracted the data. JPG provided additional unpublished data. GCMS, DM, AN, PJ, and GS performed the statistical analysis and interpreted the results. GCMS and SW wrote the first draft of the manuscript, with major contributions from JPG and PJ. All authors made revisions to the manuscript and have read and approved the final version. SW is the guarantor. All authors had full access to all of the data.

  • Funding: No funding was obtained for this study.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; JPG has received research grants to the institution from Boston Scientific, St Jude, and Philips Healthcare, and personal fees from Astra Zeneca, outside the submitted work; PJ has received research grants to the institution from Astra Zeneca, Biotronik, Biosensors International, Eli Lilly, and The Medicines Company outside the submitted work, and serves as unpaid member of the steering group of trials funded by Astra Zeneca, Biotronik, Biosensors, St Jude Medical, and The Medicines Company; PJ is a tier 1 Canada research chair in clinical epidemiology of chronic diseases, which was completed partly with funding from the Canada Research Chairs Program; GS is a Marie Skłodowska-Curie Fellow (grant MSCA-IF-703254); SW has received research grants to the institution from Bracco, Boston Scientific, Terumo, Abbott, St Jude, Edwards, Medtronic, and personal fees from Astra Zeneca, outside the submitted work; all other authors have nothing to declare; no other relationships or activities that could appear to have influenced the submitted work.

  • Ethical approval: No ethical approval was required.

  • Data sharing: No additional data are available.

  • Transparency: The corresponding author affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 17.
  17. 18.
  18. 19.
  19. 20.
  20. 21.
  21. 22.
  22. 23.
  23. 24.
  24. 25.
  25. 26.
  26. 27.
  27. 28.
  28. 29.
  29. 30.
  30. 31.
  31. 32.
  32. 33.
  33. 34.
  34. 35.
  35. 36.
  36. 37.
  37. 38.
  38. 39.
  39. 40.
  40. 41.
  41. 42.
  42. 43.
  43. 44.
  44. 45.
  45. 46.
  46. 47.
  47. 48.
  48. 49.
  49. 50.
  50. 51.
  51. 52.
  52. 53.
  53. 54.
  54. 55.
  55. 56.
  56. 57.
  57. 58.
  58. 59.
  59. 60.
  60. 61.
  61. 62.
  62. 63.
  63. 64.
  64. 65.
  65. 66.
  66. 67.
  67. 68.
  68. 69.
  69. 70.
  70. 71.
  71. 72.
  72. 73.
  73. 74.
  74. 75.
  75. 76.
  76. 77.
  77. 78.
  78. 79.
  79. 80.
  80. 81.
  81. 82.
  82. 83.
View Abstract