Diagnostic reasoning in cardiovascular medicineBMJ 2022; 376 doi: https://doi.org/10.1136/bmj-2021-064389 (Published 05 January 2022) Cite this as: BMJ 2022;376:e064389
- John E Brush Jr, senior medical director, professor of medicine12,
- Jonathan Sherbino, assistant dean, professor34,
- Geoffrey R Norman, professor emeritus and scientist3
- 1Sentara Health Research Center, Norfolk, VA, USA
- 2Eastern Virginia Medical School, Norfolk, VA, USA
- 3McMaster Education Research, Innovation and Theory (MERIT) Program, McMaster University, Hamilton, ON, Canada
- 4Department of Medicine, McMaster University, Hamilton, ON, Canada
- Correspondence to: J E Brush
Research in cognitive psychology shows that expert clinicians make a medical diagnosis through a two step process of hypothesis generation and hypothesis testing. Experts generate a list of possible diagnoses quickly and intuitively, drawing on previous experience. Experts remember specific examples of various disease categories as exemplars, which enables rapid access to diagnostic possibilities and gives them an intuitive sense of the base rates of various diagnoses. After generating diagnostic hypotheses, clinicians then test the hypotheses and subjectively estimate the probability of each diagnostic possibility by using a heuristic called anchoring and adjusting. Although both novices and experts use this two step diagnostic process, experts distinguish themselves as better diagnosticians through their ability to mobilize experiential knowledge in a manner that is content specific. Experience is clearly the best teacher, but some educational strategies have been shown to modestly improve diagnostic accuracy. Increased knowledge about the cognitive psychology of the diagnostic process and the pitfalls inherent in the process may inform clinical teachers and help learners and clinicians to improve the accuracy of diagnostic reasoning. This article reviews the literature on the cognitive psychology of diagnostic reasoning in the context of cardiovascular disease.
An accurate and timely diagnosis is of paramount importance for patients with heart disease. A missed cardiac diagnosis can lead to harm to the patient, as well as dissatisfaction and life threatening ramifications.123 Cardiac diseases are common, and cardiac diagnostic encounters are frequent, particularly in emergency departments where a missed cardiac diagnosis is a leading cause of malpractice litigation.45 One cardiac diagnostic challenge is an ST elevation myocardial infarction (STEMI), for which a correct and timely diagnosis is critical for triggering emergency life saving interventions.67 The door-to-balloon time for STEMI is a widely reported measure of a hospital’s performance that is critically dependent on reliable diagnostic competence.8 Diagnostic accuracy and timing are critical for cardiovascular patients, yet the process of diagnostic reasoning is underemphasized in cardiology training and continuing medical education, as it is in many specialty areas.9
Insufficient attention has been paid to the important area of diagnostic reasoning, which has been eclipsed in the cardiology literature by reports of large clinical trials and novel technological advances. Also, very few studies have examined how cardiovascular diagnostic strategies affect decisions about patients’ management and outcomes, and costs, even though cardiovascular diagnostic tests and imaging are frequently used, have substantial impact, and are exceedingly costly.1011
Medical error was brought to public attention in the United States and elsewhere more than two decades ago by the Institutes of Medicine’s publication To Err Is Human.12 A more recent Institutes of Medicine publication, Improving Diagnosis in Health Care, brought attention to the problem of diagnostic error with calls for better education about the diagnostic process, better measurement of diagnostic error, and more research and emphasis on diagnostic competency.13
Hiding in plain view has been the abundant literature in cognitive science, which has yielded important evidence on how clinical experts make a diagnosis. By “expert,” we mean a clinician who has completed specialty training and is in practice, and so can be assumed to have the necessary knowledge and experience in their specialty; a “novice” is a learner in the early stages of training who has not yet acquired the necessary knowledge and experience for independent practice. Much of this literature has been published in education and psychology journals and may have escaped the attention of practicing cardiologists and clinical teachers. This review summarizes the evidence base about diagnostic reasoning in the context of cardiovascular disease, with the intention that increased awareness among clinicians and teachers will improve the quality of cardiovascular diagnostic reasoning.
Sources and selection criteria
This narrative review synthesizes the diagnostic reasoning literature from medicine and applies this evidence base to the domain of cardiovascular disease. Building on our knowledge of this literature, we did a broad, systematic search using the term “diagnostic reasoning” in Google Scholar and PubMed in all date ranges. We supplemented this search strategy by a hand search of the references of key articles. We achieved inclusion of identified articles by using an informal consensus approach based on an assessment of a study’s impact and its methods, with preference given to experimental studies. We achieved organization and framing of key themes that emerged during the synthesis in an iterative fashion, by consensus. We gave precedence to references that support our shared view that the effectiveness of educational strategies and corrective measures for diagnostic reasoning should be subjected to formal evaluation.
Incidence of diagnostic error
The incidence of diagnostic errors can be estimated from several sources, including autopsy studies, surveys of patients, audits of diagnostic testing, and reviews of closed malpractice claims.14 One retrospective analysis of internal medicine cases estimated that the rate of diagnostic error was very high, possibly in the 10-15% range.15 This and other reports have noted that estimating rates of diagnostic error on the basis of retrospective review has limitations owing to detection and reporting biases.16 Another observational study identified missed diagnoses of acute myocardial infarction (AMI) by counting the number of patients who returned to an emergency department, which would likely undercount the number of missed diagnoses.3 Another limitation is that, over time, diseases can progress and diagnostic evidence can accumulate, making a diagnosis more apparent, which in hindsight can make an initially missed diagnosis seem to be a diagnostic error. A further limitation is in the calculation of diagnostic error rates, which requires counting the number of diagnostic encounters in the denominator as well as the number of misses in the numerator. Defining a representative sample of diagnostic encounters has been notoriously difficult, making calculating diagnostic miss rates difficult.3 For example, among patients in an emergency department, defining a representative sample of patients with a possible AMI to calculate a diagnostic miss rate for AMI is difficult. Notwithstanding the difficulties in measurement, diagnostic error remains a substantial problem, and tackling this problem through greater awareness is urgently needed.13
Diagnostic reasoning versus management reasoning
Clinical reasoning integrates information on patients and clinical information, medical knowledge, and situational factors to provide care for patients. Clinical reasoning is an umbrella term that includes both diagnostic reasoning and management reasoning. Diagnostic reasoning is a classification task with various levels of specificity (for example, AMI versus STEMI versus STEMI with complete occlusion of the first obtuse marginal artery). Diagnostic reasoning has an objective endpoint, although the gold standard for a diagnosis can have problems of reliability (for example, cardiologists’ determination of the presence of congestive heart failure in clinical trials). Management reasoning involves prioritization of tasks, shared decision making with a patient and family, and dynamic monitoring of response to treatment. Management reasoning is more subjective, reflecting context, available resources, and the patient’s choice.1718 For the purposes of this review, we focus on diagnostic reasoning, acknowledging that this is only a portion of the task of clinical reasoning.
The two step process of making a diagnosis
Cardiac disease is diverse, with a broad range of presenting signs and symptoms, creating diagnostic challenges for the clinician. The diagnosis is often obscured at the time of initial presentation by vague, poorly characterized symptoms such as chest pain, shortness of breath, or fluttering in the chest. The clinician must elucidate the patient’s symptoms and translate the patient’s own words into the lexicon of cardiology. The clinician then connects signs and symptoms in a recognizable narrative or pattern and works inductively to place the patient’s illness in the correct diagnostic category. The process depends on one’s ability to engage the patient and elicit a clear and complete history. The importance of the history for making a correct cardiac diagnosis is well summarized by a well known quote attributed to Sir William Osler, “Listen to the patient; he will tell you the diagnosis.”
The physical examination can be helpful if it reveals an obvious sign such as a murmur or a friction rub, but often the examination is inconclusive and further diagnostic testing is needed. An organized and selective diagnostic testing strategy is key for proceeding in an effective and efficient manner. Despite skill and experience, the clinician often remains indecisive about a cardiac diagnosis, as evidenced by the fact that about a third of patients labeled with the discharge diagnosis of congestive heart failure were also initially treated for a pulmonary diagnosis.19
Clinicians tackle clinical ambiguity and diagnostic uncertainty by using intuition and analytical reasoning. Research from the 1970s showed that the diagnostic process is composed of two parts: hypothesis generation and hypothesis testing, the so-called “hypothetico-deductive method.”202122
Researchers have found that expert diagnosticians have between three and five diagnoses in mind within seconds to minutes after starting a diagnostic encounter.20212223 Generating the hypothesis early in the encounter is important for the accuracy of the eventual diagnosis. In one observational study, if the clinician had the diagnosis in mind early on, the diagnostic accuracy was 95%; if not, the diagnostic accuracy fell to 25%.24 Another observational study of the diagnostic process showed that primary care physicians can make an accurate diagnosis on the basis of just the chief complaint in 79% of cases.22 A qualitative study showed that emergency physicians generated 25% of their diagnostic hypotheses before seeing the patient, and they generated 75% of their hypotheses within five minutes of starting the diagnostic encounter.25 The remarkable ability of experts to recognize diagnostic possibilities was shown to be an effortless and instantaneous use of intuition, or non-analytical reasoning.262728 The cognitive psychologist Herbert Simon described how experts use intuition by stating, “The situation has provided a cue; this cue has given the expert access to information stored in memory, and the information provides the answer. Intuition is nothing more and nothing less than recognition.”29
Early work showed that the two step diagnostic process was not necessarily restricted to expert diagnosticians but was observed in novice medical students as well.2021 The distinguishing feature of the master diagnostician was not possession of a generalizable diagnostic skill, but rather it was the expert’s ability to mobilize and use knowledge from past experience. Moreover, Elstein found that expert diagnostic ability was “content specific.” For both novices and experts, good performance on one case did not translate to good performance on another case of different content. Thus, the accuracy of the diagnostic process was dependent on the clinician’s experiential knowledge. Cardiologists and other specialists seem to know this wholeheartedly. They work within their content area and are quick to seek consultation with others when the diagnosis seems to fall outside of their content expertise.
The expert’s ability to mobilize and use the appropriate knowledge for an accurate diagnosis has led researchers to contemplate the possible knowledge structures that the expert might use to store experiential knowledge.30 Several possible structures have been proposed, including propositional networks, prototypes, semantic axes, and exemplars.26313233 Research suggests that clinicians are likely flexible in how they encode, access, and mobilize knowledge for various diagnostic encounters.30
Studies have shown that the mechanism of diagnostic hypothesis generation varies, depending on a clinician’s amount of experience and level of training.3435 Students lack clinical experience and rely on biomedical knowledge to make causal connections to formulate diagnostic hypotheses.3637 Observing a student evaluating a patient with chest pain can show how this early method can be slow and relatively ineffective. As trainees gain experience, formal knowledge of basic pathophysiology is combined with expanding clinical experience as their diagnostic competence matures.
With clinical experience, a student’s knowledge of disease is expanded to include signs, symptoms, and other clinical features that are observed in actual patients. The learner’s biomedical knowledge and growing clinical experience are reorganized and “encapsulated” into narrative structures that are referred to as illness scripts.35383940 The term “script” implies a series of events that, along with enabling conditions, define a knowledge structure for remembering a diagnosis. The presentation of a typical patient with chest pain provides an excellent example of an illness script. Imagine a patient with a family history of coronary artery disease and a smoking history, who presents with a three week history of progressive chest pressure in the mid chest that occurs with exertion and resolves after a few minutes of rest. The enabling conditions, or risk factors, and the classic sequence of events are combined with a basic understanding of coronary artery disease to become encapsulated into memory as an illness script of unstable angina. With this mental representation, a clinician might envision an actual patient combined with a mental image of plaque rupture and myocardial ischemia. An illness script can sometimes incorporate a prototypical patient with typical features, or in other cases it can incorporate a specific patient with particular features. With time, learners accumulate a repertoire of illness scripts that is idiosyncratic to each learner on the basis of his or her individual experience.35
With further exposure to actual cases, clinicians gain experiential knowledge by remembering individual diagnostic instances in episodic memory. When an instance or object is labeled, categorized, and placed in long term memory, it is remembered using a knowledge structure called an exemplar.4041 Rather than abstracted knowledge, exemplars are direct memories of specific patients with unique features. Exemplars may remain as distinct memories or may become less distinct and more generalized over time. Each clinician has an idiosyncratic patient experience, and the exemplars that are remembered are the result of a clinician’s unique experiences and are not generalizable to other clinicians.
An exemplar can be retrieved from memory effortlessly and unconsciously. The experiential knowledge base of an experienced clinician is analogous to a large file cabinet filled with many exemplars, filed according to diagnostic category. The range and variety of exemplars gives the clinician a sense of the diversity within a diagnostic category and the distinguishing features between diagnostic categories. Clinicians know that exemplars of anterior and posterior myocardial infarctions are within the same category and that an acute aortic dissection belongs to a different category, on the basis of the distinct features of the exemplars. With experience, they are able to quickly recognize the contrasting features of different diagnostic categories, similar to recognizing the contrasting appearance of a right bundle branch block and a left bundle branch block on an electrocardiogram.42 In addition, expert diagnosticians develop an intuitive sense of the prevalence of a diagnosis based on the number of encounters that are stored in long term memory as exemplars.43 Expert clinicians know intuitively that an acute myocardial infarction is more common than an aortic dissection on the basis of an implicit sense of the relative number of exemplars in each category stored in long term memory.
Because exemplars are mental representations of a range of specific clinical symptom constellations (that is, phenotypes), a recent study examined the range of symptom phenotypes in a registry of young patients presenting with AMI.44 This registry offered an opportunity to study symptom phenotypes of AMI because it prospectively and systematically recorded detailed information about patients’ presenting symptoms. Among 3501 patients with AMI, 488 unique symptom phenotypes were identified, showing the degree of variation that challenges diagnosticians. Significantly more symptom phenotypes occurred in women than in men, which might be a source of ambiguity that could help to explain why the diagnosis of AMI is missed more frequently in women than in men.3 At a population level, the most common symptoms were chest pain, radiation, shortness of breath, and diaphoresis, and these symptoms generally describe the prototypical AMI patient. Interestingly, the phenotype with the prototypical combination of symptoms represented only 1% of the patients in this multicenter cohort. Cognitive psychology studies have shown that many examples are critically important for learning,4546 and this study suggests that learners need extensive experience to acquire adequate exposure to various phenotypes to permit the generation of a rich library of exemplars of AMI.
When the patient’s presentation is ambiguous and a diagnostic possibility does not intuitively and immediately come to mind, clinicians revert to more reflective reasoning methods.47 For this, experienced clinicians make use of a thought process called abductive reasoning, or reasoning toward the most plausible hypothesis.48 Abductive reasoning takes the following course: “The surprising fact C is observed. But if A were true, C would be a matter of course. Hence, there is reason to suspect that A is true.”49 For example, “A patient with a positive troponin is observed. If an AMI is present, troponin would be elevated as a matter of course. Hence, there is reason to suspect an AMI in this patient.” Abductive reasoning is a way to work backward and generate hypotheses that might explain observations. It is a form of reasoning that yields hypotheses, not conclusions. It is also the thinking that is used to generate a differential diagnosis by asking, “What other diagnoses could cause the observed findings?” Abductive reasoning describes a method for hypothesis generation that experienced clinicians use when reversion to more reflective thinking is needed.
After rapidly generating several diagnostic possibilities, the clinician begins testing various possibilities, starting with the most likely ones. The decision about which diagnosis to test depends on probability, as well as on the severity and acuity of a potential diagnosis. For example, a lower probability threshold and more urgent testing strategy might be applied for severe life threatening diagnoses such as AMI, pulmonary embolus, or aortic dissection. The prudent strategy might prioritize diagnostic testing for life threatening diseases, but for the most part the order of testing and diagnostic reasoning becomes an exercise in probability.
The field of cardiology has led the way in thinking probabilistically about possible diagnoses. Clinicians have been shown to use bayesian reasoning to determine the conditional probability of coronary artery disease.50 Bayesian reasoning provides a method for updating a baseline probability estimate on the basis of the strength of new information. Of course, clinicians rarely, if ever, do formal calculations, but this subjective notion of probability helps the clinician to think about an individual and to use probability estimates to zero in on the correct diagnosis.
No test is perfect, and the strength of new evidence from cardiac testing depends on the degree of imperfection of the test, as measured by the test’s operating characteristics. Sensitivity, or the true positive rate, measures the number of patients with disease who test positive; specificity, or the true negative rate, measures the number of patients without disease who test negative. Likelihood ratios can be calculated by combining sensitivity and specificity into dimensionless numbers that give an intuitive estimate of the strength of a positive or negative test result.951
This approach has limitations too. Measuring sensitivity and specificity requires systematical testing of patients in a research setting, and the numbers, as for any clinical measurements, are relatively imprecise estimates. Furthermore, when the operating characteristics of a test are determined in a rigorously controlled setting and then used in a practice setting or for screening of individuals with a different spectrum of disease, the test’s capability can be adversely affected by spectrum bias.52 For example, a study of the current generation troponin T assay in a rigorous research setting showed that the test had a sensitivity of 95% and specificity of 80%.53 This research study, however, specifically excluded patients with renal failure or septic shock. When used clinically in an emergency department setting without rigorous restrictions, the false positive rate would likely increase, which would markedly decrease the specificity.54 Thus, tests should be ordered deliberately to avoid spectrum bias, so as to maximize the operating characteristics of the test and minimize false positive results.
Over time, the prevalence of coronary artery disease, like other cardiac diagnoses, and associated risk factors and local environmental factors, has changed, requiring an updating of the probability estimates.5556 Nevertheless, approximating pre-test probability remains an important step in the process of calibrating one’s estimate of diagnostic probability.
Anchoring and adjusting
Cognitive psychologists have long recognized that people are not necessarily rational or mathematically rigorous in their decision making.575859 People use learned rapid mental shortcuts called heuristics to enable rapid decisions to be made under conditions of uncertainty. Some authors have asserted that heuristics represent a speed-accuracy trade-off, in which the speed of heuristics leads to bias and error.60 Others have argued that heuristics, although sometimes associated with error, are very useful for rapid decision making.5961 One heuristic is anchoring and adjusting,60 which describes how a decision maker quickly and subjectively estimates (anchors) the baseline probability of an event and then adjusts the probability estimate on the basis of new information. Anchoring and adjusting is an informal shortcut that replaces the formal use of Bayes’ rule. It is an intuitive two step process for estimating probability that works in parallel with the two step process of hypothesis generation and hypothesis testing. This heuristic can be affected by two potential biases. One bias is anchoring, whereby the decision maker becomes too stuck on the initial base rate and does not adequately adjust after new evidence is received. The other bias is base rate neglect, whereby the decision maker jumps to a subsequent probability estimate on the basis of new evidence without adequate regard for the initial base rate or disease prevalence.
Our recent experimental study evaluated the effectiveness of teaching the concept of bayesian reasoning to improve the accuracy of diagnostic probability estimates.62 Students were randomized to receive an instructional video on anchoring and adjusting, likelihood ratios, and bayesian reasoning, versus exposure to repeated examples of cases with feedback, versus no intervention. Previous studies suggested that trainees’ subjective probability estimates are often highly inaccurate.6364 This study, however, showed that all study participants gave probability estimates that were unexpectedly better than predicted by previous studies. The students who received the conceptual instruction on bayesian concepts showed a modest advantage in estimating the post-test probability of disease, suggesting that even brief instruction on bayesian concepts might improve students’ use of statistical heuristics to estimate probability.
Figure 1 shows how a clinician would use the anchoring and adjusting heuristic. The clinician estimates (anchors) a pre-test probability of a diagnosis on the x axis based on knowledge of the base rate or prevalence of a disease. The clinician could draw a vertical line to the curves for either a positive or a negative test result and then a horizontal line to the y axis to determine an estimate of post-test probability. The degree of the adjustment, or the shift in the probability estimate, depends on the strength of a postitive or negative test result, which can be quantified using positive or negative likelihood ratios.
Figure 2 shows how the adjustment or shift in the probability estimate can be asymmetric for different tests. The panel on the left shows a test that is highly specific but not very sensitive, such as a chest radiograph for the diagnosis of congestive heart failure. A positive test result would result in a larger shift in the post-test probability estimate. The panel on the right shows a test that is highly sensitive but not very specific, such as a D-dimer for the diagnosis of pulmonary embolus. A negative test would result in a larger negative shift in the post-test probability estimate.9
Dual process theory: system 1 and system 2
The two step diagnostic process is compatible with dual process theory. According to this cognitive psychology theory, two definable systems for thinking exist: one is non-analytical or intuitive thinking, and the other is analytical thinking. Neuroscience studies using functional magnetic resonance imaging have shown that these two thinking patterns involve distinctly different areas of the brain and have different metabolic requirements.6566 Dual process theory draws a distinction between system 1 thinking, which is intuitive, automatic, quick, and effortless, and system 2 thinking, which is analytic, reflective, slow, and effortful.586768 System 1 thinking is analogous to driving a car down a familiar, empty highway in that it works unconsciously and effortlessly. System 2 thinking is more like parking a car in a tight parking space, which requires deliberate and effortful attention.
System 1 thinking is triggered by an association between new information and a similar example, or exemplar, stored in long term memory.69 The association is effortless and depends on the strength of the association, which can be influenced by factors such as the number of examples in memory, the number of common features, and the recency or vividness of the memory.70 System 2, on the other hand, uses computation, analysis, and logical rules, and places a heavy burden on working memory.69 Expert clinicians make use of system 1 and system 2 thinking interchangeably, depending on the diagnostic task at hand.
Some authors have promoted the idea that errors occur because of short cuts, or heuristics, which are used by system 1 thinking and not corrected by system 2 reasoning.58 They provide the following advice: “The way to block errors that originate in System 1 is simple in principle: recognize the signs that you are in a cognitive minefield and slow down, and ask for reinforcement from System 2.”58 Other authors have countered this advice by stating that, “Perhaps the most persistent fallacy in the perception of dual-process theories is the idea that Type 1 processes (intuitive, heuristic) are responsible for all bad thinking and that Type 2 processes (reflective, analytic) necessarily lead to correct responses… So ingrained is this good-bad thinking idea that the same dual process theories have built it into their core terminology.”67
Does the speed of system 1 thinking lead to diagnostic error? An experimental study showed that a correct diagnosis was actually associated with less time spent on the diagnostic task.71 In other experimental studies in which investigators cautioned participants about speed and errors and encouraged participants to be deliberate and thorough, these instructions had no effect on diagnostic accuracy.727374 In another study, participants were allowed to re-think and revise their initial diagnosis, but revisions were more likely to be incorrect.75 One study, however, showed that extreme time pressure can have a negative effect on diagnostic accuracy, possibly by inducing anxiety in participants.76 Most of the evidence suggests that relying less on system 1 and more on system 2, as Kahneman and others advise, does not increase diagnostic accuracy.77 Kahneman did not study experts, and the context specific knowledge of expert diagnosticians seems to make system 1 thinking more of a strength than a weakness.
Some authors have associated diagnostic error with many cognitive biases.787980818283 Surprisingly few studies, however, have empirically examined the role of cognitive biases in diagnostic error. One systematic review of cognitive bias in healthcare indicated that for diagnostic reasoning, only seven biases have actually been empirically evaluated.84
The effect of bias on diagnosis can be studied either in an artificial experimental setting or in a practice setting where diagnostic errors have been identified and reviewed retrospectively. One experimental study showed evidence of “satisfaction of search” bias among radiologists shown radiographs with multiple artificial lung nodules. Participants often stopped searching after identifying only one nodule.85 Another experimental study examined base rate neglect and found little evidence that this bias affects experts.43 Additionally, these investigators found that the degree of self-reported experience with a diagnosis correlated well with an expert’s intuitive estimate of its base rate. Other experimental studies examined availability bias, which refers to how recent exposure to a case can bias the assessment of a new case, and these studies showed mixed results.868788 Some experimental studies showed that availability actually enhanced diagnostic accuracy.8990 For practitioners, this makes sense. The active engagement of practice with repeated exposures to a range of diagnostic encounters tends to build confidence among practitioners, supporting the notion that availability may improve diagnostic accuracy in the setting of real world practice.
Other observational studies have examined the role of bias through retrospective reviews of diagnostic errors in actual practice. One study examined 100 cases of diagnostic error in the emergency department and found that 68% were associated with a cognitive bias, primarily premature closure.15 Another observational study, however, found no role of bias in reported cases of diagnostic error.1 One prospective study showed that diagnostic experts were unable to agree on which bias actually contributed to the diagnostic error, and the study also found that the study participants were themselves affected by hindsight bias.91
Strategies for experienced clinicians to avoid diagnostic error
Rather than attributing diagnostic error to biases or flawed cognitive processes, some authors have argued that diagnostic error is more commonly due to an inability to adequately mobilize necessary knowledge, or due to knowledge deficits.177 Experimental studies have shown that the ability to mobilize knowledge and avoid diagnostic errors improves with experience.869293 Experimental studies have also shown that improved diagnostic accuracy is associated with the acquisition of both formal knowledge and experiential knowledge.437192
Simply imploring clinicians to routinely slow down and carefully monitor their intuitive thinking does not seem to be effective for improving diagnostic accuracy. Rapid and intuitive recognition of patterns is an important part of the diagnostic process, particularly in cardiology, and constraining this activity does not seem to be a good strategy. The diagnostic process, however, does allow the opportunity to reflect on the particular features of the diagnostic encounter. Clinicians often ask, “What am I missing? What else could this be?” For tough cases, consciously acknowledging the difficulty of a diagnostic challenge increased accuracy.9495 Experienced surgeons seem to know when to slow down at critical moments.96
Mobilizing knowledge through deliberate reflection is a promising technique for improving diagnostic accuracy.979899100101 Reflecting on the concordant and discordant features between the patient and the various diagnostic hypotheses offers an opportunity for mid-course correction. Deliberate reflection enables clinicians to overcome distracting and misleading features of a case but requires that the clinician have adequate experience and sufficient clinical knowledge about the diversity of diagnostic features. This has been demonstrated elegantly in a more recent experimental study by these authors.102 They showed that physicians can be immunized against availability bias through an intervention that increased their knowledge about the features that can discriminate between similar looking diseases. Of course, the strategy of deliberate reflection also requires recognition that an initial diagnostic impression may be unsettled and needs further reflection. Experimental studies have shown that clinicians’ diagnostic confidence correlates fairly well with diagnostic accuracy and that the correlation improves with experience, but overconfidence is likely a persistent problem and a potential impediment to the optimal use of deliberate reflection.94103
Checklists have been promoted as tools for improving diagnostic accuracy.104 Checklists can be classified as either content specific tools that trigger the retrieval of relevant disease specific knowledge or process focused tools that guide adherence to optimal thinking.105 Unfortunately, studies of the effectiveness of checklists have been disappointing.105 Checklists focusing on content tend to show some promise in a few limited experimental studies,106107 but they tend to be more effective for junior clinicians and for more difficult cases.105 Whether experimental studies of checklists are generalizable to the practice setting and whether checklists would be used consistently in the real world setting remain open questions.
Computerized decision support programs have also been promoted for improving diagnostic accuracy but have fallen short of expectations.108109 A review of a limited number of studies suggested some potential benefit for junior clinicians, but uptake of this technology in practice has been very limited.110 In part, this may be a consequence of logistical difficulties with the software platform. A recent study of an electronic differential diagnostic support tool showed that computerized decision support can increase the number of diagnostic hypotheses and the probability that the correct diagnosis would be considered, and the impact was greater for novice clinicians.136
Cognitive forcing strategies for reducing diagnostic error have been studied.7881 Three experimental studies assessed this approach to teach participants to recognize specific cognitive biases and apply such strategies.111112113 These studies showed that cognitive forcing strategies had no effect on diagnostic errors or accuracy. Humans are not capable of consciously recognizing unconscious biases,114115 and that teaching this process would not be successful in reducing errors seems predictable. The task is made more difficult by the fact that more than 100 cognitive biases have been described in the general literature and at least 38 have been described in the medical literature.116 Moreover, as noted earlier, even experts have trouble consistently and correctly identifying specific cognitive biases.91
Notwithstanding difficulties with human introspection, flawed thinking undoubtedly affects diagnostic reasoning. Psychologists have described three general types of fallacies: hasty judgments, biased judgments, and distorted probability estimates.58 General knowledge of these broad categories might help practitioners to develop habits that help them to avoid bias.
A particular concern is implicit bias regarding race, gender, sexuality, and ability, among other factors. The word bias in this context refers to stereotyping, which is “the process by which people use social categories (for example, race, sex) in acquiring, processing, and recalling information about others.” 117 A classic experimental study more than two decades ago showed how race and sex can affect the diagnostic evaluation of chest pain and referral patterns for diagnostic cardiac catheterization.118 Clearly, implicit bias affects diagnostic reasoning, and overcoming this concern should be central to medical education and professional development. Suggested educational strategies for overcoming implicit bias include emphasizing fairness and egalitarian goals, encouraging identification with common identities with patients, counter-stereotyping, and trying to understand the patient’s perspective.119 More research is needed to identify the most successful educational and support strategies for reducing the adverse effects of implicit bias on the quality of diagnostic reasoning.
Educational strategies to improve diagnostic accuracy
Teaching diagnostic competence in cardiology starts with instruction in the basics of history taking, physical diagnosis, interpretation of electrocardiograms, and a variety of other basic diagnostic skills that are prerequisites for making a cardiovascular diagnosis.120121122 Professional societies have formulated expanded lists of competencies that are needed for interpretation of cardiovascular diagnostic tests,123 and these competencies are required for board certification and practice.124
True expertise in cardiovascular diagnosis, however, resides in an ability that is learnt through experience and years of deliberate practice and reflection.125126 The diagnostic expert uses experiential knowledge gained in the context of training in clinical rotations and specialized practice. Experiential knowledge has been described as “a constantly evolving, dynamic resource, and expertise resides in the ability and willingness not only to use and build, but also to purposefully adapt and re-engineer knowledge effectively.”125
Several educators and investigators have recommended a variety of educational strategies for promoting diagnostic excellence.13115125126127128129 The original research in the cognitive science of medical diagnosis was started by educators who were searching for the best way to turn novices into experts.181920 Clearly, knowledge, both formal and experiential, is a critical determinant for accurate diagnostic reasoning.130 That better integration of basic science instruction with clinical experience is a successful strategy for improving diagnostic reasoning is therefore not surprising. Vertical integration of the basic sciences with clinical experience can create cognitive conceptual coherence that seems to improve diagnostic reasoning.131132 This strategy may facilitate the formation of illness scripts and make knowledge more accessible at the time of a diagnostic encounter. This integrative strategy may also make basic science education more compelling and memorable because it is linked to relevant clinical context. Contextualizing basic science to specific clinical situations does not necessarily transfer from one content area to another, which may explain why diagnostic expertise is content specific. Most clinical teaching occurs at the bedside, and clinical teachers of session level education need to be aware of the importance of integrating basic science knowledge with experience. Other educational strategies have been described, but measuring educational outcomes is difficult, and relatively few studies have formally evaluated the effect of educational strategies on learning outcomes or have compared recipients of educational interventions with control groups.130131132
Societies, professional meetings, and journals have been established to promote educational strategies and interventions with the aim of achieving diagnostic excellence.133134135 The idea is that greater awareness of the diagnostic process and attention to the sources of diagnostic error could help clinicians to make the most of their experience, purposefully seek feedback, and be more intentional about avoiding diagnostic error. Physicians seek causal explanations and mechanistic concepts, but teaching abstract cognitive psychology concepts out of context may not be effective. Interleaving these cognitive psychology concepts into content specific continuing medical education could be effective, but strategies to improve diagnostic reasoning through continuing medical education need further study.
This narrative review synthesizes the accumulated research into how experts make a diagnosis and considers the implications for learners, clinicians, and teachers. Application of the cognitive science of diagnostic reasoning should help learners to make the most of their clinical experiences and improve the effectiveness of clinicians and teachers. Effective educational strategies are those that focus on the acquisition and mobilization of knowledge, both experiential and formal. Other educational strategies and interventions are promising but need formal study and careful evaluation. Future research should continue to focus on diagnostic reasoning in the context of cardiovascular medicine and other subspecialties, with the goal of improving the accuracy and reliability of the diagnostic process and the quality of care for our patients.
How can researchers design and evaluate real world interventions to assess the effect of implicit bias on the diagnostic process?
How can teaching of diagnostic reasoning be effectively embedded into subspecialty teaching rotations?
How can artificial intelligence and computerized decision support tools effectively improve the diagnostic process?
One of the authors reached out to a patient who was thrilled that we were working on this narrative review because his life was dramatically affected by the diagnostic process. The patient and his wife read the manuscript and offered useful comments and encouragement.
The patient was referred to one of the authors with an undiagnosed and severe superior vena cava syndrome. The patient and his wife (a nurse) were very frustrated at the time of presentation because he had been extensively evaluated and the cause of his problem remained undiagnosed. A careful history detailed the enabling conditions and the time sequence of his illness, which led to an explanatory diagnostic hypothesis. This hypothesis led to the confirmatory diagnostic testing and effective treatment. This patient is an example of Osler’s adage to “Listen to the patient; he will tell you the diagnosis.” This patient remains an inspiration and a reminder of how an accurate medical diagnosis can have an enormous impact on a patient’s life.
Series explanation: State of the Art Reviews are commissioned on the basis of their relevance to academics and specialists in the US and internationally. For this reason they are written predominantly by US authors
Contributors: All of the authors contributed to all aspects of the preparation of this review. JEB is the guarantor.
Competing interests: We have read and understood the BMJ policy on declaration of interests and declare the following interests: JEB receives royalties from Dementi Milestone Publishing for the book The Science of the Art of Medicine: A Guide to Medical Reasoning.
Provenance and peer review: Commissioned; externally peer reviewed.