Antibiotic prescribing without documented indication in ambulatory care clinics: national cross sectional studyBMJ 2019; 367 doi: https://doi.org/10.1136/bmj.l6461 (Published 11 December 2019) Cite this as: BMJ 2019;367:l6461
- Michael J Ray, doctoral student, researcher12,
- Gregory B Tallman, assistant professor3,
- David T Bearden, clinical professor2,
- Miriam R Elman, biostatistician1,
- Jessina C McGregor, associate professor2
- 1Oregon Health & Science University-Portland State University School of Public Health, Portland, OR 97239, USA
- 2Oregon State University College of Pharmacy, Portland, OR 97201, USA
- 3Pacific University School of Pharmacy, Hillsboro, OR 97123, USA
- Correspondence to: M J Ray @MichaelRayMPH on Twitter) (or
- Accepted 6 November 2019
Objectives To identify the frequency with which antibiotics are prescribed in the absence of a documented indication in the ambulatory care setting, to quantify the potential effect on assessments of appropriateness of antibiotics, and to understand patient, provider, and visit level characteristics associated with antibiotic prescribing without a documented indication.
Design Cross sectional study.
Setting 2015 National Ambulatory Medical Care Survey.
Participants 28 332 sample visits representing 990.9 million ambulatory care visits nationwide.
Main outcome measures Overall antibiotic prescribing and whether each antibiotic prescription was accompanied by appropriate, inappropriate, or no documented indication as identified through ICD-9-CM (international classification of diseases, 9th revision, clinical modification) codes. Survey weighted multivariable logistic regression was used to evaluate potential risk factors for receipt of an antibiotic prescription without a documented indication.
Results Antibiotics were prescribed during 13.2% (95% confidence interval 11.6% to 13.7%) of the estimated 990.8 million ambulatory care visits in 2015. According to the criteria, 57% (52% to 62%) of the 130.5 million prescriptions were for appropriate indications, 25% (21% to 29%) were inappropriate, and 18% (15% to 22%) had no documented indication. This corresponds to an estimated 24 million prescriptions without a documented indication. Being an adult male, spending more time with the provider, and seeing a non-primary care specialist were significantly positively associated with antibiotic prescribing without an indication. Sulfonamides and urinary anti-infective agents were the antibiotic classes most likely to be prescribed without documentation.
Conclusions This nationally representative study of ambulatory visits identified a large number of prescriptions for antibiotics without a documented indication. Antibiotic prescribing in the absence of a documented indication may severely bias national estimates of appropriate antibiotic use in this setting. This study identified a wide range of factors associated with antibiotic prescribing without a documented indication, which may be useful in directing initiatives aimed at supporting better documentation.
Inappropriate prescribing of antibiotics is a major public health problem, as it contributes to antibiotic resistance.12 In the US, medical providers often incorrectly prescribe antibiotics for acute viral respiratory infections, especially during peak influenza season.3456 Antimicrobial therapy is extremely common in US ambulatory care settings,2478910 with an estimated 836 antibiotic prescriptions per 1000 people in 2016. Investigators have shown that more than 30% of antibiotic prescriptions in ambulatory care settings are inappropriate.111213
Programs evaluating antibiotic use depend on the presence of a documented indication in patients’ medical records, as the frequency of inappropriate use is determined by these indications.14 However, this documentation is not universally required, and missing indication data may lead to underestimates of inappropriate antibiotic use.1415 In turn, this hinders antibiotic stewardship and public health efforts, because the extent of the problem is neither measured accurately nor understood completely.
Our objective was to identify the frequency with which antibiotics are prescribed in the absence of a documented indication by using a nationally representative sample of ambulatory clinic encounters to estimate the degree to which previous estimates of appropriate prescribing may have been biased. We also sought to understand the patient, provider, and visit level characteristics associated with antibiotic prescribing without a documented indication.
The National Ambulatory Medical Care Survey (NAMCS) is an annual national survey conducted by the National Center for Health Statistics. It uses a probabilistic sampling framework to obtain a representative sample of office based US physicians.16 Physicians complete an automated survey describing a sample of patients’ visits during a specified reporting period. NAMCS staff abstract additional information from electronic medical records. NAMCS provides more than 1000 variables related to various aspects of a medical visit, including patients’ demographic information, information on the provider, diagnosis and procedure codes, and drug administration.16 We analyzed the 28 332 visits (representing 990.8 million visits across the US) to office based healthcare providers that were sampled in 2015. Complete survey methods and descriptive statistics can be found in the 2015 NAMCS documentation file.16
We included patients with a least one antibiotic prescription in our analyses. NAMCS uses the Cerner Multum Lexicon Plus database to convert information on drugs prescribed to therapeutic drug classes and includes up to 30 drug names for a single office visit.1617 We determined that an antibiotic was prescribed during an in-person office visit if any of the Multum Level 2 category identifiers for antibacterial agents were present.
Classification of antibiotic prescribing indications
To identify indications for antibiotic prescribing, we evaluated encounter diagnosis codes for bacterial infections or other conditions for which antibiotics are frequently prescribed. NAMCS reports up to five ICD-9-CM (international classification of diseases, 9th revision, clinical modification) codes. On the basis of the complete list of ICD-9-CM codes available for each visit in which an antibiotic prescription was reported, we considered the indication to be “appropriate” if any bacterial infection or other condition for which antibiotics are always or sometimes indicated was documented, “inappropriate” if only a condition for which antibiotics are not indicated but are commonly prescribed (for example, upper respiratory tract infection) was documented, or “no documented indication” if neither of the preceding categories was applicable. We adapted these classifications from the three diagnosis tiers previously reported by Fleming-Dutra et al (see appendix).11 Our list was similar to those generated by other research groups examining inappropriate prescribing behaviors.1218
Definitions of other variables
We evaluated several potentially important risk factors for prescription of antibiotics without a documented indication, including patient, provider, and visit level characteristics. We categorized age as under 18, 18 to 64, and 65 years and older. We categorized provider specialty as primary care (general/family medicine, pediatrics, and internal medicine), specialty care in which antibiotics are commonly prescribed (gynecology, urology, dermatology, and otolaryngology), and all other specialties.14 We also assessed seasonal variation (winter, spring, summer, and fall). We identified the presence of chronic disease through the NAMCS survey item “Total number of chronic diseases” (0-12) and then dichotomized the variable (0 v ≥1 chronic conditions).
All analyses accounted for the complex survey design by using variables provided by NAMCS. We calculated patient, provider, and visit level characteristics as weighted percentages and 95% confidence intervals stratified by whether antibiotics were prescribed with an appropriate, inappropriate, or missing indication.16 We used Rao-Scott χ2 tests to test for heterogeneity. Although our main interest was records that lacked a documented indication, we presented results for prescriptions that were written with an inappropriate indication for comparison.
We built a multivariable survey weighted logistic regression model to identify risk factors associated with antibiotic prescriptions with no documented indication. Variables with a P value of less than 0.15 in bivariable analyses were assessed for inclusion in the multivariable model, as was an interaction term for age and sex based on our previous findings.19 We did backward selection and retained variables that significantly (P<0.05) contributed to the model, along with age, sex, geographic region, and pre-surgery visit status, which we chose a priori as potential confounders. We generated stratum specific odds ratios and corresponding 95% confidence intervals by using the significant interaction term from the final model. We used SAS 9.4 for analyses and generated figures with R.
Patient and public involvement
This research was completed without patient involvement. Patients were not invited to comment on the study design and were not consulted to interpret the results. Patients were not invited to contribute to the reporting of our findings.
An estimated 990.8 million ambulatory care visits to office based healthcare providers took place in 2015, as reported by NAMCS (fig 1). Of those visits, approximately 130 million (13.2%, 95% confidence interval 11.6% to 13.7%) involved receipt of an antibiotic prescription and were included in our study. An average of 2.6 diagnosis codes were documented per visit (median=2), and 17% (14% to 20%) of visits had the maximum number of diagnosis codes (five codes) available in the dataset.
Prescribing without documented indication
Among included visits (130.5 million estimated), we deemed 57% (52% to 62%) of indications for antibiotic prescription to be appropriate according to our criteria and 25% (21% to 29%) to be inappropriate; 18% (15% to 22%) lacked either an appropriate or an inappropriate documented indication (fig 1). This corresponds to an estimated 23.7 million antibiotic prescriptions without a documented indication in 2015. The most common diagnoses reported among the no indication group were unspecified essential hypertension (401.9: 11%, 7% to 16%), diabetes mellitus without mention of complication (250.00; 8%, 4% to 13%), and other specified aftercare (V58.89; 7%, 1% to 14%). No other codes were present in more than 5% of “no indication” visits. We observed no clear difference in prescribing without an indication across seasons (P=0.58; fig 2).
Patients who received antibiotics were more likely to be male (61%) and non-Hispanic white (58%), compared with those who did not. The median age was 47 years. In bivariable comparisons, several patient level characteristics were significantly associated with receipt of an antibiotic prescription without an indication (table 1). Twenty per cent of adults aged 18-64 and 22% of those aged 65 years and older received antibiotics without a documented indication, compared with 8% of patients under 18 years (table 1). Chronic conditions were also associated with more prescribing without an indication (22% for patients with a chronic condition versus 14% for those without). Patients with Medicare or Medicaid insurance seemed to have a higher proportion of prescriptions without an indication (21% on Medicare/Medicaid versus 16% for those with private insurance), but differences were not statistically significant in bivariable analysis. We observed no apparent differences by race/ethnicity.
In bivariable analysis (table 1), primary care providers had a significantly lower percentage of antibiotic prescriptions without a documented indication (12%), compared with other specialists who commonly prescribe antibiotics (24%), as well as those in all other specialties (29%). We observed no difference between solo and group practitioners (data not shown), but differences existed according to practice ownership. Insurance company or health maintenance organization (HMO) affiliated offices had a lower proportion (12%) of prescriptions without an indication than did offices owned by a physician or group of physicians (19%) or academic health centers (21%) (table 1).
Characteristics of visits
In bivariable analyses (table 1), prescribing without a documented indication was significantly less frequent when a patient received the prescription from his or her designated primary care physician (14%) compared with another provider (23%). Patients who spent less time with a physician were less likely to receive an antibiotic without indication (15% for those with shorter visits versus 21% with longer visits). When a microbiology culture (blood, urine, throat, or other) was collected during a visit, 5% of prescriptions lacked an indication compared with 20% in the absence of a culture. No clear difference in indications by antibiotic class was apparent (table 1 and fig 3). Among all prescriptions without a documented indication, 22% were for quinolones, 14% for macrolides, 13% for penicillins, and 13% for cephalosporins. No clear differences in prevalence of indication by day of the week were apparent (data not shown).
Table 2 shows the results of our multivariable logistic regression analysis. We identified a significant interaction between age group and sex. Adult men (18 years and older) were more likely to receive an antibiotic prescription without a documented indication than were male patients under 18 years (adjusted odds ratio 2.3, 95% confidence interval 1.0 to 5.3); however, these age groups did not differ significantly for female patients. Specialties that frequently prescribe antibiotics and all other specialties were twice as likely to prescribe antibiotics without an indication than were primary care physicians. Longer visits were associated with an almost twofold increase in the odds of prescribing without a documented indication compared with shorter visits. For visits with a blood, urine, or throat culture, clinicians were much less likely to prescribe without an indication compared with visits at which no culture was taken (adjusted odds ratio 0.2, 0.1 to 0.4). Sulfonamides and urinary anti-invectives were more likely to be prescribed without an indication than were penicillins, which had the highest prevalence of antibiotics with a documented indication.
We observed that approximately 24 million US ambulatory care visits with antibiotic prescriptions lacked a documented indication in 2015. Taken with the 32 million prescriptions that we identified as inappropriate, as many as 43% of prescriptions in our dataset were potentially inappropriate. Without evidence of an indication, the appropriateness of these prescriptions cannot be ascertained. Potentially compounding the high rates of inappropriate antibiotic prescribing, the magnitude of antibiotic prescriptions without a documented indication poses a barrier to antimicrobial stewardship and public health efforts intended to evaluate and improve antibiotic prescribing in ambulatory care settings. Several studies have estimated the prevalence of antibiotic prescribing,7112021 or examined inappropriate prescribing for upper respiratory tract infections,3458 but these estimates have typically relied on documented diagnosis codes to classify the appropriateness of antibiotic prescribing. The primary objective of this study was to highlight the potential degree of misclassification that may occur due to under-coding. Unnecessary antibiotic prescriptions represent an important target for antimicrobial stewardship efforts in ambulatory care settings. Our work complements previous work in this area by assessing the potential effect that prescribing without a documented indication may have on the estimated burden of unnecessary antibiotic use.
Our study is among the first to examine factors associated with antibiotic prescriptions with a lack of documented indication. We identified both patient and provider level characteristics associated with a greater likelihood of antibiotic prescribing without documentation of an indication. Adult male patients were significantly more likely than younger male patients to receive an antibiotic prescription without documentation of the indication in their medical record. Visits with specialty care providers who frequently prescribe antibiotics were also significantly less likely to provide a coded indication than were primary care providers. Sulfonamides and urinary anti-infectives had a higher proportion of missing indications than did penicillins. Among recipients of urinary anti-infectives, 9% had ICD-9-CM codes indicating non-specific urinary symptoms (for example, dysuria, urinary frequency, incontinence, urgency) that could potentially indicate urinary tract infection but were not considered a possible indication in our analysis. Although this provides some insight into the possible indication for these antibiotics, it represents only 0.6% of the total prescribing without a documented indication.
By identifying factors associated with prescribing without a documented indication, we can better inform antimicrobial stewardship and public health interventions. For example, Meeker et al found that requiring primary care clinicians to enter free text justifications when ordering antibiotics lowered rates of inappropriate prescribing.2223 Similar strategies may benefit ambulatory specialty care clinics. Our findings suggest that improving coding practices in non-primary care practice settings could facilitate accurate assessments of the appropriateness of antibiotic prescribing.
Limitations of study
Because our study used nationally representative survey data, our results are highly generalizable to the US population. However, several limitations should be noted. Only the first five ICD-9-CM codes documented in the health record were included in the survey data. Thus, we were not able to ascertain whether indications would have been present if additional codes were available or documented in providers’ notes. In the event that all 17% of visits with no indication with the maximum number of ICD-9-CM codes reported were misclassified (that is, an indication would have been identified if additional codes were reported), 15% (95% confidence interval 12% to 18%) of visits associated with an antibiotic prescription would still lack a documented indication. In other words, at best, only an additional 3% of prescriptions could be evaluated for appropriateness if more than five diagnosis codes were available. We were also unable to identify prescriptions for anticipated future use, such as for travel. Finally, to be included in the NAMCS dataset, the patient must have made an in-person visit to an ambulatory care facility, and we were unable to assess the appropriateness of any prescriptions provided as part of virtual or telephone encounters. Retail health clinics have also emerged as a major source of antibiotic prescribing, especially for acute respiratory illness.24 The increasing trend of antibiotic prescribing via telemedicine and the prevalence of non-prescription antibiotic use are additional areas to examine for inappropriate use of antibiotics.2526
An additional limitation involves the cross sectional study design, which prevented the use of the patient’s history of the present illness in exploring possible indications. We found that 60% of antibiotic prescriptions without documentation were documented as continuing (versus new) compared with 24% of appropriate prescriptions. Among those with all five codes and no documented indication, half of the major reasons for the visit were chronic problems (31% for routine and 21% for flare-up). Although the indication for the prescribed antibiotic might have been documented during a previous visit, the lack of documentation at the time of prescribing poses a challenge to ongoing efforts to evaluate appropriateness. These results point to a recurring theme whereby prescription of an antibiotic may be warranted but, owing to the lack of documented indication, we cannot be certain.
Conclusions and public health implications
We identified a large number of ambulatory visits in which antibiotics were prescribed without a documented indication in this nationally representative survey. Antibiotic prescribing in the absence of a documented indication may severely bias national estimates of appropriate antibiotic use in this setting and misinform antimicrobial stewardship efforts. Our study identified several independent risk factors for antibiotic prescribing without a documented indication; these may be useful in directing initiatives aimed at improving documentation. With 60% of antibiotic expenditure and up to 90% of antibiotic use originating in ambulatory care settings,27282930 more focus is needed to support well informed stewardship efforts beyond the hospital.
What is already known on this topic
Previous studies have identified a high degree of unnecessary antibiotic prescribing in the ambulatory care setting as an important target for antibiotic stewardship
Studies examining the appropriateness of antibiotic prescribing rely on documentation of the indication for the antibiotic
Few studies to date have examined the proportion of antibiotic prescriptions that lack a documented indication
What this study adds
Of 130.5 million antibiotic prescriptions estimated by a nationally representative survey for 2015, 18% (approximately 24 million) lacked a documented indication
Being an adult male, having at least one chronic disease, spending more time with a provider, and seeing a non-primary care specialist were positively associated with prescribing without indication
Receipt of a prescription for sulfonamide or a urinary anti-infective was also associated with absence of a documented infection
Contributors: MJR and JCM designed the study. GBT and MRE assisted with data preparation and analysis. MJR analyzed and interpreted the data. JCM supervised the study. GBT and DTB provided clinical expertise. MJR drafted the manuscript. MJR, GBT, DTB, MRE, and JCM critically revised the manuscript. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. MJR is the guarantor.
Funding: This was an unfunded project.
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organization for the submitted work; JCM has received grants from Merck, Agency for Health Care Research and Quality (AHRQ), and Centers for Disease Control and Prevention (CDC) outside the submitted work; MRE has received grants from the AHRQ, CDC, Society for Infectious Diseases Pharmacists, and Oregon State University outside the submitted work; no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Owing to the use of publicly available data, no institutional review board approval was necessary.
Data sharing: The data used in this study are publicly available from the US National Center for Health Statistics
Transparency: The lead author (the manuscript’s guarantor) affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.