Intended for healthcare professionals

CCBYNC Open access
Research

Behavioral interventions to improve population health outreach for hepatitis C screening: randomized clinical trial

BMJ 2021; 373 doi: https://doi.org/10.1136/bmj.n1022 (Published 18 May 2021) Cite this as: BMJ 2021;373:n1022
  1. Shivan J Mehta, assistant professor of medicine1 2,
  2. Susan C Day, professor of clinical medicine1,
  3. Anne H Norris, associate professor of clinical medicine1,
  4. Jessica Sung, clinical research coordinator1 2,
  5. Catherine Reitz, project manager1 2,
  6. Colin Wollack, senior application analyst3,
  7. Christopher K Snider, senior data analyst2,
  8. Pamela A Shaw, associate professor of biostatistics4,
  9. David A Asch, John Morgan professor1 2 5
  1. 1Department of Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
  2. 2Center for Health Care Innovation, University of Pennsylvania, Philadelphia, PA, USA
  3. 3Information Services, Penn Medicine, University of Pennsylvania, Philadelphia, PA, USA
  4. 4Department of Clinical Epidemiology, Biostatistics, and Informatics, University of Pennsylvania, Philadelphia, PA, USA
  5. 5Center for Health Equity Research and Promotion, Philadelphia VA Medical Center, Philadelphia, PA, USA
  1. Correspondence to: S J Mehta, 14-174 PCAM South Tower, 3400 Civic Center Boulevard, Philadelphia, PA, USA shivan.mehta{at}pennmedicine.upenn.edu
  • Accepted 14 April 2021

Abstract

Objective To evaluate whether opt out framing, messaging incorporating behavioral science concepts, or electronic communication increases the uptake of hepatitis C virus (HCV) screening in patients born between 1945 and 1965.

Design Pragmatic randomized controlled trial.

Setting 43 primary care practices from one academic health system (Philadelphia, PA, USA) between April 2019 and May 2020.

Participants Patients born between 1945 and 1965 with no history of screening and at least two primary care visits in the two years before the enrollment period.

Interventions This multilevel trial was divided into two studies. Substudy A included 1656 eligible patients of 17 primary care clinicians who were randomized in a 1:1 ratio to a mailed letter about HCV screening (letter only), or a similar letter with a laboratory order for HCV screening (letter+order). Substudy B included the remaining 19 837 eligible patients followed by 417 clinicians. Active electronic patient portal users were randomized 1:5 to receive a mailed letter about HCV screening (letter), or an electronic patient portal message with similar content (patient portal); inactive patient portal users were mailed a letter. In a factorial design, patients in substudy B were also randomized 1:1 to receive standard content (usual care), or content based on principles of social norming, anticipated regret, reciprocity, and commitment (behavioral content).

Main outcome measures Proportion of patients who completed HCV testing within four months.

Results 21 303 patients were included in the intention-to-treat analysis. Among the 1642 patients in substudy A, 19.2% (95% confidence interval 16.5% to 21.9%) completed screening in the letter only arm and 43.1% (39.7% to 46.4%) in the letter+order arm (P<0.001). Among the 19 661 patients in substudy B, 14.6% (13.9% to 15.3%) completed screening with usual care content and 13.6% (13.0% to 14.3%) with behavioral science content (P=0.06). Among active patient portal users, 17.8% (16.0% to 19.5%) completed screening after receiving a letter and 13.8% (13.1% to 14.5%) after receiving a patient portal message (P<0.001).

Conclusions Opt out framing and effort reduction by including a signed laboratory order with outreach increased screening for HCV. Behavioral science messaging content did not increase uptake, and mailed letters achieved a greater response rate than patient portal messages.

Trial registration ClinicalTrials.gov NCT03712553.

Introduction

The hepatitis C virus (HCV) has historically been the leading cause of liver transplant and hepatocellular carcinoma in the United States.12 Direct acting antivirals can result in sustained virologic response in more than 95% of those treated with minimal side effects, but the benefits of treatment are limited by several patients with undiagnosed HCV.34 National guidelines recommend HCV screening for all patients born between 1945 and 1965 because of the higher prevalence in these birth cohorts, and screening tests are covered with no cost sharing.56 Many states in the US have mandated offering HCV testing to all eligible outpatients,7 including Pennsylvania where this study was based.8 However, screening rates in this group remain low and variable across practices,91011 possibly because many patients do not routinely see their primary care clinician, and there could be competing priorities at appointments. Screening might be increased by complementing efforts in clinic with direct outreach to patients’ homes, which has been incorporated into other population health initiatives.121314 Electronic patient portals that allow patients to send and receive messages securely have proliferated across health systems as a low cost alternative to mailed letters for outreach.

Recent insights from behavioral science reveal that humans have predictable biases, such as status quo bias, and interventions that leverage the same biases can be used to promote healthy behaviors.15161718 For example, changing decisions from opt in to opt out framing can nudge patients toward preventive health activities while maintaining patient autonomy.1920212223 The conventional opt in approach implies that the default is for the patient to not participate, while opt out framing suggests that the status quo is for the patients to participate in the health promoting activity. Messaging that incorporates social norms, anticipated regret, reciprocity, and commitment has increased energy conservation, cancer screening, workplace performance, and vaccination rates.2425262728 Similar approaches might advance HCV screening.

We used the Pennsylvania mandate for population HCV screening as motivation to improving screening outreach by simultaneously comparing several approaches: opt out versus opt in; electronic patient portal messaging versus mailed outreach; and messaging that incorporates behavioral science principles versus standard messaging.

Methods

Study design

This was a multilevel, pragmatic, randomized clinical trial divided into two concurrent studies to evaluate behavioral interventions to increase uptake of HCV screening through outreach to patients (fig 1). In substudy A, eligible patients were randomly assigned to a traditional mailed letter signed by the primary care clinician describing the importance of and eligibility for HCV screening; or a mailed letter with similar messaging and a laboratory requisition for HCV antibody testing.

Fig 1
Fig 1

CONSORT (consolidated standards of reporting trials) flow diagram. Lab=laboratory; PCP=primary care provider

Substudy B was a separate, patient level randomized trial among the remaining eligible patients that used a factorial design. Among patients who used the electronic patient portal, we compared electronic communication with mailed letters. Among all patients in substudy B, we concurrently compared standard messaging about HCV screening with messaging informed by concepts from behavioral science, such as social norming, anticipated regret, reciprocity, and commitment.

The study was approved by the institutional review board at the University of Pennsylvania. A waiver of informed consent was obtained because the study was minimal risk to patients and could not have been practicably carried out without the waiver.29 The protocol and statistical analysis plan appear as an online supplement, and the protocol was registered at ClinicalTrials.gov (NCT03712553).

Study population

We identified all patients from our electronic health records who fulfilled the following criteria: patients had at least two visits in the past two years at a primary care practice in the Philadelphia region at the University of Pennsylvania with an active primary care clinician; they were born between 1945 and 1965 and had no history of an HCV antibody test or viral load; they had no record of previously declining screening. The practices are part of an academic health system affiliated with the University of Pennsylvania. The baseline HCV screening rate across the primary care population was 61%. Because this was a pragmatic, population based study, all identified patients were included with no additional exclusions.

Interventions

The health system employed 434 primary care clinicians in the Philadelphia region, 79 of whom had 35-250 eligible patients. Because substudy A initially involved cluster randomization at the clinician level, this range was determined to minimize variability of patient panels. Those 79 clinicians were invited to participate in substudy A through electronic mail, and 17 of them agreed to participate, with a combined eligible patient panel of 1656. The remaining 417 clinicians were included in substudy B, and informed of the study and the outreach to their patients taking place on their behalf (including the use of their electronic signature).

Patients of the 17 clinicians in substudy A were randomized to two study arms in a 1:1 allocation ratio, stratified by provider, using a computerized random number generator. Patients in arm A1 (letter only) received a mailed letter signed by their primary care clinician describing the importance of HCV screening, their eligibility for screening, and instructions to contact their clinician for an HCV screening test. Patients randomized to arm A2 (letter+laboratory order) received a mailed letter with similar messaging and a signed laboratory requisition for HCV antibody screening. Participants in this arm were directed to take the laboratory requisition to the laboratory of their choice to complete their test. Laboratory requisitions were generated through bulk ordering in the electronic health records for all patients in this arm, with a physician member of the research team as the ordering provider and the primary care provider as the authorizing clinician.

All completed test results for patients in study arm A2 were routed from the electronic health record to the primary care clinician and the study team. The study team sent letters to patients with negative results, which were electronically signed by their physician. Positive results within the A2 arm were sent to primary care clinicians through a message in the electronic health records so that they could help with care coordination and follow-up. Because completed test results in study arm A1 were ordered by the primary care provider, they were routed and communicated according to routine practice. We initially planned to cluster randomize at the clinician level, but changed to individual level randomization (March 2019) to gain more power. Because this intervention was mainly directed at patients’ homes without the need for an office visit, we did not anticipate much contamination at the clinician level.

The remaining 417 primary care clinicians accounted for 19 837 patients eligible for HCV screening, who were included in substudy B. We identified patients as active portal users if they had read or sent at least one secure patient portal message in the previous 12 months; patients were inactive if they did not have a patient portal account or had not used their account in the previous 12 months. Fifty nine per cent of patients in the trial were active portal users and were randomized in a 1:5 allocation ratio by using a computerized random number generator to receive a mailed letter or a patient portal message. This ratio was chosen to minimize the resources needed to print and mail letters.

In a factorial design, all patients in substudy B were also randomized in a 1:1 ratio to receive standard messaging or messaging based on principles of behavioral science. Active patient portal users who were randomized to receive a mailed letter were further randomized in a 1:1 ratio to receive standard messaging (arm B1—usual care letter) or messaging based on principles of behavioral science (arm B2—behavioral content letter). Active patient portal users who were randomized to receive an electronic communication were further randomized in a 1:1 ratio to receive standard messaging (arm B3—usual care patient portal) or messaging based on principles of behavioral science (arm B4—behavioral content patient portal). Inactive patient portal users were randomized in a 1:1 ratio to receive a mailed letter with the standard messaging (arm B5—usual care letter) or messaging based on behavioral science (arm B6—behavioral content letter). All participants in substudy B were directed to contact their primary care clinician for an HCV screening test.

Behavioral content messaging was similar to that of usual care and incorporated four concepts from behavioral economics: social norming (“Here’s a chance to join the majority of others at Penn Medicine who have been screened for Hepatitis C”), anticipated regret (“We don’t want you to develop liver disease that could have been prevented with earlier testing”), reciprocity (“Help us achieve our goal of having 100% of patients screened at Penn Medicine”), and commitment (“Write down a date by when you will get your screening done”).

The large, population based pragmatic design allowed the testing of three hypotheses simultaneously (fig 1): opt in or opt out—a preordered test will be superior to traditional outreach (A1 v A2); mode—electronic messaging will be superior to mailed outreach (B1+B2 v B3+B4); and content—messaging that incorporates behavioral science principles will be superior to standard messaging (B1+B3+B5 v B2+B4+B6).

For all study arms, patients with no screening result within two months from the date of initial outreach received a reminder outreach through the same communication mode and with the same content as the initial outreach, including a copy of the laboratory requisition for patients in arm A2. The investigators were blinded to patient data and randomization, but the research staff were not blinded because they were administering the interventions.

Study outcomes

The primary outcome was the proportion of patients who completed HCV antibody testing within four months of initial outreach. The secondary outcome was the proportion who completed HCV antibody testing within 12 months. Additional outcomes included the proportion of HCV screening tests ordered, the proportion of tests positive, the proportion with detectable viral load, and referral rate and receipt of HCV treatment. Data were obtained from the electronic health records through automated data extraction and chart review if necessary for verification.

Statistical analysis

Because of the pragmatic design, our power calculations were based on the population of eligible patients in each substudy and meaningful differences to justify implementation of the interventions. We estimated that usual care messaging alone (letter only) would result in a 5% response rate based on findings from other screening outreach activities.2030 Our power calculation was based on cluster randomization, but we changed to patient level randomization before enrollment. Recruiting at least 10 clinicians with between 35 and 250 eligible patients, we estimated at least 1160 eligible patients (from preliminary data extraction). This population would provide 90% power to detect a 5 percentage point increase in response rate in the letter+laboratory order arm (A2) compared with the letter only arm (A1) using the χ2 test of proportions and intention-to-treat protocol, and considering a two sided P value less than 0.05 as statistically significant. This increase would justify investment by a health system in sending out laboratory orders.31 For substudy B, we estimated 26 162 remaining patients across the health system based on a preliminary data extraction. This population would provide approximately 90% power to detect an increase in response rate of 0.9 percentage points for the behavioral content arms (B2+B4+B6) compared with a 5% response rate in the usual content arms (B1+B3+B5). Changing the messaging should have no additional cost, so any small increase would be important to detect. Of those remaining patients, we estimated that 15 959 (61%) would be active patient portal users. With a 1:5 randomization ratio of letter to patient portal (approximately 2659 receiving letters and 13 300 receiving portal messages), we estimated approximately 90% power to detect an increase in response rate of 1.6 percentage points for the patient portal arms (B3+B4) compared with the letter arms (B1+B2). While this increase is modest, when applied to larger populations at scale, it would result in a large change in HCV screening uptake. We did not anticipate an interaction between messaging and mode of communication. The final number of enrolled patients was lower than prespecified estimates because of changes in screening over time and edits to the data pull to more accurately exclude patients who had already been screened for HCV.

We performed prespecified subgroup analyses for the primary outcome by patient portal user status, sex, race or ethnicity, age, and income. Race or ethnicity was based on self-reported data in the electronic health record. Household income was estimated using the American Community Survey 2013-2017 5-year estimates data for median income by zip code of residence. For the purposes of these analyses, age and income were categorized into quarters. We also tracked screening completion for the 12 month time period. All analyses were performed in Stata version 15.0 (Stata Corp, College Station, TX).

Patient and public involvement

Because this was a time sensitive health system imperative, we were not able to include patients or the public in the design, conduct, reporting, or dissemination plans of our research.

Results

Patient characteristics

A total of 21 493 patients were randomized; 190 (0.9%) were excluded mainly because of death or an inability to deliver a mailing or portal message, leaving 21 303 in the intention-to-treat analysis (fig 1). The mean age was 63 years (standard deviation 6 years); 55% were women, 66% had commercial insurance, and 31% were insured by Medicare. About 80% of patients were white, 12% were black, and 4% were Hispanic or Latino (table 1). Median household income was $87 019 (£62 680, €71 920; interquartile range $68 785-97 602). The intervention was conducted from April 2019 to May 2020, when the 12 month follow-up was completed for all participants.

Table 1

Personal characteristics by substudy. Data are numbers (%) unless indicated otherwise

View this table:

Screening response

At four months from initial outreach, of the 1642 patients in substudy A, 19.2% (95% confidence interval 16.5% to 21.9%) completed screening in the letter only (A1) arm and 43.1% (39.7% to 46.4%) in the letter+laboratory order (A2) arm (absolute difference 23.9%, 95% confidence interval 19.6% to 28.2%, P<0.001; table 2).

Table 2

Hepatitis C virus antibody screening at four months

View this table:

Among the 19 661 patients in substudy B, 14.6% (13.9% to 15.3%) completed screening with usual care content and 13.6% (13.0% to 14.3%) with behavioral science content (absolute difference −1.0%, −1.9% to 0.0%, P=0.06). Among the 11 395 active patient portal users in substudy B, 17.8% (16.0% to 19.5%) completed screening after receiving letters and 13.8% (13.1% to 14.5%) after receiving patient portal messages (absolute difference −4%, −5.8% to −2.1%; P<0.001). In a post hoc multivariable regression analysis among patient portal users, we found no significant interaction between letter content and mode of communication (P=0.99). When accounting for two comparisons in substudy B (P value threshold of 0.05/2=0.025 with Bonferroni correction), the statistical significance remained the same.

The results for the main outcomes were similar when patients were followed for 12 months after the intervention (table 3). We did not find any differences in office visits across the different comparator groups at four months (supplementary table 1). Among all patients in the study, those who had no office visits in the four months after initial outreach had a 6.3% screening rate (691/11 017) while those with one or more visits had a 25.2% screening rate (2594/10 286).

Table 3

Hepatitis C virus antibody screening at 12 months

View this table:

Screening outcomes

A total of 4611 HCV antibody tests were ordered in the four month outreach period, and 3285 (15.4%) patients received HCV antibody screening; 45 (1.4%) were antibody positive and 14 (0.4%) were viral load positive (table 4).

Table 4

Hepatitis C virus test results and follow-up activity. Data are numbers of participants

View this table:

By 12 months, a total of 8649 HCV antibody tests were ordered, and 6365 (29.9%) patients received HCV antibody screening. Of those, 87 (1.4%) were antibody positive and 24 were found to be viral load positive. Twenty three patients (0.4%) were referred for treatment. Based on chart review from the electronic health record, to date, 11 patients have started treatment with direct acting antiviral therapy, five have had sustained virologic response, and three have completed treatment and are awaiting final viral load testing.

Subgroup analyses

The results of the study comparisons were consistent across subgroup characteristics, including sex, age, race, and income (supplementary tables 2-4), although we were not powered to detect differences by subgroup. Black patients in substudy B showed an 11.2% increase in response to mailed letters compared with patient portal messages (supplementary table 4). In substudy B, 15.2% of active patient portal users participated in screening with usual care messaging, and 13.8% with behavioral messaging.

Cost analysis

We estimate that the cost of sending each letter was approximately $0.78 for the printing and postage. The number needed to screen for the mailed letter compared with the patient portal message at four months was 1/0.04=25 (number needed to screen=1/absolute difference in response rate). Therefore, it costs approximately 25×$0.78=$19.50 for each additional patient screened when sending letters. The cost of sending the laboratory slip was approximately $0.17 in addition to the cost of mailing the letter. The number needed to screen for the laboratory slip compared with the mailed letter alone was 1/0.239=4.2. Therefore, it costs approximately 4.2×$0.17=$0.71 per additional patient screened when sending the laboratory slip.

Discussion

Principal findings

This pragmatic trial has three specific findings. Firstly, an opt out approach involving a signed laboratory order with mailed outreach doubled participation in HCV screening compared with the conventional approach of suggesting patients contact their primary care clinicians. Secondly, among active users of patient portals, mailed letters achieved a better screening response than digital communication. Thirdly, message content enhanced with principles of behavioral science did not increase screening rates. This trial also has one general finding, which is that population based health initiatives offer health systems the opportunity to rigorously test alternative approaches that might be useful elsewhere.

The simple act of sending the signed laboratory order with the mailed outreach resulted in the most dramatic increase in HCV screening. Several reasons might explain this finding. The traditional method for patient outreach is an opt in approach; patients have to actively choose to participate by contacting the primary care clinician or practice directly. Sending the signed laboratory order implies that the default is participation and eliminates the steps required for patients who want to participate but might have busy schedules; similar results have been seen in cancer screening and HIV testing.202122 This approach is additionally facilitated by bulk ordering enabled by electronic health records, which allows a large number of orders to be signed with just a few clicks and reduces the workload of primary care providers. This approach aligns with the behavioral science principle of making the best choice the easy choice.22 A randomized trial at an academic medical center in 2013 showed that repeated mailed outreach with a laboratory form and up to four mailing reminders resulted in 27% of patients being tested for HCV compared with 1% in the control group with no outreach.31

Mailed letters resulted in a 4 percentage point increase in screening response compared with electronic patient portal messaging. This result competes with the conventional approach of using electronic messages whenever feasible—an approach driven in part by lower costs but also by an intuition that those who use digital communication channels prefer them. Our results suggest that even among digital users, mailed letters are more motivating, which has been shown in other contexts.3233 The increased response rate to mailed letters should be balanced by the higher incremental cost, which we found to be $19.50 for each additional patient screened. Interestingly, it only cost $0.17 per additional patient screened to add the signed order to the mailed letter. Future studies could send letters to patients who do not respond to an electronic message or could determine whether an order slip added to a patient portal message might increase uptake.

We can only speculate why the behavioral science content resulted in a similar response rate as standard messaging. Firstly, many of the behavioral science principles we included were studied in different populations and contexts. Secondly, our messaging invoked behavioral principles that have been shown to work in isolation, but their effect in combination is not clear. Thirdly, the behavioral content messages were substantially longer than the usual care content. The net result might have been distraction because previous studies have shown a reduced response rate to longer surveys.3435 Our subgroup analysis revealed that the patient portal group had a greater reduction in response for behavioral content.

Among the 3285 patients newly screened in our study, only 0.4% were viral load positive, which is lower than the 1.0% prevalence from a 2013 study.31 The lower yield could reflect the success of past efforts to encourage HCV screening among those with risk factors or the relatively affluent population of eligible patients in this study.36 The baseline HCV screening rate across our population was 61% before outreach, which is comparable to other successful interventions37 and substantially higher than national rates. Interestingly, the rate of viral load positivity among screened patients who did not have patient portal access was 1.0%, suggesting this population might be at higher risk. Further research is needed for these approaches in other clinical populations.38

Strengths and limitations of this study

The strengths of this study are the prospective design and individual level randomization. This was a pragmatic trial embedded in a naturalized clinical setting across a diverse network of primary care practices with minimal patient exclusions. A central finding of this study is that multiple important clinical research questions can be answered by embedding prospective randomization with factorial design into the day-to-day operations of a functioning health system.2939 Additionally, the results were consistent when we followed outcomes for 12 months after the intervention.

This trial was limited to one academic health system, so the results might not be generalizable to other populations. For example, the patients who were eligible for this trial were more likely to have higher income and live in suburban areas. However, the 43 practices were diverse in patient population, geography, and practice operations. We did not find any difference in response to the interventions by sex, age, race, and income. Additionally, the end of the 12 month follow-up time frame coincided with the covid-19 pandemic, which could have decreased response rate. However, most of the patients screened did so early after the intervention and all arms had higher response rates than we anticipated, probably because of the attention provided by the state mandate and communication from this trial. Finally, the sample size of the study was smaller than originally anticipated, which reduced the power to detect smaller differences in screening response that might be clinically meaningful.

Conclusions

In this study, we showed how a pragmatic trial embedded in clinical operations revealed that opt out framing and effort reduction can substantially improve uptake of hepatitis C screening and other population health initiatives. While state mandates focus on offering screening to eligible patients, additional efforts to understand barriers to screening uptake and behavioral insights to target these barriers are needed to ensure that more patients receive testing. This focus is particularly important because guidelines are changing to recommend screening for all adults aged between 18 and 79.40 Future efforts could focus on a combination of more intensive outreach and reducing barriers to screening through engagement in clinic and at home.414243

What is already known on this topic

  • Hepatitis C virus screening rates remain low, despite recommendations to screen patients born between 1945 and 1965

  • Concepts from behavioral science such as opt out framing, effort reduction, social norming, and commitment have been shown to increase healthy behavior in other contexts

What this study adds

  • Opt out framing and effort reduction by including a signed laboratory order with outreach increased screening uptake

  • Behaviorally informed messaging content did not increase screening uptake

  • Mailed letters achieved a greater response rate than electronic patient portal messages

Footnotes

  • Contributors: SJM, SCD, AHN, CR, PAS, and DAA contributed to the planning of the study. SJM, SCD, AHN, JS, CR, CW, CKS, and DAA contributed to the conduct of the study. All authors contributed to the reporting of the study. SJM is responsible for the overall content as guarantor. SJM takes responsibility for the integrity of the data and the accuracy of the data analysis and the conduct of the study, had full access to all the data, and controlled the decision to publish. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

  • Funding: This trial was funded by the University of Pennsylvania Health System. SJM’s time was supported by grant No K08CA234326 from the National Cancer Institute of the National Institutes of Health. The funders had no involvement in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: support from the University of Pennsylvania Health System for the submitted work; DAA owns stock in Berkshire Hathaway, is a partner in and part owner of VAL Health, and has received compensation and/or travel support for speaking, writing, or consulting from the following organizations: Salzburg Global Seminars, GSK, JFK Health System, Cosmetic Boot Camp, Meeting Designs, Capital Consulting, Healthcare Financial Management Association, Joslin Diabetes Center, National Academy of Medicine, the Commonwealth Fund, Massachusetts Medical Society, Endocrine Society, Osteoarthritis Research Society International, Baystate Medical Center, Weill-Cornell Medical College, Association of American Medical Colleges, TED MED, National Alliance of Health Care Purchaser Coalitions, Deloitte, Harvard University, American Association for Physician Leadership, Brandeis University, University of Rochester, Partner’s Health Care System, Virginia Medical Center, Johns Hopkins University, MITRE, the University of Chicago, the US Air Force and the US Space Force, the University of California; the other authors have no competing interests to disclose.

  • Ethical approval: The study was approved by the institutional review board at the University of Pennsylvania. A waiver of informed consent was obtained because the study was minimal risk to patients and could not have been practicably carried out without the waiver.

  • Data sharing: No additional data available.

  • The lead author (SJM) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned and registered have been explained.

  • Dissemination to participants and related patient and public communities: The results of this study will be disseminated across the University of Pennsylvania Health System to help guide implementation of ongoing population health strategies to increase HCV screening and other preventive health activities. The results will also be shared on the website for the Center for Health Care Innovation (https://healthcareinnovation.upenn.edu/) for broad dissemination to the public.

  • Provenance and peer review: Not commissioned; externally peer reviewed.

http://creativecommons.org/licenses/by-nc/4.0/

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References