BACKGROUND

In the U.S., an estimated 25 %1 of patients do not have a primary care provider or do not have complete access to one, particularly in rural areas.2 As the U.S. population grows and ages, and millions become insured under the Affordable Care Act, provider resources are increasingly constrained.1 In a 2014 survey, 81 % of physicians described themselves as overextended or at full patient capacity, with no time to take on more patients.3 Patients find that work and personal responsibilities compete with finding convenient care.4,5 In partnerships with many health systems and providers, CVS MinuteClinics offer medical care that supports and augments regular provider care during times when the providers themselves are unavailable.68 Emerging technologies like telehealth may additionally facilitate access to care when regular providers are not available.

Telehealth enables health care professionals to provide medical services at a distance using video imaging and other technology.9 Several studies have found that the quality of telehealth services and patients’ clinical outcomes following telehealth visits may be comparable to those of traditional face-to-face office visits, with the additional benefit of superior access to care.10,11 Based on the accumulating positive evidence, the Centers for Medicare and Medicaid Services (CMS) has expanded geographic coverage for telemedicine and coverage for new services such as wellness visits and psychotherapy,1215 and 19 states have passed “parity” legislation requiring third-party payers to reimburse for telehealth visits.9 The ACA mandates further study of and reimbursement for telehealth services.12,16

In October 2013, CVS Health implemented a pilot telehealth program. The program’s goals are to provide quality care and to reduce wait times for that care. Patients who visited a pilot clinic and had symptoms appropriate for telehealth consultation could participate in a telehealth visit. Beginning in January 2014, patients were invited to complete a satisfaction survey after their telehealth visits. In this study, we describe 1734 patients’ experiences and satisfaction with their telehealth visits. In particular, we explore characteristics and attitudes associated with patients’ preference for receiving medical care via a telehealth visit compared to a traditional office visit. By understanding the characteristics that improve the patient experience, health care providers can create or improve telehealth programs that provide high-quality, accessible primary care.

METHODS

The MinuteClinic Telehealth Pilot Program

Eleven clinics in California and Texas are participating in the program. In the telehealth visit, which mirrors a traditional face-to-face office visit, the patient and an assisting nurse communicate with an off-site nurse practitioner or physician assistant (practitioner) via a video monitor with two-way audio and visual capabilities. The patient describes his/her symptoms, and the assisting nurse uses special diagnostic tools designed for telehealth use (digital video otoscope, telephonic stethoscope, digital video laryngoscope, etc.) to display visual images on the video monitor screen (e.g., the actual images that the otoscope sees when looking in a patient’s ear) or present sounds via the monitor’s audio output (e.g., the patient’s heartbeat detected via the telephonic stethoscope) that the assisting nurse, patient, and remote practitioner can all see or hear. The assisting nurse can also process lab and diagnostic tests. The practitioner provides a diagnostic assessment and, together with the patient, decides upon a treatment plan. The practitioner is able to dispense prescriptions either electronically or via printout by the assisting nurse. The assisting nurse prints out the visit summary and treatment plan. All MinuteClinic providers, whether delivering care on-site or via telehealth, follow the same medical evidence-based treatment algorithms.17

Training for the Assisting Nurse

To participate in the telehealth visit, the assisting nurse participated in 2 weeks of training. During the first week, the assisting nurse completed a series of self-paced online learning modules related to telehealth policies, procedures, and delivery that were developed by MinuteClinic’s clinical training managers. During the second week, training managers provided 8 h (1 day) of hands-on training with the telehealth equipment. The assisting nurse then spent the next 4 days practicing with the telehealth equipment in mock telehealth visits together with off-site practitioners and the training managers.

Study Population

Patients who were 18 years of age or older and who presented at a participating MinuteClinic between January and September 2014 were eligible for a telehealth visit. MinuteClinics are always staffed with an on-site practitioner, and in the pilot program, telehealth visits were available anytime the MinuteClinic was open. All patients who visited a participating MinuteClinic were met by the assisting nurse, who assessed their chief complaints, processed insurance payments, and took vital signs. When the wait to see the on-site practitioner was 20 min on average, the assisting nurse offered patients with chief complaints appropriate for telehealth consultation (pharyngitis, sinusitis, otitis media, otitis externa, upper respiratory infections, bronchitis, allergic rhinitis, influenza, conjunctivitis, or urinary tract infection) the choice of waiting to see the on-site practitioner or participating in a telehealth visit with a remote practitioner. The assisting nurse informed patients that the cost of the telehealth visit was the same as that for a typical visit. Patients who agreed to participate gave written consent to receive care via telehealth and were placed in a virtual “waiting room.” The off-site practitioner initiated the visit by “picking up” the patient from the waiting room. Occasionally, all off-site practitioners were providing telehealth care to other patients, and the on-site practitioner was ready to see the waiting patient before an off-site practitioner. In these cases, the patient saw the on-site practitioner instead. Patients who ultimately participated in a telehealth visit constituted the final study population.

More than half of all patients visiting a MinuteClinic had conditions that were suitable for telehealth consultation. Approximately 70 % of patients offered the telehealth option decided to receive care via telehealth.

Data Sources

Patient Demographics and Telehealth Satisfaction Survey

Following their telehealth visits, patients were invited to complete a 12-item paper-based survey about their experiences with the MinuteClinic telehealth pilot program team (Appendix available online). The primary purpose for conducting the survey was quality improvement in order to assess whether CVS Minute Clinic’s telehealth option satisfied their health care needs. The nursing assistant left the room while patients completed the survey. On the survey, patients were asked whether they had previously received care at a MinuteClinic, had a telehealth visit, and where the telehealth visit(s) took place, and reported their age, gender, whether they had health insurance, and whether they had a PCP. Patients reported their primary motivation for choosing a telehealth visit and any concerns prior to the visit itself. Using a five-point Likert scale ranging from 1 = very dissatisfied to 5 = very satisfied, patients rated their satisfaction with each of eight different features: overall understanding of telehealth; ease of seeing diagnostic images on the monitor (e.g., when the digital video otoscope was used, did the patient think that the image he/she saw on the monitor was clear and not blurry); ease of seeing and hearing the remote practitioner; capability of the on-site assisting nurse; quality of the care they received, utility of the treatment and educational materials they received; the convenience of the visit; and overall satisfaction. Patients rated their telehealth visit in comparison to a traditional face-to-face medical visit: better than a traditional visit; just as good as; worse; or not sure. Finally, patients used a four-point Likert scale to indicate how likely they would be to use telehealth at MinuteClinic again and how likely they would be to recommend telehealth at MinuteClinic to someone else.

Response Rate

Because the satisfaction survey was conducted to inform program quality improvement activities, no data were collected on the number of patients who were invited to complete a survey (invitations were not made during times when the clinic was out of surveys or when the assisting nurse forgot or was too busy to ask) or on those who refused to participate. All surveys were completed anonymously, and no personal health information or personally identifiable information on survey respondents was collected, in compliance with HIPAA. To estimate the number of survey-eligible patients, we made an ad hoc assumption that 75 % of 4405 telehealth participants during the period January–September 2014 were asked to complete a survey, for an eligible survey population of 3303. We also report a more conservative response rate that assumes that all 4405 telehealth participants were asked to complete a survey.

Adult MinuteClinic Patient and U.S. Population Demographics

Because no data were collected with which to compare responders with non-responders, we compared responders’ demographics with those of adult MinuteClinic patients and the general U.S. adult population. We obtained nationwide age,18 gender,19 and medical insurance20 data from the 2009–2013 American Community Survey conducted by the U.S. Census Bureau.21 The proportion of U.S. adults aged 18 years or older with a primary care provider or usual place of care was drawn from the National Health Interview Survey.22 We present the raw numbers for each population with no adjustment or standardization.

Outcomes

The main outcome of interest was a patient’s preference for telehealth visits compared to traditional office visits. We used patients’ responses to the survey question “How did your telehealth visit compare to a traditional in-person visit?” We characterized patients who reported that a telehealth visit was “better than a traditional visit” as “Preferred telehealth” versus all other responses (“just as good as a traditional visit”; “worse than a traditional visit”; or “not sure”). A second outcome, “Liked telehealth,” was defined as a patient’s rating of a telehealth visit as “better than a traditional visit” or “just as good as a traditional visit” versus all other responses.

Statistical Analyses

In total, 1812 patients completed the survey, of whom 78 reported having used telehealth services prior to the visit of interest. We excluded these 78 patients from further analysis, as repeated telehealth service use would likely bias their responses towards more favorable ratings. The final analytic population included 1734 patients. In conducting the analyses, we used only de-identified data. We described patient demographic characteristics and compared them with the characteristics of the MinuteClinic and U.S. adult populations. Patients’ survey responses were calculated for three patient groups: all patients, patients who preferred telehealth, and patients who liked telehealth.

We assessed the relationship between patient demographic and survey responses and their preference for each of the outcomes using univariate regression. We grouped age in three categories (18–34; 35–44; 55 and older) to increase our ability to detect differences across groups. Only survey variables that characterized aspects of patients’ experience before or during the telehealth visit were examined, to ensure a temporal association between patient experience and visit preference. These included patients’ perceptions of the telehealth visit convenience, concerns with using telehealth, whether they found the telehealth format confusing or complicated, and variables related to their satisfaction with the telehealth process (seeing/hearing the remote practitioner, viewing images, education and materials, treatment plan, capability of assisting nurse, quality of care received, and overall satisfaction). The following variables were excluded: how likely the patient would be 1) to use telehealth again and 2) to recommend telehealth to a friend or family member. Because patients’ responses were highly skewed toward the most positive rating, we dichotomized each of the satisfaction variables as “very satisfied” versus “all other” (a grouping of the following responses: “somewhat satisfied,” “neither satisfied nor dissatisfied,” “somewhat dissatisfied,” or “very dissatisfied”).

All variables were entered into the corresponding multivariate logistic regression model. All models accounted for the clustering of patients within MinuteClinics using generalized estimating equations.23,24 In the multivariate models, we assessed potential collinearity among variables using variance inflation factors (VIF). Analyses were performed using SAS Enterprise Guide 5.1 (SAS Institute Inc., Cary, NC, USA).

RESULTS

In total, 1734 patients completed a satisfaction survey, for an estimated response rate of 54 %. Conservatively assuming that all 4405 telehealth participants were asked to complete a survey (which is not true), the response rate would be 40 %. Compared to 61 % of MinuteClinic patients, 70 % of telehealth participants were women (Table 1). Telehealth patients were more likely to report having a PCP or usual place of care (59 %) than were all MinuteClinic patients (50 %); both were lower than in the U.S. population (83 %). Twenty percent of telehealth patients reported not having medical insurance, similar to the prevalence in the U.S. population. In contrast, 11 % of MinuteClinic patients do not have insurance.

Table 1 Characteristics of 1734 patients with a telehealth visit, compared with the CVS MinuteClinic general adult population and the U.S. adult population

One-third (32 %) expressed a preference for receiving care via telehealth. An additional 57 % rated a telehealth visit as “just as good as a traditional visit.” One percent of patients rated the telehealth visit as “worse than a traditional visit,” and the remainder responded that they were not sure.

Over half of patients cited shorter/no wait time as their primary motivation for using telehealth (Table 2). Patients’ experiences were overwhelmingly positive: 94–99 % reported being “very satisfied” with all attributes. When rating the quality of care they received, 95 % of all patients were very satisfied, 98 % rated the assisting nurse as highly capable, and 94 % were very satisfied with the treatment plan and educational materials they received. Among all patients, 95 % were very satisfied with the technology, i.e., their ability to see and hear the practitioner and to see diagnostic images on the monitor. Finally, 95 % of all patients appreciated the convenience of the service. Nearly 100 % of patients in each group reported that they “definitely” or “probably” would use telehealth personally and would recommend telehealth to someone else.

Table 2 Patients’ motivations for and satisfaction with telehealth visits, among all patients and among those who rated telehealth as good or better than a traditional office visit

In the multivariate model, those with no medical insurance had 21 % increased odds of preferring a telehealth visit to a traditional visit (odds ratio [OR] = 1.21; 95 % confidence interval [CI], 1.02–1.43) (Table 3). Several variables predicted whether patients liked telehealth. Female patients had 1.75 odds of liking telehealth (95 % CI, 1.05–2.86). Patients also had greater odds if they were very satisfied with their overall understanding of telehealth (OR = 2.80; 95 % CI, 1.81–4.32), the quality of care they received (OR = 2.38; 1.47–3.87), or the convenience of using telehealth (OR = 2.85; 1.06–7.65). Conversely, patients who were very satisfied with the capability of the assisting nurse had reduced odds of liking telehealth (OR = 0.48; 95 % CI, 0.29–0.80).

Table 3 Characteristics associated with patient preference for telehealth visits compared to traditional visits

DISCUSSION

Among 1734 patients who participated in a MinuteClinic telehealth visit, 95 % were very satisfied with the quality of the health care they received and rated telehealth as better than or just as good as a traditional visit. Only one factor was a significant predictor of patient preference for telehealth: those with no medical insurance had 20 % greater odds of preferring telehealth to a traditional visit. Patients who were very satisfied with their understanding of telehealth, the quality of care they received, and telehealth’s convenience had more than 2.3 times the odds of liking telehealth. These results provide insights into patients’ motivations for using telehealth and factors associated with their preference for telehealth visits.

Nearly all patients in the telehealth pilot program were very satisfied with the quality of the care they received. Patient perceptions were in line with evidence from studies that found care quality and clinical outcomes following telehealth visits to be comparable or superior to those of traditional ambulatory visits, emergency department visits, or hospitalization.11 To date, telehealth programs have been associated with successful management of acute infection, rapid pediatric triage in the emergency department, and the provision of timely high-quality care in disciplines such as mental health, primary care/internal medicine, cardiology, and dermatology.2531 Additionally, retail clinic care for common conditions is associated with comparable32 or superior quality and outcomes17 compared to ambulatory care facilities or emergency departments.

In our study, patients’ insurance status and demographics and their motivations for using telehealth reflect current health care access challenges in the U.S. as provider resources are increasingly constrained.1 Although 80 % of telehealth participants had medical insurance, 41 % reported that they did not have a PCP or a usual place of care. Fully 95 % were very satisfied with telehealth’s convenience. Notably, 70 % of telehealth participants were women, who are often likely to be juggling work, childcare, and other responsibilities that may impede access to convenient medical care.4,5 In a recent study of insured patients’ use of an exclusively Web-based telehealth model, 21 % of patients had not accessed medical care in the previous year, 67 % were female, and over one-third of telehealth visits occurred on weekends and holidays when traditional care is difficult to access.11 Based on our study, patient characteristics (70 % female, 41 % with no usual place of care) and their motivations (56 % reported shorter wait time as their primary reason for using telehealth), MinuteClinic—and the telehealth pilot program in particular—appears to be reaching a segment of the adult population who may have difficulty accessing high-quality, timely care.

Our satisfaction results are in line with recent research that found that improved access to care was associated with patient satisfaction.33 Lack of medical insurance was the only significant predictor of a preference for telehealth. Medical insurance is a proxy for access to care, and evidence suggests that both retail clinics and telehealth services can provide quality care at lower costs.3437 Among the 95 % of patients who rated telehealth as just as good as or better than a traditional visit, high satisfaction with the quality of care they received and their understanding of the service were both significant predictors of this rating. Equally important to patients’ liking telehealth was convenience. Paradoxically, patients’ high satisfaction with the capability of the assisting nurse was inversely associated with liking telehealth. It is possible that patients who developed a strong affinity for the on-site nurse decided that the benefits of this in-person interaction, characteristic of a traditional visit, outweighed the other benefits associated with a telehealth visit, or that they felt that the assisting nurse was capable of performing the diagnostic exam alone, without the remote practitioner’s input, not understanding that the nurse was not licensed to practice alone. It is difficult to disentangle which of these explanations, if either, is probable without additional information from patients.

The present study uses survey data from a small non-randomized telehealth pilot program in which the vast majority of respondents were very satisfied with the quality of health care they received, the convenience of that care, and the logistics and technology associated with the telehealth visit. Because the focus of the quality improvement initiative was to assess patient satisfaction with telehealth, the present study does not compare patients who participated in a telehealth visit with those who declined to participate, as preference for either care delivery model is related to both patient exposure to telehealth and the likelihood that they were satisfied with telehealth, and would bias any analysis. The survey instrument was created by the pilot program evaluation team and was not tested for reliability or validity prior to use. While the high degree of satisfaction with the telehealth pilot program among patients who did decide to try telehealth for the first time is an important finding in and of itself, the homogeneity of patients’ responses limited our power to identify predictors of rating a telehealth visit as preferable to or just as good as a traditional visit, and is reflected in the wide confidence intervals. Data on the number of patients who were invited to take the survey and who refused were not available, and we could not assess a precise survey response rate or the comparability of survey responders and non-responders regarding their telehealth experiences. In an effort to address these limitations, we used available telehealth visit metrics to estimate a conservative response rate. Additionally, we compared the demographic characteristics of survey respondents with those of the MinuteClinic and U.S. adult populations, providing context as to the generalizability of our results.

In a pilot program providing care via telehealth, 95 % of all participants who completed a satisfaction survey were highly satisfied with the quality of the care they received, the ease with which telehealth technology was integrated into the visit, and the timeliness and convenience of their care. Fully one-third of patients—and particularly those with no health insurance—preferred a telehealth visit to a traditional visit, and nearly all found telehealth to be just as good as or better than a traditional visit, with quality and convenience driving this ranking. Telehealth may be particularly well-suited to patients who have difficulty accessing timely, convenient care.