Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Frances Mair a Department of
Primary Care, Whelan Building, Quadrangle, University of Liverpool,
Liverpool L69 3GB, b Department of Telecommunication, Michigan
State University, 409 Communication Arts and Sciences Building, East
Lansing, MI 48824-1212, USA
Correspondence to: F Mair f.s.mair{at}liv.ac.uk
| Abstract |
|---|
|
|
|---|
Objective:
To review research into patient
satisfaction with teleconsultation, specifically clinical consultations
between healthcare providers and patients involving real time
interactive video.
Telemedicine can be defined as the use of telecommunications
technologies to provide medical information and services.1 There is increasing interest in the use of telemedicine as a means of
healthcare delivery. This is partly because technological advances have
made the equipment less expensive and simpler to use and partly because
increasing healthcare costs and patient expectations have increased the
need to find alternative modes of healthcare delivery.
A wide variety of studies concerning telemedicine, interactive video
consultations, have been performed in different settings throughout the
world. Commentators on telemedicine frequently highlight the need for
research into safety, efficacy, and cost effectiveness. Telemedicine
literature abounds with publications about patient satisfaction, which
are generally positive, and as a result there is a tendency to assume
that the need for further research into this is less of a priority.
We argue in this paper that (a) the available research fails both to
provide satisfactory explanations of the underlying reasons for patient
satisfaction or dissatisfaction with telemedicine and to explore
communication issues in any depth and (b) generalisations about
satisfaction with telemedical care are difficult because of
methodological deficiencies of the current evidence. To support this
perspective, we provide the results of a systematic literature review
of research into telemedicine satisfaction, in the context of
interactive video.
Search strategy
Design:
Systematic review of telemedicine satisfaction studies. Electronic databases searched include Medline, Embase, Science
Citation Index, Social Sciences Citation Index, Arts and Humanities
Citation Index, and the TIE (Telemedicine Information Exchange) database.
Subjects:
Studies conducted worldwide and published between 1966 and 1998.
Main outcome measures:
Quality of evidence about
patient satisfaction.
Results:
32 studies were identified. Study methods used were simple survey instruments (26 studies), exact methods not
specified (5), and qualitative methods (1). Study designs were
randomised controlled trial (1 trial); random patient selection (2);
case-control (1); and selection criteria not specified or participants
represented consecutive referrals, convenience samples, or volunteers
(28). Sample sizes were
20 (10 trials),
100 (14), >100 (7),
and not specified (1). All studies reported good levels of patient
satisfaction. Qualitative analysis revealed methodological problems
with all the published work. Even so, important issues were highlighted
that merit further investigation. There is a paucity of data examining
patients' perceptions or the effects of this mode of healthcare
delivery on the interaction between providers and clients.
Conclusions:
Methodological deficiencies (low sample
sizes, context, and study designs) of the published research limit the generalisability of the findings. The studies suggest that
teleconsultation is acceptable to patients in a variety of
circumstances, but issues relating to patient satisfaction require
further exploration from the perspective of both clients and providers.
![]()
Introduction
Top
Abstract
Introduction
Methods
Results
Discussion
References
![]()
Methods
Top
Abstract
Introduction
Methods
Results
Discussion
References
To identify telemedicine satisfaction studies the following
electronic databases were searched: Medline 1966 to 1998, Embase
1988-98, Science Citation Index 1981-98, Social Sciences Citation Index
1981-98, Arts and Humanities Citation Index 1981-98, and the TIE
(Telemedicine Information Exchange) database. Searches were restricted
to English language papers, and the keywords used were: "patient
satisfaction," "consumer satisfaction," "telecommunications,"
and "telemedicine." The reference lists of papers identified were
hand searched for other relevant references.
Selection criteria
It is acknowledged that well designed and executed trials,
particularly randomised controlled trials, provide the most reliable
evidence for inclusion in any systematic review.3 However,
in view of the limited number of patient satisfaction studies that met
the search criteria outlined above, we analysed data from all clinical
trials identified irrespective of sample size or methodologies used.
Titles and abstracts of the studies identified by the outlined search
strategy were read to determine their potential eligibility for the
review. The full articles were then assessed for relevance.
Outcome measures and data extraction
The outcome measures we examined included patients' satisfaction
(principally overall satisfaction with the telemedicine service but
also including levels of satisfaction with communication via this
medium, telemedicine consultations compared with traditional face to
face consultations, and technical performance) and patients'
willingness to use telemedicine in the future.
Qualitative analysis
In view of the heterogeneous nature of the studies identified, the
dearth of randomised controlled trials, and the preponderance of
demonstration and feasibility studies, the data available did not
permit the use of formal statistical techniques such as meta-analysis.
Instead, we conducted a broad qualitative overview of the data,
including a critical review of the strength of the findings. We judged
the reliability and validity of data by the methodologies used in each
study and judged their generalisability from the study context. We did
not use a formal scoring method as no well validated instrument for
qualitative review yet exists.
3 4
However, as the basis
for our critical appraisal of the studies, we used a checklist designed
for assessing the methodological quality of both randomised and
non-randomised studies of healthcare interventions.4
| Results |
|---|
|
|
|---|
Thirty two studies met our selection criteria. The studies examined the use of interactive video in diverse contexts ranging from specialist consultations to home nursing. Many of these represented demonstration and feasibility studies rather than full scale trials. This is reflected in their sample sizes often being small and selection criteria for study participants rarely being random in nature. Only seven studies had more than 100 participants,5-11 14 were small pilot studies with less than 100 patients,12-25 and 10 were simple feasibility studies with 20 or fewer patients.26-35 One paper, which presented an overview of an Australian regional telepsychiatry project, did not provide patient numbers.36
The table lists the studies by type of consultation. (An extra table on the BMJ 's website provides further detail of studies in which patient numbers were over 20 and methods of measuring patient satisfaction were explicitly described. None of these studies declared any conflicts of interest.)
|
In terms of methodologies used, 26 studies used simple survey instruments, five did not specify the exact methods, and one used qualitative methods. Only one study was a randomised controlled trial,10 in two others patients were randomly selected, 19 23 and one was a case-control study.20 In the remaining 28 studies selection criteria were not specified or participants represented consecutive referrals, convenience samples, or volunteers.
Measures of patient satisfaction
The studies mainly used simple survey instruments to ascertain
patient satisfaction. Firm conclusions are limited by methodological
difficulties, but it would seem that the patients found
teleconsultations acceptable; noted definite advantages, particularly
increased accessibility of specialist expertise, less travel required,
and reduced waiting times; but also had some disquiet about this mode
of healthcare delivery, particularly relating to communication between
provider and client via this medium.
Shortcomings of studies
We identified several problems with the studies that affect their
reliability and validity. Many studies had small sample sizes, almost a
third having 20 or fewer participants, and low response rates, as low
as 50%.22 Patient selection criteria were often not
clearly specified, or there were no formal selection criteria. Most of
the studies (28) used volunteers or physician referrals and provided no
information about refusal rates at point of initial referral. Thus, it
is not possible to discount selection bias in favour of those likely to
be positive about teleconsultation.
Generalisability of results
The generalisability of much of the published research is limited
because of effect modifiers such as study setting. One of the largest
studies examined teleconsultation in a prison in the United
States.5 Clearly, there are several reasons why
satisfaction in prisoners may be different from that in the general
population. Thus, the peculiarities of the setting mean that this
study's results cannot be applied reliably to the general population
of that country or more widely.
| Discussion |
|---|
|
|
|---|
The published research suggests that healthcare delivery via telemedicine is acceptable to patients in a variety of circumstances, but, by addressing this issue in a rather superficial manner, most studies have produced more questions than answers. Thus far, most telemedicine research has had a technological focus. We know a great deal about bandwidths and resolution, but little about the human dimensions that make the practice possible. Pragmatic information that can benefit future delivery of health care via telemedicine is needed.
The following issues need to be addressed:
In addition, we need to use research tools that have been shown to be reliable and valid. Questionnaires have advantages and disadvantages, but if they are to be used in future research we need to use instruments that have undergone rigorous testing and have been shown to produce repeatable results and to measure what they are intended to measure. Future evaluations need to start with a set of clear hypotheses and objectives and to use clearly defined methodologies that will increase the likelihood of meeting the initial aims. Although randomised controlled trials may not always be practical, representative patient samples are necessary in order to improve the usefulness of results obtained.
This review serves to highlight methodological deficiencies in the published research. Although there are practical obstacles to evaluating telemedicine,37 there remains a need for further exploration of this field in order to facilitate an evidence based approach to the wider introduction of this new technology. It is an oversimplification to suggest that this aspect of telemedicine has undergone sufficient scrutiny.
|
What is already known on this topic
Telemedicine is currently advocated as a mode of healthcare delivery because of its potential to diminish inequalities in service provision and to improve access to care Studies of interactive teleconsultations have been performed in a diversity of settings throughout the world, and most suggest that patients are satisfied with this mode of healthcare delivery However, preliminary review of this literature indicates there are still many gaps in knowledge in relation to patient satisfaction with telemedicine What this study addsThis systematic review of the telemedicine literature demonstrates that methodological deficiencies in the published research affect the validity and generalisability of the results and that communication issues, the quality of interpersonal relationships with this medium, and subsequent effects, if any, on the outcome of consultations have yet to be fully explored Future research in this subject needs to be more scientifically robust in order to assist policymakers in reaching informed decisions about the appropriate use of this technology |
| Acknowledgments |
|---|
We thank Dr Mark Gabbay, senior lecturer, Department of Primary Care, University of Liverpool, and Dr Maria Leitner, Health and Community Care Research Unit, University of Liverpool, for advice and comments.
Contributors: FM contributed to initiation of the research, discussed core ideas, designed the protocol, participated in data collection, analysed and interpreted the data, and participated in writing the paper. PW initiated the primary study hypothesis and the research, discussed core ideas, and participated in study design, data collection, and writing of the paper. FM is guarantor of this paper.
| Footnotes |
|---|
Funding: None.
Competing interests: None.
An extra table giving details of
studies appears on the BMJ website
| References |
|---|
|
|
|---|
| 1. |
Perednia DA, Allen A.
Telemedicine technology and clinical applications.
JAMA
1995;
273:
483-488 |
| 2. | Mahmud K, Lenz J. The personal telemedicine system. A new tool for the delivery of health care. J Telemed Telecare 1995; 1: 173-177[Medline]. |
| 3. | NHS Centre for Reviews and Dissemination. Report Number 4. York: University of York, 1996. |
| 4. | Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventions. J Epidemiol Community Health 1998; 52: 377-384[Abstract]. |
| 5. | Brecht RM, Gray CL, Peterson C, Youngblood B. The University of Texas Medical Branch-Texas Department of Criminal Justice telemedicine project: findings from the first year of operation. Telemed J 1996; 2: 25-35[Medline]. |
| 6. | Loane MA, Bloomer SE, Corbett R, Eedy DJ, Gore HE, Mathews C, et al. Patient satisfaction with realtime teledermatology in Northern Ireland. J Telemed Telecare 1998; 4: 36-40[Medline]. |
| 7. |
Lowitt MH, Kessler II, Kauffman CL, Hooper FJ, Siegel E, Burnett JW.
Teledermatology and in-person examinations: a comparison of patient and physician perceptions and diagnostic agreement.
Arch Dermatol
1998;
134:
471-476 |
| 8. | Gilmour E, Campbell SM, Loane MA, Esmail A, Griffiths CE, Roland MO, et al. Comparison of teleconsultations and face-to-face consultations: preliminary results of a United Kingdom multicentre teledermatology study. Br J Dermatol 1998; 139: 81-87[CrossRef][Medline]. |
| 9. | Oakley AMM, Astwood DR, Loane M, Duffill MB, Rademaker M, Wootton R. Diagnostic accuracy of teledermatology: results of a preliminary study in New Zealand. NZ Med J 1997; 110: 51-53[Medline]. |
| 10. | Brennan JA, Kealy JA, Gerardi L, Shih R, Allegra J, Sannipoli L, et al. A randomized controlled trial of telemedicine in an emergency department. J Telemed Telecare 1998; 4(suppl 1): 18-20. |
| 11. | Duffy JR, Werven GW, Aronson AE. Telemedicine and the diagnosis of speech and language disorders. Mayo Clin Proc 1997; 72: 1116-1122[Abstract]. |
| 12. | Huston JL, Burton DC. Patient satisfaction with multispecialty interactive teleconsultations. J Telemed Telecare 1997; 3: 205-208[CrossRef][Medline]. |
| 13. | Callahan EJ, Hilty DM, Nesbitt TS. Patient satisfaction with telemedicine consultation in primary care: comparison of ratings of medical and mental health applications. Telemed J 1998; 4: 363-369[Medline]. |
| 14. | Conrath DW, Buckingham P, Dunn EV, Swanson JN. An experimental evaluation of alternative communication systems as used for medical diagnosis. Behav Sci 1975; 20: 296-305[Medline]. |
| 15. | Blakeslee DB, Grist WJ, Stachura ME, Blakeslee BS. Practice of otolaryngology via telemedicine. Laryngoscope 1998; 108: 1-7[Medline]. |
| 16. | Blackmon LA, Kaak HO, Ranseen J. Consumer satisfaction with telemedicine child psychiatry consultation in rural Kentucky. Psychiatr Serv 1997; 48: 14644-14666. |
| 17. |
Harrison R, Clayton W, Wallace P.
Can telemedicine be used to improve communication between primary and secondary care?
BMJ
1997;
313:
1377-1381 |
| 18. | Jones DH, Crichton C, Macdonald A, Potts S, Sime D, Toms J, et al. Teledermatology in the highlands of Scotland. J Telemed Telecare 1996; 2(suppl 1): 7-9. |
| 19. | Baigent MF, Lloyd C, Kavanagh SJ, Ben-Tovim DI, Yellowlees PM, Kalucy RS, et al. Telepsychiatry: `tele' yes, but what about the `psychiatry'? J Telemed Telecare 1997; 3(suppl 1): 3-5. |
| 20. | Dongier M, Tempier R, Lalinec-Michaud M, Meunier D. Telepsychiatry: psychiatric consultation through two-way television. A controlled study. Can J Psychiatry 1986; 31: 32-34[Medline]. |
| 21. | Allen A, Hayes MPA. Patient satisfaction with teleoncology: a pilot study. Telemed J 1995; 1: 41-46[Medline]. |
| 22. | Clarke PHJ. A referrer and patient evaluation of a telepsychiatry consultation-liaison service in South Australia. J Telemed Telecare 1997; 3(suppl 1): 12-14. |
| 23. | Pedersen S, Holand U. Tele-endoscopic otorhinolaryngoligical examination: preliminary study of patient satisfaction. Telemed J 1995; 1: 47-52[Medline]. |
| 24. | Whitten P, Mair FS, Collins B. Home tele-nursing care in Kansas: patients' perceptions of uses and benefits. J Telemed Telecare 1997; 3: 67-69 |
| 25. | Graham M. Telepsychiatry in Appalachia. Am Behav Sci 1996; 39: 602-615[Abstract]. |
| 26. | Hubble JP, Pahwa R, Michalek DK, Thomas C, Koller WC. Interactive video conferencing: a means of providing interim care to Parkinson's disease patients. Mov Disord 1993; 8: 380-382[CrossRef][Medline]. |
| 27. | Takano T, Nakamura K, Akao C. Assessment of the value of videophones in home healthcare. Telecomm Policy 1995; 19: 241-248. |
| 28. | Couturier P, Tyrrell J, Tonetti J, Rhul C, Franco A. Feasibility of orthopaedic teleconsulting in a geriatric rehabilitation service. J Telemed Telecare 1998; 4(suppl 1): 85-87. |
| 29. | Itzak B, Weinberger T, Berkovitch E, Reis S. Telemedicine in primary care in Israel. J Telemed Telecare 1998; 4(suppl. 1): 11-14. |
| 30. |
Baer L, Cukor P, Jenike MA, Leahy L, O'Laughlen J, Coyle JT.
Pilot studies of telemedicine for patients with obsessive-compulsive disorder.
Am J Psychiatry
1995;
152:
1383-1385 |
| 31. | Doolittle GC, Yaezel A, Otto F, Clemens C. Hospice care using home-based telemedicine systems. J Telemed Telecare 1998; 4(suppl. 1): 58-59. |
| 32. | Kunkler IH, Rafferty P, Hill D, Henry M, Foreman D. A pilot study of tele-oncology in Scotland. J Telemed Telecare 1998; 4: 113-119[CrossRef][Medline]. |
| 33. | Ball CJ, McLaren PM, Summerfield AB, Lipsedge MS, Watson JP. A comparison of communication modes in adult psychiatry. J Telemed Telecare 1995; 1: 22-26[Medline]. |
| 34. | Allen A, Roman L, Cox R, Cardwell B. Home health visits using a cable television network: user satisfaction. J Telemed Telecare 1996; 2(suppl 1): 92-94. |
| 35. | McLaren PM, Blunden J, Lipsedge ML, Summerfield AB. Telepsychiatry in an inner-city community psychiatric service. J Telemed Telecare 1996; 2: 57-59[CrossRef][Medline]. |
| 36. | Trott P. The Queensland Northern Regional Health Authority telemental health project. J Telemed Telecare 1996; 2(suppl 1): 98-104. |
| 37. | Wootton R. Telemedicine in the National Health Service. J R Soc Med 1998; 91: 614-621[Medline]. |
(Accepted 5 April 2000)
Read all Rapid Responses