Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Sasha Shepperd a Department of Primary Health Care and General
Practice, Division of Primary Care and Population Health Sciences,
Imperial College of Science Technology and Medicine, London
W2 1PG, b Division of
Public Health and Primary Health Care, University of Oxford, Institute
of Health Sciences, Oxford OX3 7LF, c Centre for Health Information
Quality, Winchester SO22 5DH
Correspondence to: Sasha Shepperd
S.Shepperd{at}ic.ac.uk
The provision of consumer health information was
pioneered in the United States: organisations such as Planetree
(a not for profit, community based healthcare initiative) were
among the first to provide information services.1 Over the
years several organisations in the United Kingdom
Some of the organisations in the United Kingdom that are funded to
provide health information for patients and the public are listed in
box 1.
The internet
Box 1
: Sources of consumer health information
Box 2
: Gateway sites
Healthfinder (www.healthfinder.gov/) Health On the Net Foundation
(www.hon.ch/) Organising Medical Networked Information
(www.omni.ac.uk) Box 3
: Online sources of consumer health information
HebsWeb (www.hebs.scot.nhs.uk/) HPIC Health Promotion Information Centre
(www.hea.org.uk.hpic/) Medline Plus
(www.nlm.nih.gov/medlineplus/) National Institutes of Health
(www.nih.gov/health/consumer/) Patient UK (www.patient.co.uk/) Assessment tools are available to judge the content of consumer
health information, and many organisations have developed internal
systems of appraisal. Several problems must be resolved before
appraisal becomes common practice, including the resources required to
assess the vast amount of health information written for consumers.
Judging the quality of consumer information is not always
straightforward. Guidelines and checklists have been published for appraising the quality of written consumer health
information.8-10 Commonly agreed criteria include
currency and sources of information, reliability, relevance, and
accuracy. For most of these instruments, however, details of
reliability or validity are inadequate, and some seem to have been
derived from a variety of unstated
perspectives.11 Instructions on use
and interpretation are not always explicitly stated.
Retrieving high quality online information that may be of use can also
be a problem. Difficulties in searching and using information in this
rapidly changing environment have been well
described.
7 12
The advent of the
internet has led to a proliferation of appraisal tools and quality
checklists, particularly in relation to the development of gateway
sites.7 The reliability and validity of these
checklists are not always clear. Box 4 shows two validated tools developed for rating the quality of consumer health information.
Readability tests are designed to provide a quantifiable
assessment of how easy text is to read. A criticism of readability tests is that they do not take into account a patient's prior experience and motivation. During the course of an illness patients may
rapidly become familiar with quite complex terminology.16 Gender, culture, and age should also be considered when these measures
are used.17 Tests of readability are generally based on
the number and length of sentences and the number of long words (usually defined as words with three or more syllables). Commonly used
measures of readability include Flesch (which may be found on many word
processing packages)18 and Gobbledygook.19 In addition to quality and readability, the evidence base of the information and the involvement of consumers in the production of the
material base should be considered.
Box 4
: Examples of tools for assessing the quality of consumer
health information
DISCERN (www.discern.org.uk) The Health Information Quality Assessment Tool
(hitiweb.mitretek.org/iq) If good quality health information is not available an alternative
is to produce a leaflet or website. Outlining the steps to good
practice for those setting out to write leaflets for patients, Smith
emphasised the time it takes to produce clear, unambiguous material
that patients will use.20 In addition to following validated quality criteria, writers should take patients' information needs into account and be aware of how people will read what they have
written.
21 22
This will require involving patients in developing and testing materials.10 Before embarking on
this lengthy process, however, a first step is to check if high quality information already exists.
including the
College of Health, the Help for Health Trust, the Health Education
Authority, the Health Education Board for Scotland, and self help
groups
have provided information on a wide range of health topics
directly to patients or consumers. Similar initiatives have been
undertaken in Europe, Canada, Australia, and New Zealand.2
More recently, developments in Britain such as local consumer health
information services, the Patient Partnership Strategy,3
and initiatives at the King's Fund
4 5
have improved
awareness of and access to evidence based consumer health information.
These developments have come at a time when the amount of health
information is increasing, particularly through the internet
and amid
increasing concern about the varying quality of health information
accessed by patients. We outline some steps to help health
professionals advise patients on where to find good quality health
information in this rapidly changing field.
Summary points
Patients require access to good quality, evidence based
information so they can take an active part in decisions about their
health care
The amount of information available to patients is increasing,
particularly through the internet
The quality of this information remains variable
Health professionals need to be able to direct patients to sources of
good quality consumer health information, including health related
websites
![]()
Sources of consumer health information
The internet offers access to health information provided by many
different organisations and agencies. Several providers offer gateway
services that operate a selective process, only including information
that meets certain criteria. First time users may find that gateway
sites are a helpful initiation to this type of information. Box 2 gives
examples of widely used gateway sites that use explicit guidelines for
selecting information. A fuller listing can be found in a
review by Kim et al.7 Box 3 gives examples of other well
known websites that provide public access to health information. As
these sites contain links to other organisations and services,
including the sites of national self help groups, we have not listed
addresses for individual services. These examples are limited by the
dynamic nature of the web. Also, even where information is selected to
conform with explicit criteria, the basis for these criteria is not
always clear.
all health authorities are required to provide a freephone
health information service for their residents. There are various local
arrangements for the provision of these lines, but all services work to
the same standards and provide access to information for patients and
the public on the same number.
24 hour, nurse led telephone advice line,
currently covering 40% of England. The whole country will be covered
by the year 2000.6
based in Winchester, the trust
provides information as part of the Health Information Service and NHS
Direct Hampshire; it maintains a large consumer health information
library and databases, including Helpbox, which provides details of
national self help groups and references to self help literature on a
wide range of health issues. Helpbox is now available as a Windows
compatible package, and future editions will include details of the
quality of each publication.
funded by the NHS Executive
as a central resource to facilitate the production and dissemination of
high quality patient information for health service
users.3 Focuses on information describing treatment
choices and outcomes; does not currently provide access to information
on specific conditions or treatments, but provides advice on quality
guidelines and initiatives and works directly with NHS and patient
representatives to raise awareness of key issues in the development of
consumer health information.
a key
component will be a virtual "floor" (NHS Direct On-Line) for
patients and the public; this will provide easy access to best current
knowledge. NHS Direct On-Line will help people to address three
questions:
How can I stay healthy and reduce my risk of disease?
Should I see my doctor?
Am I getting the right type of care and treatment for my health
problem?
a US
government site that provides access to health information from a range
of sources, including government agencies, voluntary groups, and
professional organisations. It has links to Medline Plus and other
online databases
an international, not for profit initiative
based in Geneva. It provides a database of evaluated health materials
and also promotes the use of the HON code as a self governance
initiative to help unify the quality of medical and health information
available. Users of website health information displaying the HON logo
can be assured that the material has been developed in accordance with
these guidelines
based at the University of Nottingham,
OMNI provides access to good quality biomedical and health information
from the internet worldwide. It has been developed primarily for
medical professionals, but consumers may find it useful
the website for the
Health Education Board of Scotland; a popular site providing access to
a wide range of consumer health information and resources through a
virtual health centre
the national centre for health
promotion information and advice in England and part of the
Health Education Authority; includes access to databases
covering a variety of health issues and topics in a range of formats
supported by the US National
Library of Medicine; provides access to a wide range of databases,
including the abstracts of articles indexed on Medline.
provides access to databases of
consumer health information published by the US National Institutes of
Health. The NIH search engine is also available
designed to
direct non-medical people in the United Kingdom to information about
health related issues; maintained by two general practitioners
responsible for the patient information leaflet service (PILS)
![]()
Appraisal tools for consumer health information
![]()
Quality
![]()
Readability
developed to assess
the quality of health information on treatment
choices.
13 14
A number of hints are given after each
question to guide the user. Areas covered are: bias in the material, a
clear statement of aims, references and additional sources of support
and information, uncertainty, risks and benefits (including those of
opting for no treatment), and treatment options. DISCERN also alerts
the user to concepts such as shared decision making, and quality of
life. An online version (www.discern.org.uk) is currently being tested.
the Health Summit Working Group
in North America (hitiweb.mitretek.org/hswg) is currently developing a
reliable and valid appraisal tool for users of health information on
the internet.15 The tool is interactive and is potentially
useful for patients wishing to evaluate the overall quality of health
related websites. The main areas currently covered are credibility,
content, disclosure, links, design, interactivity, and caveats
(information on the function of the site).
![]()
If no information is available
| |
Acknowledgments |
|---|
We thank Dr Muir Gray, Dr Tony Hope and Dr Theo Schofield for their helpful comments.
| |
Footnotes |
|---|
Competing interests: SS receives royalties from the DISCERN handbook.
| |
References |
|---|
| 1. | Planetree. www.planetree.org; accessed 2 August 1999. |
| 2. | Medical consumerism: library roles and initiatives. In: Rees A, ed. Managing consumer health information. Phoenix: Oryx Press, 1991. |
| 3. | NHS Executive. Patient partnership: building a collaborative strategy. Leeds: NHS Executive, 1996. |
| 4. | Dunning M, Abi-Aad G, Gilbert D, Hutton H, Brown C. Turning evidence into everyday practice. London: King's Fund, 1999. |
| 5. | Coulter A, Entwistle VA, Gilbert D. Informing patients: an assessment of the quality of patient information materials. London: King's Fund, 1998. |
| 6. | NHS Executive. Information for health: an information strategy for the modern NHS 1998-2005. Leeds: NHS Executive, 1998. |
| 7. |
Kim P, Eng TR, Deering MJ, Maxfield A.
Published criteria for evaluating health related web sites: review.
BMJ
1999;
318:
647-649 |
| 8. | Coulter A. Give patients solid information. Management in General Practice 1996; 20: 40-42. |
| 9. | Entwistle VA, Sowden AJ, Watt IS. Evaluating interventions to promote patient involvement in decision-making: by what criteria should effectiveness be judged? J Health Serv Res Policy 1998; 3: 100-107[Medline]. |
| 10. |
Coulter A.
Evidence based patient information.
BMJ
1998;
317:
225-226 |
| 11. | Entwistle VA, Sheldon TA, Sowden AJ, Watt IS. Supporting consumer involvement in decision making: what constitutes quality in consumer health information? Int J Health Care 1996; 8: 425-437. |
| 12. |
Jadad A, Gagliardi A.
Rating health information on the internet.
JAMA
1998;
279:
611-614 |
| 13. | Charnock D. The DISCERN handbook: quality criteria for consumer health information. Abingdon: Radcliffe Medical Press, 1998. |
| 14. |
Charnock D, Shepperd S, Gann B, Needham G.
DISCERN an instrument for judging the quality of consumer health information on treatment choices.
J Epidemiol Community Health
1999;
53:
105-111[Abstract].
|
| 15. | Mitretek Systems Innovative Technology in the Public Interest. hitiweb.mitretek.org/hswg; accessed 2 August 1999. |
| 16. | Meade C, Smith CF. Readability formulas: cautions and criteria. Patient Educ Couns 1991; 17: 153-158. |
| 17. | Secker J, Pollard R. Writing leaflets for patients: guidelines for producing written information. Edinburgh: Health Education Board for Scotland, 1995. |
| 18. | Flesch R. A new readability yardstick. J Appl Psychol 1948; 32: 221-233. |
| 19. | Ewles L, Simnett I. Promoting health: a practical guide. London: Scutari Press, 1995. |
| 20. | Smith T. Information for patients. BMJ 1992; 305: 1242. |
| 21. | Sless D, Wiseman R. Writing about medicines for people. Canberra: Australian Government Publishing Service, 1997. |
| 22. | Wright P. Writing and information design of healthcare materials. In: Candlin C, Hyland K, eds. Writing: texts, processes and practices. London: Addison Wesley Longman, 1998. |
(Accepted 11 August 1999)