BMJ 1999;319:764-766 ( 18 September )

Education and debate

Helping patients access high quality health information

Sasha Shepperd, lecturer a Deborah Charnock, research officer b Bob Gann, director c

a Department of Primary Health Care and General Practice, Division of Primary Care and Population Health Sciences, Imperial College of Science Technology and Medicine, London W2 1PG, b Division of Public Health and Primary Health Care, University of Oxford, Institute of Health Sciences, Oxford OX3 7LF, c Centre for Health Information Quality, Winchester SO22 5DH

Correspondence to: Sasha Shepperd S.Shepperd{at}ic.ac.uk

The provision of consumer health information was pioneered in the United States: organisations such as Planetree (a not for profit, community based healthcare initiative) were among the first to provide information services.1 Over the years several organisations in the United Kingdom---including the College of Health, the Help for Health Trust, the Health Education Authority, the Health Education Board for Scotland, and self help groups---have provided information on a wide range of health topics directly to patients or consumers. Similar initiatives have been undertaken in Europe, Canada, Australia, and New Zealand.2 More recently, developments in Britain such as local consumer health information services, the Patient Partnership Strategy,3 and initiatives at the King's Fund 4 5 have improved awareness of and access to evidence based consumer health information. These developments have come at a time when the amount of health information is increasing, particularly through the internet---and amid increasing concern about the varying quality of health information accessed by patients. We outline some steps to help health professionals advise patients on where to find good quality health information in this rapidly changing field.


Summary points


Patients require access to good quality, evidence based information so they can take an active part in decisions about their health care

The amount of information available to patients is increasing, particularly through the internet

The quality of this information remains variable

Health professionals need to be able to direct patients to sources of good quality consumer health information, including health related websites



    Sources of consumer health information

Some of the organisations in the United Kingdom that are funded to provide health information for patients and the public are listed in box 1.

The internet
The internet offers access to health information provided by many different organisations and agencies. Several providers offer gateway services that operate a selective process, only including information that meets certain criteria. First time users may find that gateway sites are a helpful initiation to this type of information. Box 2 gives examples of widely used gateway sites that use explicit guidelines for selecting information. A fuller listing can be found in a review by Kim et al.7 Box 3 gives examples of other well known websites that provide public access to health information. As these sites contain links to other organisations and services, including the sites of national self help groups, we have not listed addresses for individual services. These examples are limited by the dynamic nature of the web. Also, even where information is selected to conform with explicit criteria, the basis for these criteria is not always clear.


Box 1 : Sources of consumer health information

  • National Freephone Health Information Service (tel: 0800 66 55 44)---all health authorities are required to provide a freephone health information service for their residents. There are various local arrangements for the provision of these lines, but all services work to the same standards and provide access to information for patients and the public on the same number.
  • NHS Direct (tel: 0845 4647)---24 hour, nurse led telephone advice line, currently covering 40% of England. The whole country will be covered by the year 2000.6
  • Help for Health Trust (tel: 01962 849 100; www.hfht.demon.co.uk/)---based in Winchester, the trust provides information as part of the Health Information Service and NHS Direct Hampshire; it maintains a large consumer health information library and databases, including Helpbox, which provides details of national self help groups and references to self help literature on a wide range of health issues. Helpbox is now available as a Windows compatible package, and future editions will include details of the quality of each publication.
  • Centre for Health Information Quality (tel: 01962 863511; enquiries{at}centreforhiq.demon.co.uk; www.centreforhiq.demon.co.uk/)---funded by the NHS Executive as a central resource to facilitate the production and dissemination of high quality patient information for health service users.3 Focuses on information describing treatment choices and outcomes; does not currently provide access to information on specific conditions or treatments, but provides advice on quality guidelines and initiatives and works directly with NHS and patient representatives to raise awareness of key issues in the development of consumer health information.
  • National Electronic Library for Health (www.nelh.nhs.uk/)---a key component will be a virtual "floor" (NHS Direct On-Line) for patients and the public; this will provide easy access to best current knowledge. NHS Direct On-Line will help people to address three questions:
      How can I stay healthy and reduce my risk of disease?
      Should I see my doctor?
      Am I getting the right type of care and treatment for my health problem?


Box 2 : Gateway sites

Healthfinder (www.healthfinder.gov/)---a US government site that provides access to health information from a range of sources, including government agencies, voluntary groups, and professional organisations. It has links to Medline Plus and other online databases

Health On the Net Foundation (www.hon.ch/)---an international, not for profit initiative based in Geneva. It provides a database of evaluated health materials and also promotes the use of the HON code as a self governance initiative to help unify the quality of medical and health information available. Users of website health information displaying the HON logo can be assured that the material has been developed in accordance with these guidelines

Organising Medical Networked Information (www.omni.ac.uk)---based at the University of Nottingham, OMNI provides access to good quality biomedical and health information from the internet worldwide. It has been developed primarily for medical professionals, but consumers may find it useful


Box 3 : Online sources of consumer health information

HebsWeb (www.hebs.scot.nhs.uk/)---the website for the Health Education Board of Scotland; a popular site providing access to a wide range of consumer health information and resources through a virtual health centre

HPIC Health Promotion Information Centre (www.hea.org.uk.hpic/)---the national centre for health promotion information and advice in England and part of the Health Education Authority; includes access to databases covering a variety of health issues and topics in a range of formats

Medline Plus (www.nlm.nih.gov/medlineplus/)---supported by the US National Library of Medicine; provides access to a wide range of databases, including the abstracts of articles indexed on Medline.

National Institutes of Health (www.nih.gov/health/consumer/)---provides access to databases of consumer health information published by the US National Institutes of Health. The NIH search engine is also available

Patient UK (www.patient.co.uk/)---designed to direct non-medical people in the United Kingdom to information about health related issues; maintained by two general practitioners responsible for the patient information leaflet service (PILS)



    Appraisal tools for consumer health information

Assessment tools are available to judge the content of consumer health information, and many organisations have developed internal systems of appraisal. Several problems must be resolved before appraisal becomes common practice, including the resources required to assess the vast amount of health information written for consumers.

    Quality

Judging the quality of consumer information is not always straightforward. Guidelines and checklists have been published for appraising the quality of written consumer health information.8-10 Commonly agreed criteria include currency and sources of information, reliability, relevance, and accuracy. For most of these instruments, however, details of reliability or validity are inadequate, and some seem to have been derived from a variety of unstated perspectives.11 Instructions on use and interpretation are not always explicitly stated.

Retrieving high quality online information that may be of use can also be a problem. Difficulties in searching and using information in this rapidly changing environment have been well described. 7 12 The advent of the internet has led to a proliferation of appraisal tools and quality checklists, particularly in relation to the development of gateway sites.7 The reliability and validity of these checklists are not always clear. Box 4 shows two validated tools developed for rating the quality of consumer health information.

    Readability

Readability tests are designed to provide a quantifiable assessment of how easy text is to read. A criticism of readability tests is that they do not take into account a patient's prior experience and motivation. During the course of an illness patients may rapidly become familiar with quite complex terminology.16 Gender, culture, and age should also be considered when these measures are used.17 Tests of readability are generally based on the number and length of sentences and the number of long words (usually defined as words with three or more syllables). Commonly used measures of readability include Flesch (which may be found on many word processing packages)18 and Gobbledygook.19 In addition to quality and readability, the evidence base of the information and the involvement of consumers in the production of the material base should be considered.


Box 4 : Examples of tools for assessing the quality of consumer health information

DISCERN (www.discern.org.uk)---developed to assess the quality of health information on treatment choices. 13 14 A number of hints are given after each question to guide the user. Areas covered are: bias in the material, a clear statement of aims, references and additional sources of support and information, uncertainty, risks and benefits (including those of opting for no treatment), and treatment options. DISCERN also alerts the user to concepts such as shared decision making, and quality of life. An online version (www.discern.org.uk) is currently being tested.

The Health Information Quality Assessment Tool (hitiweb.mitretek.org/iq)---the Health Summit Working Group in North America (hitiweb.mitretek.org/hswg) is currently developing a reliable and valid appraisal tool for users of health information on the internet.15 The tool is interactive and is potentially useful for patients wishing to evaluate the overall quality of health related websites. The main areas currently covered are credibility, content, disclosure, links, design, interactivity, and caveats (information on the function of the site).



    If no information is available

If good quality health information is not available an alternative is to produce a leaflet or website. Outlining the steps to good practice for those setting out to write leaflets for patients, Smith emphasised the time it takes to produce clear, unambiguous material that patients will use.20 In addition to following validated quality criteria, writers should take patients' information needs into account and be aware of how people will read what they have written. 21 22 This will require involving patients in developing and testing materials.10 Before embarking on this lengthy process, however, a first step is to check if high quality information already exists.

    Acknowledgments

We thank Dr Muir Gray, Dr Tony Hope and Dr Theo Schofield for their helpful comments.

    Footnotes

Competing interests: SS receives royalties from the DISCERN handbook.

    References

1. Planetree. www.planetree.org; accessed 2 August 1999.
2. Medical consumerism: library roles and initiatives. In: Rees A, ed. Managing consumer health information. Phoenix: Oryx Press, 1991.
3. NHS Executive. Patient partnership: building a collaborative strategy. Leeds: NHS Executive, 1996.
4. Dunning M, Abi-Aad G, Gilbert D, Hutton H, Brown C. Turning evidence into everyday practice. London: King's Fund, 1999.
5. Coulter A, Entwistle VA, Gilbert D. Informing patients: an assessment of the quality of patient information materials. London: King's Fund, 1998.
6. NHS Executive. Information for health: an information strategy for the modern NHS 1998-2005. Leeds: NHS Executive, 1998.
7. Kim P, Eng TR, Deering MJ, Maxfield A. Published criteria for evaluating health related web sites: review. BMJ 1999; 318: 647-649[Abstract/Free Full Text].
8. Coulter A. Give patients solid information. Management in General Practice 1996; 20: 40-42.
9. Entwistle VA, Sowden AJ, Watt IS. Evaluating interventions to promote patient involvement in decision-making: by what criteria should effectiveness be judged? J Health Serv Res Policy 1998; 3: 100-107[Medline].
10. Coulter A. Evidence based patient information. BMJ 1998; 317: 225-226[Free Full Text].
11. Entwistle VA, Sheldon TA, Sowden AJ, Watt IS. Supporting consumer involvement in decision making: what constitutes quality in consumer health information? Int J Health Care 1996; 8: 425-437.
12. Jadad A, Gagliardi A. Rating health information on the internet. JAMA 1998; 279: 611-614[Abstract/Free Full Text].
13. Charnock D. The DISCERN handbook: quality criteria for consumer health information. Abingdon: Radcliffe Medical Press, 1998.
14. Charnock D, Shepperd S, Gann B, Needham G. DISCERN---an instrument for judging the quality of consumer health information on treatment choices. J Epidemiol Community Health 1999; 53: 105-111[Abstract].
15. Mitretek Systems Innovative Technology in the Public Interest. hitiweb.mitretek.org/hswg; accessed 2 August 1999.
16. Meade C, Smith CF. Readability formulas: cautions and criteria. Patient Educ Couns 1991; 17: 153-158.
17. Secker J, Pollard R. Writing leaflets for patients: guidelines for producing written information. Edinburgh: Health Education Board for Scotland, 1995.
18. Flesch R. A new readability yardstick. J Appl Psychol 1948; 32: 221-233.
19. Ewles L, Simnett I. Promoting health: a practical guide. London: Scutari Press, 1995.
20. Smith T. Information for patients. BMJ 1992; 305: 1242.
21. Sless D, Wiseman R. Writing about medicines for people. Canberra: Australian Government Publishing Service, 1997.
22. Wright P. Writing and information design of healthcare materials. In: Candlin C, Hyland K, eds. Writing: texts, processes and practices. London: Addison Wesley Longman, 1998.

(Accepted 11 August 1999)


© BMJ 1999

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Article

Paternalism or partnership?
Angela Coulter
BMJ 1999 319: 719-720. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

  • Rennie, C. A, Hannan, S., Maycock, N., Kang, C. (2007). Age-related macular degeneration: what do patients find on the internet?. JRSM 100: 473-477 [Abstract] [Full text]  
  • Porter, A., Edirippulige, S. (2007). Parents of Deaf Children Seeking Hearing Loss-Related Information on the Internet: the Australian Experience. J Deaf Stud Deaf Educ 12: 518-529 [Abstract] [Full text]  
  • Chambers, S. A., Rahman, A., Isenberg, D. A. (2007). Treatment adherence and clinical outcome in systemic lupus erythematosus. Rheumatology (Oxford) 46: 895-898 [Full text]  
  • Podichetty, V K, Booher, J, Whitfield, M, Biscup, R S (2006). Assessment of internet use and effects among healthcare professionals: a cross sectional survey.. Postgrad. Med. J. 82: 274-279 [Abstract] [Full text]  
  • McCray, A. T. (2005). Promoting Health Literacy. J. Am. Med. Inform. Assoc. 12: 152-163 [Abstract] [Full text]  
  • Anderson, J. G. (2004). Consumers of e-Health: Patterns of Use and Barriers. Social Science Computer Review 22: 242-248 [Abstract]  
  • Benigeri, M., Pluye, P. (2003). Shortcomings of health information on the Internet. HEALTH PROMOT INT 18: 381-386 [Abstract] [Full text]  
  • Solomons, R. E. B. (2003). Assisted Internet Access for Patients in a General Practitioner Surgery: Helping the Information Poor. Health Informatics Journal 9: 199-206 [Abstract]  
  • Bouchier, H., Bath, P. A. (2003). Evaluation of Websites that Provide Information on Alzheimer's Disease. Health Informatics Journal 9: 17-31 [Abstract]  
  • Al-Shahi, R, Sadler, M, Rees, G, Bateman, D (2002). The internet. J. Neurol. Neurosurg. Psychiatry 73: 619-628 [Abstract] [Full text]  
  • Howitt, A., Clement, S., de Lusignan, S., Thiru, K., Goodwin, D., Wells, S. (2002). An evaluation of general practice websites in the UK. Fam Pract 19: 547-556 [Abstract] [Full text]  
  • Manheimer, E., Anderson, D. (2002). Survey of public information about ongoing clinical trials funded by industry: evaluation of completeness and accessibility. BMJ 325: 528-531 [Abstract] [Full text]  
  • Treweek, S. P., Glenton, C., Oxman, A. D., Penrose, A. (2002). Computer-generated Patient Education Materials: Do They Affect Professional Practice? : A Systematic Review. J. Am. Med. Inform. Assoc. 9: 346-358 [Abstract] [Full text]  
  • VandeKieft, G. K., Ogle, K. S., Wang, T. (2001). Internet resources for end-of-life care. AM J HOSP PALLIAT CARE 18: 313-320 [Abstract]  
  • Doyal, L (2001). Informed consent: moral necessity or illusion?. Qual Saf Health Care 10: i29-33 [Abstract] [Full text]  
  • Kotak, A., Butler, R. (2001). Do trainees have adequate access to computers and computer software ?. Psychiatr. Bull. 25: 31-32 [Abstract] [Full text]  
  • Smith, M., Gertz, E., Alvarez, S., Lurie, P. (2000). The Content and Accessibility of Sex Education Information on the Internet. Health Educ Behav 27: 684-694 [Abstract]  
  • Eysenbach, G. (2000). Recent advances: Consumer health informatics. BMJ 320: 1713-1716 [Full text]  
  • Pal, B. (2000). Internet helps communication between doctors and patients. BMJ 320: 59-59 [Full text]  
  • Pandolfini, C., Impicciatore, P., Bonati, M. (2000). Parents on the Web: Risks for Quality Management of Cough in Children. Pediatrics 105: e1-e1 [Abstract] [Full text]  
  • Coulter, A. (1999). Paternalism or partnership?. BMJ 319: 719-720 [Full text]  



Access all current jobs at BMJ Group
Whats new online at Student 

BMJ
Listen to the latest 

BMJ Interview