BMJ 1999;318:647-649 ( 6 March )

Information in practice

Published criteria for evaluating health related web sites: review

Paul Kim, research assistant, a Thomas R Eng, study director, a Mary Jo Deering, director, a Andrew Maxfield, research fellow. b

a Health Communication and Telehealth, Office of Disease Prevention and Health Promotion, US Department of Health and Human Services, Washington DC, USA, b National Institute for Occupational Safety and Health, Centers for Disease Control and Prevention, Washington DC

Correspondence to: Dr Eng teng{at}osophs.dhhs.gov

Objective: To review published criteria for specifically evaluating health related information on the world wide web, and to identify areas of consensus.
Design: Search of world wide web sites and peer reviewed medical journals for explicit criteria for evaluating health related information on the web, using Medline and Lexis-Nexis databases, and the following internet search engines: Yahoo!, Excite, Altavista, Webcrawler, HotBot, Infoseek, Magellan Internet Guide, and Lycos. Criteria were extracted and grouped into categories.
Results: 29 published rating tools and journal articles were identified that had explicit criteria for assessing health related web sites. Of the 165 criteria extracted from these tools and articles, 132 (80%) were grouped under one of 12 specific categories and 33 (20%) were grouped as miscellaneous because they lacked specificity or were unique. The most frequently cited criteria were those dealing with content, design and aesthetics of site, disclosure of authors, sponsors, or developers, currency of information (includes frequency of update, freshness, maintenance of site), authority of source, ease of use, and accessibility and availability.
Conclusions: Results suggest that many authors agree on key criteria for evaluating health related web sites, and that efforts to develop consensus criteria may be helpful. The next step is to identify and assess a clear, simple set of consensus criteria that the general public can understand and use.


Key messages

  • Many organisations and individuals have published criteria to evaluate health related information on the world wide web

  • A literature and world wide web search found that the most frequently cited criteria were those dealing with content, design and aesthetics of site, disclosure of authors, sponsors, or developers, currency of information, authority of source, and ease of use

  • Criteria related to confidentiality and privacy were only cited by one author

  • Consensus regarding critical criteria for evaluation of web based health information seems to be emerging

  • Our results indicate that many authors agree on key criteria for evaluating health related web sites, and that efforts to develop a set of key criteria may be helpful




© BMJ 1999
Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to StumbleUpon StumbleUpon   Add to Technorati Technorati    What's this?

Relevant Article

Consensus on criteria for evaluating health related web sites is emerging
BMJ 1999 318: 0. [Full Text]

This article has been cited by other articles:

  • STINSON, J. N., TUCKER, L., HUBER, A., HARRIS, H., LIN, C., COHEN, L., GILL, N., LUKAS-BRETZLER, J., PROULX, L., PROWTEN, D. (2009). Surfing for Juvenile Idiopathic Arthritis: Perspectives on Quality and Content of Information on the Internet. The Journal of Rheumatology 36: 1755-1762 [Abstract] [Full text]  
  • Akram, G, Thomson, A H, Boyter, A C, Morton, M J S (2008). Characterisation and evaluation of UK websites on attention deficit hyperactivity disorder. Arch. Dis. Child. 93: 695-700 [Abstract] [Full text]  
  • Marriott, J. V., Stec, P., El-Toukhy, T., Khalaf, Y., Braude, P., Coomarasamy, A. (2008). Infertility information on the World Wide Web: a cross-sectional survey of quality of infertility information on the internet in the UK. Hum Reprod 23: 1520-1525 [Abstract] [Full text]  
  • Datta, A. K, Selman, T. J, Kwok, T., Tang, T., Khan, K. S (2008). Quality of information accompanying on-line marketing of home diagnostic tests. JRSM 101: 34-38 [Abstract] [Full text]  
  • Harrison, S., Barlow, J., Williams, G. (2007). The content and interactivity of health support group websites. Health Education Journal 66: 371-381 [Abstract]  
  • Fragoulis, K. N., Vardakas, K. Z., Falagas, M. E. (2007). Open access World Wide Web resources on urogenital infections. Nephrol Dial Transplant 22: 3046-3047 [Abstract] [Full text]  
  • Harland, J., Bath, P. (2007). Assessing the quality of websites providing information on multiple sclerosis: evaluating tools and comparing sites. Health Informatics Journal 13: 207-221 [Abstract]  
  • Pappas, G., Falagas, M. E. (2007). Free Internal Medicine Case-Based Education Through the World Wide Web: How, Where, and With What?. Mayo Clin Proc. 82: 203-207 [Abstract] [Full text]  
  • St Leger, L. (2006). Communication technologies and health promotion: opportunities and challenges. HEALTH PROMOT INT 21: 169-171 [Full text]  
  • Papadaki, A, Scott, J A (2006). Process evaluation of an innovative healthy eating website promoting the Mediterranean diet. Health Educ Res 21: 206-218 [Abstract] [Full text]  
  • Hargrave, D. R., Hargrave, U. A., Bouffet, E. (2006). Quality of health information on the Internet in pediatric neuro-oncology. Neuro Oncol Duke 8: 175-182 [Abstract] [Full text]  
  • Shaikh, U., Scott, B. J. (2005). Extent, Accuracy, and Credibility of Breastfeeding Information on the Internet. J Hum Lact 21: 175-183 [Abstract]  
  • Martins, E N, Morse, L S (2005). Evaluation of internet websites about retinopathy of prematurity patient education. Br J Ophthalmol 89: 565-568 [Abstract] [Full text]  
  • McCray, A. T. (2005). Promoting Health Literacy. J. Am. Med. Inform. Assoc. 12: 152-163 [Abstract] [Full text]  
  • Charnock, D., Shepperd, S. (2004). Learning to DISCERN online: applying an appraisal tool to health websites in a workshop setting. Health Educ Res 19: 440-446 [Abstract] [Full text]  
  • Bachman, J. A., Brennan, P. F., Patrick, T. B. (2003). Design and Evaluation of SchoolhealthLink, a Web-Based Health Information Resource. The Journal of School Nursing 19: 351-357 [Abstract] [Full text]  
  • Benigeri, M., Pluye, P. (2003). Shortcomings of health information on the Internet. HEALTH PROMOT INT 18: 381-386 [Abstract] [Full text]  
  • Sheehan, N. L, Kelly, D. V, Tseng, A. L, van Heeswijk, R. P., Beique, L. C, Hughes, C. A (2003). Evaluation of HIV Drug Interaction Web Sites. The Annals of Pharmacotherapy 37: 1577-1586 [Abstract] [Full text]  
  • Theodosiou, L., Green, J. (2003). Emerging challenges in using health information from the internet. Adv. Psychiatr. Treat. 9: 387-396 [Abstract] [Full text]  
  • Bath, P. A., Bouchier, H. (2003). Development and Application of a Tool Designed to Evaluate Web Sites Providing Information on Alzheimer's Disease. Journal of Information Science 29: 279-297 [Abstract]  
  • Cheh, J. A., Ribisl, K. M., Wildemuth, B. M. (2003). An Assessment of the Quality and Usability of Smoking Cessation Information on the Internet. Health Promot Pract 4: 278-287 [Abstract]  
  • Bouchier, H., Bath, P. A. (2003). Evaluation of Websites that Provide Information on Alzheimer's Disease. Health Informatics Journal 9: 17-31 [Abstract]  
  • Neuhauser, L., Kreps, G. L. (2003). Rethinking Communication in the E-health Era. J Health Psychol 8: 7-23 [Abstract]  
  • Barnes, M. D., Penrod, C., Neiger, B. L., Merrill, R. M., Thackeray, R., Eggett, D. L., Thomas, E. (2003). Measuring the Relevance of Evaluation Criteria among Health Information Seekers on the Internet. J Health Psychol 8: 71-82 [Abstract]  
  • Al-Shahi, R, Sadler, M, Rees, G, Bateman, D (2002). The internet. J. Neurol. Neurosurg. Psychiatry 73: 619-628 [Abstract] [Full text]  
  • Bensley, R. J., Lewis, J. B. (2002). Analysis of Internet-Based Health Assessments. Health Promot Pract 3: 463-476 [Abstract]  
  • Howitt, A., Clement, S., de Lusignan, S., Thiru, K., Goodwin, D., Wells, S. (2002). An evaluation of general practice websites in the UK. Fam Pract 19: 547-556 [Abstract] [Full text]  
  • Fallis, D., Fricke, M. (2002). In reply:--. J. Am. Med. Inform. Assoc. 9: 403-404 [Full text]  
  • Wolfe, R. M., Sharp, L. K., Lipsky, M. S. (2002). Content and Design Attributes of Antivaccination Web Sites. JAMA 287: 3245-3248 [Abstract] [Full text]  
  • Eysenbach, G., Powell, J., Kuss, O., Sa, E.-R. (2002). Empirical Studies Assessing the Quality of Health Information for Consumers on the World Wide Web: A Systematic Review. JAMA 287: 2691-2700 [Abstract] [Full text]  
  • Croft, D. R., Peterson, M. W. (2002). An Evaluation of the Quality and Contents of Asthma Education on the World Wide Web*. Chest 121: 1301-1307 [Abstract] [Full text]  
  • Kunst, H., Groot, D., Latthe, P. M, Latthe, M., Khan, K. S (2002). Accuracy of information on apparently credible websites: survey of five common health topics. BMJ 324: 581-582 [Full text]  
  • D'Alessandro, D., Kingsley, P. (2002). Creating a Pediatric Digital Library for Pediatric Health Care Providers and Families: Using Literature and Data to Define Common Pediatric Problems. J. Am. Med. Inform. Assoc. 9: 161-170 [Abstract] [Full text]  
  • Clement, W A, Wilson, S, Bingham, B J (2002). A guide to creating your own patient-oriented website. JRSM 95: 64-67 [Full text]  
  • Fallis, D., Fricke, M. (2002). Indicators of Accuracy of Consumer Health Information on the Internet: A Study of Indicators Relating to Information for Managing Fever in Children in the Home. J. Am. Med. Inform. Assoc. 9: 73-79 [Abstract] [Full text]  
  • VandeKieft, G. K., Ogle, K. S., Wang, T. (2001). Internet resources for end-of-life care. AM J HOSP PALLIAT CARE 18: 313-320 [Abstract]  
  • Berland, G. K., Elliott, M. N., Morales, L. S., Algazy, J. I., Kravitz, R. L., Broder, M. S., Kanouse, D. E., Munoz, J. A., Puyol, J.-A., Lara, M., Watkins, K. E., Yang, H., McGlynn, E. A. (2001). Health Information on the Internet: Accessibility, Quality, and Readability in English and Spanish. JAMA 285: 2612-2621 [Abstract] [Full text]  
  • Coomarasamy, A., Latthe, P., Papaioannou, S., Publicover, M., Gee, H., Khan, K. S (2001). Critical appraisal in clinical practice: sometimes irrelevant, occasionally invalid. JRSM 94: 573-577 [Abstract] [Full text]  
  • Smith, M., Gertz, E., Alvarez, S., Lurie, P. (2000). The Content and Accessibility of Sex Education Information on the Internet. Health Educ Behav 27: 684-694 [Abstract]  
  • Edejer, T. T.-T. (2000). Disseminating health information in developing countries: the role of the internet. BMJ 321: 797-800 [Full text]  
  • ARMSTRONG, R. (2000). http://www.ilar.org A source of information for rheumatologists, allied health professionals, medical students and the general public. Ann Rheum Dis 59: 241-242 [Full text]  
  • Jadad, A. R., Haynes, R. B., Hunt, D., Browman, G. P. (2000). The Internet and evidence-based decision-making: a needed synergy for efficient knowledge management in health care. CMAJ 162: 362-365 [Full text]  
  • Jadad, A. R (1999). Promoting partnerships: challenges for the internet age. BMJ 319: 761-764 [Full text]  
  • Shepperd, S., Charnock, D., Gann, B. (1999). Helping patients access high quality health information. BMJ 319: 764-766 [Full text]  
  • Tramer, M. R. (1999). How Can We Cope with the Internet?. Anesth. Analg. 89: 271-271 [Full text]  

Rapid Responses:

Read all Rapid Responses

A wider application than just to doctors
Peter Murray
bmj.com, 11 Mar 1999 [Full text]
Internet evaluation tools better aimed at professionals
Michelle Gillies
bmj.com, 7 Apr 1999 [Full text]
Access jobs at BMJ Careers
Whats new online at Student BMJ