BMJ 1998;317:264-265 ( 25 July )

Information in practice

Evaluation of readability and accuracy of information leaflets in general practice for patients with asthma

Editorial by Coulter

Helen Smith, directora Susan Gooding, research and development nursea Richard Brown, general practitionerb Anthony Frew, senior lecturerc

a Wessex Primary Care Research Network, Primary Medical Care, University of Southampton, Southampton SO16 5ST, b Wilton Health Centre, Wilton SP2 0HT, c University Medicine, Southampton General Hospital, Southampton SO16 6YD

Correspondence to: Dr Smith hes{at}soton.ac.uk

Printed education materials are often used to augment healthcare professionals' verbal information to patients. Asthma is one of the commonest chronic diseases managed in general practice, and many leaflets have been produced on its diagnosis, prognosis, management, and treatment, but these have been subjected to little critical review.

    Subjects, methods, and results
Top
Subjects, methods, and results
Comment
References

We evaluated the readability and accuracy of patient information leaflets available in general practice for asthmatic patients. We invited 70 general practices from the Wessex Research Network to send one copy of each of the leaflets they had on asthma: 168 different leaflets were received from 49 practices. We reviewed the leaflets for readability using the simple measure of gobbledegook (SMOG) formula, which estimates the level of education required to understand the text.1 AF reviewed the leaflets for congruency with current British Thoracic Society guidelines2 and accuracy in other areas.

The reading grade for these publications ranged from 5 to 12 (mode 8, mean 8.66 (SD 1.79)) (table), and 39 (23%) contained inaccuracies.

                              
View this table:
[in this window]
[in a new window]
 

Readability of patient information leaflets about asthma

The British Thoracic Society guidelines were not applicable to 78 of the leaflets. Of the rest, 58 were fully congruent, 21 were >90% accurate, and 11 were inaccurate. Six inaccurate leaflets were produced by charities, the other five by drug companies. Seven of these leaflets contained therapeutic advice that was out of date. One recent publication ignored the effects of chronic exposure to cats. Another denied the presence of inflammation in mild disease. Three of the inaccurate leaflets had no publication date, and all but one of the rest were at least six years old; several practices sent a leaflet 13 years old.

Thirty four leaflets (20%) contained inaccurate or misleading statements about areas outside the society guidelines. These included unreasonable advice on the need to see a doctor, exaggerating the role of cola drinks as a trigger, inexact advice on avoiding house dust mite allergens, incorrect information on the efficacy of desensitising injections, wrong contact addresses and telephone numbers, and misinformation about obtaining a peak flow meter and not acknowledging the wide range of devices available.

    Comment
Top
Subjects, methods, and results
Comment
References

Five and a half million people in Britain have reading difficulties,3 and considerably more (22% of the working population) have a low level of literacy.4 Text with SMOG scores under 5 will be understood by most people (information from Basic Skills Agency, 1992), and it is recommended that health literature should be written at a SMOG score =<5.5 To attain high levels of reader comprehension would require revision of 97% of the leaflets we reviewed. Rather than attempting wholesale revision, it is more realistic to match readers with existing materials and to strive for low readability scores in replacement leaflets.

Readability formulae have limitations; ideally, testing with patients should also be done as reading is a complex process and ability to comprehend a text is influenced by presentation (organisation, print, illustrations), situation (stress), and reader characteristics (motivation, maturity). Formulae based on word length disregard patients' familiarity with the vocabulary associated with their illness, thereby overestimating the difficulty of the text.

None of the inaccuracies highlighted posed a serious threat to patient wellbeing, but patients deserve to receive complete, current information about treatment and health education. Practices sent copies of every leaflet that they had, so this may have included leaflets not normally used. Less desirable leaflets may not be given to patients, but while these remain in the practice there is the potential that they may be used.

To ensure that patients receive good advice we recommend that healthcare professionals read leaflets before giving them to patients to ensure that the content is accurate and up to date; assess patients' reading abilities and select material to suit; and, perhaps most importantly, review stocks of leaflets regularly and discard those that are out of date or inaccurate to reduce the risk of misinforming patients.

    Acknowledgments

We thank all the practices that took part in the study and the administrative and support staff of the Wessex Research Network---Joan Dunleavey, Christine Tresise, and Sylvia Craigie-Halkett.

Contributors: HS initiated the study, designed the protocols, and participated in writing the paper. SG coordinated the collection of data, undertook the analysis of readability, and participated in writing the paper. RB participated in data interpretation and in writing the paper. AF provided expert review of the leaflets' accuracy and participated in writing the paper. HS is guarantor for the paper.

Funding: Grant from Allen and Hanburys.

Conflict of interest: None.

    References
Top
Subjects, methods, and results
Comment
References

  1. McLaughlin GH. SMOG grading---a new readability formula. J Reading 1969; 12: 639-646.
  2. British Thoracic Society guidelines. Thorax 1997; 52(suppl): S1-22[Free Full Text].
  3. Basic Skills Agency. Making reading easier. London: Basic Skills Agency , 1992.
  4. Carey S, Low S, Hansbro J. Adult literacy in Britain. London: Office for National Statistics , 1997.
  5. Estey A, Musseau A, Keehn L. Comprehension levels of patients reading health information. Patient Education Counselling 1991; 18: 165-169, 1996;30:205-8.

(Accepted 5 May 1998)


© BMJ 1998

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Articles

Evidence based patient information
P V Gardiner, Ray Jones, Robert Thomas, and Ken Campbell
BMJ 1999 318: 461. [Extract] [Full Text]

Evidence based patient information
Angela Coulter
BMJ 1998 317: 225-226. [Extract] [Full Text]

This article has been cited by other articles:

  • Marshall, L. A., Williams, D. (2006). Health information: does quality count for the consumer?: How consumers evaluate the quality of health information materials across a variety of media. Journal of Librarianship and Information Science 38: 141-156 [Abstract]  
  • Clerehan, R., Buchbinder, R., Moodie, J. (2005). A linguistic framework for assessing the quality of written patient information: its use in assessing methotrexate information for rheumatoid arthritis. Health Educ Res 20: 334-344 [Abstract] [Full text]  
  • Rudd, R. E., Zobel, E. K., Fanta, C. H., Surkan, P., Rodriguez-Louis, J., Valderrama, Y., Daltroy, L. H. (2004). Asthma: In Plain Language. Health Promot Pract 5: 334-340 [Abstract]  
  • Carter, L., Bowman, D., Oakeshott, P. (2003). Informed consent for Screening. Fam Pract 20: 222-222 [Full text]  
  • Risk, A., Petersen, C. (2002). Health Information on the Internet: Quality Issues and International Initiatives. JAMA 287: 2713-2715 [Full text]  
  • Fitzmaurice, D A (2001). Written information for treating minor illness. BMJ 322: 1193-1194 [Full text]  
  • Estrada, C. A., Hryniewicz, M. M., Higgs, V. B., Collins, C., Byrd, J. C. (2000). Anticoagulant Patient Information Material Is Written at High Readability Levels. Stroke 31: 2966-2970 [Abstract] [Full text]  
  • Dixon-Woods, M. (2000). The production of printed consumer health information: order from chaos?. Health Education Journal 59: 108-115  
  • Gardiner, P V, Jones, R., Thomas, R., Campbell, K. (1999). Evidence based patient information. BMJ 318: 461-461 [Full text]  
  • Coulter, A. (1998). Evidence based patient information. BMJ 317: 225-226 [Full text]  

Rapid Responses:

Read all Rapid Responses

Conflicting considerations in design of leaflets
Ken Campbell
bmj.com, 24 Jul 1998 [Full text]
Use of the primary healthcare team for full evaluation of patient leaflets
Manish Pareek
bmj.com, 28 Jul 1998 [Full text]
Factors affecting the use and improvement of Web-based information
Sally Tweddle
bmj.com, 30 Jul 1998 [Full text]



Access jobs at BMJ Careers
Whats new online at Student 

BMJ