Papers

Prospective cohort study of routine use of risk assessment scales for prediction of pressure ulcers

Lisette Schoonhoven, PhD student ^a, Jeen R E Haalboom, associate professor of medicine ^b, Mente T Bousema, dermatologist ^c, Ale Algra, associate professor of clinical epidemiology ^a, Diederick E Grobbee, professor of clinical epidemiology ^a, Maria H Grypdonck, professor of nursing sciences ^a, Erik Buskens, assistant professor of medical technology assessment ^a,  for the prePURSE study group

^a Julius Centre for Health Sciences and Primary Care, University Medical Centre Utrecht, PO Box 85500, 3508 GA, Utrecht, Netherlands, ^b Department of Internal Medicine, University Medical Centre Utrecht, ^c Department of Dermatology, Eemland Hospital, PO Box 1502, 3800 BM, Amersfoort, Netherlands

Correspondence to: L Schoonhoven L.Schoonhoven{at}jc.azu.nl

	Abstract

Top Abstract Introduction Methods Results Discussion References

Objective: To evaluate whether risk assessment scales can be used to identify patients who are likely to get pressure ulcers.
Design: Prospective cohort study.
Setting: Two large hospitals in the Netherlands.
Participants: 1229 patients admitted to the surgical, internal, neurological, or geriatric wards between January 1999 and June 2000.
Main outcome measure: Occurrence of a pressure ulcer of grade 2 or worse while in hospital.
Results: 135 patients developed pressure ulcers during four weeks after admission. The weekly incidence of patients with pressure ulcers was 6.2% (95% confidence interval 5.2% to 7.2%). The area under the receiver operating characteristic curve was 0.56 (0.51 to 0.61) for the Norton scale, 0.55 (0.49 to 0.60) for the Braden scale, and 0.61 (0.56 to 0.66) for the Waterlow scale; the areas for the subpopulation, excluding patients who received preventive measures without developing pressure ulcers and excluding surgical patients, were 0.71 (0.65 to 0.77), 0.71 (0.64 to 0.78), and 0.68 (0.61 to 0.74), respectively. In this subpopulation, using the recommended cut-off points, the positive predictive value was 7.0% for the Norton, 7.8% for the Braden, and 5.3% for the Waterlow scale.
Conclusion: Although risk assessment scales predict the occurrence of pressure ulcers to some extent, routine use of these scales leads to inefficient use of preventive measures. An accurate risk assessment scale based on prospectively gathered data should be developed.

What is already known on this topic The incidence of pressure ulcers in hospitalised patients varies between 2.7% and 29.5% Guidelines for prevention of pressure ulcers base the allocation of labour and resource intensive measures on the outcome of risk assessment scales Most risk assessment scales are based on expert opinion or literature review and have not been evaluated The sensitivity and specificity of risk assessment scales vary What this study adds The effectiveness of available risk assessment scales is limited Use of the outcome of risk assessment scales leads to inefficient allocation of preventive measures

	Introduction

Top Abstract Introduction Methods Results Discussion References

Pressure ulcers are the third costliest disorder, after cancer and cardiovascular diseases.¹ The proportion of patients newly admitted to hospital that developed pressure ulcers varied from 3% to 30%.^2-7 Preventive measures are expensive and labour intensive: patients at risk of developing pressure ulcers should be identified. ^{8 9}

At least 40 risk assessment scales exist.¹⁰ Only six risk assessment scales have been tested for their predictive validity.¹⁰ The results varied, and little evidence of predictive value or accuracy of the scales was available. ^{2 8 10-13} Moreover, most of the studies had methodological limitations¹⁰: they were small and conducted in varying populations. Also, in some studies the nurse was not blinded when doing the scoring nor were the results adjusted to take account of preventive measures.

Despite these shortcomings, the Braden and Norton scales are recommended tools in North American guidelines for the prevention of pressure ulcers.³ In the United Kingdom, the Waterlow and Norton scales are the two scales most commonly used,¹² and expensive preventive measures are taken based on their outcome. Because the Norton,¹⁴ Braden,¹⁵ and Waterlow scales (www.awma.com.au/pages/Guidelines.pdf),¹⁶ can be viewed as a standard of reference and are recommended in several practice guidelines, we chose to evaluate their predictive value in a prospective cohort of 1229 hospitalised patients.

	Methods

Top Abstract Introduction Methods Results Discussion References

The prevention and pressure ulcer risk score evaluation study (prePURSE) is a prospective cohort study that includes patients from the Utrecht University Medical Centre and Eemland Hospital, Amersfoort, the Netherlands. Between January 1999 and June 2000, patients admitted to the surgical, internal, neurological, and geriatric wards were asked to participate in the study. Patients without pressure ulcers, older than 18 years, and with an expected admission of at least five days were eligible. A quarter (1536) of a total of 6000 eligible patients were visited, of whom 93% (1431) agreed to participate. Eventually, 80% of patients (1229) had at least one follow up visit before discharge.

Data collection
A research nurse visited patients within 48 hours of admission and once a week subsequently until they developed a pressure ulcer, were discharged, or had stayed in hospital for more than 12 weeks. A nurse checked for the presence of pressure ulcers and collected information on all risk factors included in the risk assessment scales (see bmj.com). The scales sum the points for individual items into one overall score. A threshold given by the original author of the scale divides the patients into at risk or not at risk for developing pressure ulcers. At each visit, we collected information on preventive measures. Attending nurses were blinded for the observations by the research nurse.

Pressure ulcers were classified according to the four grades of the European pressure ulcer advisory panel.¹⁷ Pressure ulcers of grade 2 or worse were included.¹⁷ Preventive measures were included if, at the time the skin was inspected, the patient had a pressure reducing mattress or bed or was repositioned regularly.

Analysis
Patient's scores on the Norton, Braden, and Waterlow scales were calculated for each visit. The ability of the scales to predict whether pressure ulcers will develop was determined from the area under the receiver operating characteristic curve.

	Results

Top Abstract Introduction Methods Results Discussion References

A total of 135 (11%) patients developed pressure ulcers while in hospital. Most pressure ulcers (129) developed in the first four weeks. Overall, the weekly incidence of patients with pressure ulcers was 6.2% (95% confidence interval 5.2% to 7.2%).

A total of 57 patients received preventive measures for 101 patient weeks in total. Patients receiving preventive measures were about five years older than those not receiving such measures, and a higher proportion developed pressure ulcers (17.8% v 5.5%) (table 1). Most patients at risk, according to the assessment scales, did not receive preventive measures; some patients considered not at risk did receive preventive measures.

For all patients, the area under the curve for the first week of follow up was 0.51 (0.44 to 0.58) for the Norton scale, 0.52 (0.45 to 0.59) for the Braden scale, and 0.60 (0.53 to 0.66) for the Waterlow scale (figure). Results were similar when the 57 patients who received preventive measures without developing pressure ulcers were excluded. With both the 57 patients who received preventive measures without developing pressure ulcers and the 747 surgical patients excluded, the areas under the curve were 0.69 (0.63 to 0.76), 0.70 (0.63 to 0.77), and 0.67 (0.61 to 0.73), respectively. Excluding only the 747 surgical patients gave similar results. In subsequent weeks, the areas under the curves for the risk assessment scales did not differ substantially between the subpopulation and the entire group (see bmj.com).

View larger version (14K): [in this window] [in a new window]   Receiver operating characteristic curves for Norton, Braden, and Waterlow risk assessment scales in the first week, including all patients (top) and for all weeks combined, in subpopulation excluding surgical patients and patients with preventive measures who did not develop pressure ulcers (bottom)

For all patients over all weeks (2190 patient weeks), the areas under the curves did not satisfactorily predict pressure ulcer development. In the subpopulation excluding patients who received preventive measures without developing pressure ulcers (83 patient weeks) and surgical patients (752 patient weeks), the areas under the curve indicated relatively good performance of the risk (table 2; figure). Therefore, we also calculated the positive predictive values, negative predictive values, sensitivity, and specificity of the scales at their respective cut-off points (table 2).

	Discussion

Top Abstract Introduction Methods Results Discussion References

The three scales most commonly used to assess the risk of developing pressure ulcersthe Norton, Braden, and Waterlow scalesdo not satisfactorily predict pressure ulcer development in patients admitted to hospital. This may be because the risk assessment scales are based on clinical observation and pathophysiological insights, and not on adequate prospective or prognostic research.

Preventive measures
Preventive measures may modify the association between scores on risk assessment scales and the development of pressure ulcers. To assess the effect of these measures on the association between risk assessment scales and development of pressure ulcers we excluded only those patients who received measures and did not develop pressure ulcers. The results did not differ from those for the total population; preventive measures did not affect the association between score on risk assessment scales and the development of pressure ulcers. We considered pressure reducing mattresses or beds and regular repositioning to be preventive measures. As there are no conclusive comparative studies on effectiveness of these measures, we did not distinguish between them.

Week of admission
The first and later weeks of follow up differed in discriminative ability. This may be explained by differences in patients' characteristics over the period of admission. In the first week of admission more than half of the patients (747) had undergone surgery; surgery is considered a risk factor for pressure ulcer development.¹⁸ Incidence of pressure ulcers in surgical patients varies from 19% to 66%,¹⁸ and almost a quarter (23%) of the pressure ulcers which develop in the hospital may be acquired intraoperatively.¹⁹ Intraoperatively acquired pressure ulcers, however, still could not have been predicted. Including imminent surgery as a factor in the risk assessment might improve prediction.

The discriminative ability of the scales in all weeks of follow up did not change greatly when surgical patients were excluded. We combined the data of the different weeks of follow up. The scales are able to predict whether or not a patient develops a pressure ulcer in 70% of the cases. Only 5% to 8%, however, of the patients for whom the risk assessment scales recommend receiving preventive measures actually develop pressure ulcers. Although the scales predict development of pressure ulcers, to some extent, strict application of the scales leads to inefficient use of preventive measures.

Previous studies
Although some earlier studies reported higher sensitivity and specificity for the Norton and Braden scales, ^{8 14 15} we have confidence in our results. We defined pressure ulcers as grade 2 or worse. Older lesions of the skin would still have been visible as a scab at a subsequent visit. Consequently, no pressure ulcers could have been missed. Also, the results of the earlier studies may well have been flawed because preventive measures were not taken into account.¹² Preventive measures may have stopped pressure ulcers developing. Most preventive measures were taken in patients who were not at risk, according to the risk assessment scales. In fact, in only 67 (8%) of the patient weeks which the Norton scale considered high risk, preventive measures were given. Despite prevention, eight patients developed pressure ulcers. Accordingly, the performance of the Norton scale may have been modified only in 7% (59) of the patient weeks at risk. A similar outcome was found for the other two scales: the effect of preventive measures was small.

As the incidence of pressure ulcers is low, it may not be possible to improve much on the prediction of pressure ulcers. Eventually, it may be more effective to treat a grade 1 pressure ulcer immediately than to try to "predict and prevent."

Conclusion
The broadly advocated advice to use risk assessment scales for pressure ulcers and to use the outcomes to decide on preventive measures leads to ineffective and inefficient treatment for most patients. Future research should identify factors actually associated with the development of pressure ulcers and evidence based risk assessment scales should be constructed.

	Acknowledgments

Contributors: see bmj.com

	Footnotes

Funding: Zorg Onderzoek Nederland (ZON) (Praeventiefonds 28-2821).

Competing interests: None declared.

This is an abridged version; the full version is on bmj.com

	References

Top Abstract Introduction Methods Results Discussion References

1.	Health Council of the Netherlands. Pressure ulcers. The Hague: Health Council of the Netherlands, 1999. (Publication No 1999/23.)
2.	Clark M, Farrar S. Comparison of pressure sore risk calculators. In: Harding KG, Leaper DL, eds. Proceedings of the first European conference on advances in wound management, 1991, Cardiff, United Kingdom. London: Macmillan, 1991:158-162.
3.	Panel for the prediction and prevention of pressure ulcers in adults. Pressure ulcers in adults: prediction and prevention. Rockville: Agency for Health Care Policy and Research, Public Health Service, US Department of Health and Human Services, 1992. (Clinical practice guideline number 3; AHCPR Publication No 92-0047.)
4.	Goodridge DM, Sloan JA, LeDoyen YM, McKenzie JA, Knight WE, Gayari M. Risk-assessment scores, prevention strategies, and the incidence of pressure ulcers among the elderly in four Canadian health-care facilities. Can J Nurs Res 1998; 30: 23-44[Medline].
5.	Bergstrom N, Braden B, Kemp M, Champagne M, Ruby E. Multi-site study of incidence of pressure ulcers and the relationship between risk level, demographic characteristics, diagnoses, and prescription of preventive interventions. J Am Geriatr Soc 1996; 44: 22-30[Web of Science][Medline].
6.	Allman RM, Goode PS, Patrick MM, Burst N, Bartolucci AA. Pressure ulcer risk factors among hospitalized patients with activity limitation. JAMA 1995; 273: 865-870[Abstract/Free Full Text].
7.	Clark M, Watts S. The incidence of pressure sores within a National Health Service Trust hospital during 1991. J Adv Nurs 1994; 20: 33-36[CrossRef][Web of Science][Medline].
8.	Edwards M. The rationale for the use of risk calculators in pressure sore prevention, and the evidence of the reliability and validity of published scales. J Adv Nurs 1994; 20: 288-296[CrossRef][Web of Science][Medline].
9.	European pressure ulcer advisory panel (EPUAP). Pressure ulcer prevention guidelines. Oxford: EPUAP, 1999. www.epaup.org/glprevention.html (accessed 19 Aug 2002).
10.	Nixon J, McGough A. Principles of patient assessment: screening for pressure ulcers and potential risk. In: Morison M, ed. The prevention and treatment of pressure ulcers. 1st ed. London: Mosby, 2001:55-74.
11.	Haalboom JR, den Boer J, Buskens E. Risk-assessment tools in the prevention of pressure ulcers. Ostomy Wound Manage 1999; 45: 20-24.
12.	Edwards M. Pressure sore risk calculators: some methodological issues. J Clin Nurs 1996; 5: 307-312[Web of Science][Medline].
13.	Hamilton F. An analysis of the literature pertaining to pressure sore risk-assessment scales. J Clin Nurs 1992; 1: 185-193[CrossRef].
14.	Norton D, McLaren R, Exton-Smith AN. Pressure sores. In: An investigation of geriatric nursing problems in hospital. New York: Churchill Livingstone, 1975.
15.	Bergstrom N, Braden BJ, Laguzza A, Holman V. The Braden scale for predicting pressure sore risk. Nurs Res 1987; 36: 205-210[CrossRef][Web of Science][Medline].
16.	Waterlow J. Pressure sores: a risk assessment card. Nurs Times 1985; 81: 49-55.
17.	European Pressure Ulcer Advisory Panel (EPUAP). Guidelines on treatment of pressure ulcers. In: Oxford: EPAUP, 1999. www.epuap.org/gltreatment.html (accessed 17 Sep 2002).
18.	Stotts NA. Risk of pressure ulcer development in surgical patients: a review of the literature. Adv Wound Care 1999; 12: 127-136[Medline].
19.	Beckrich K, Aronovitch SA. Hospital-acquired pressure ulcers: a comparison of costs in medical vs. surgical patients. Nurs Econ 1999; 17: 263-271[Medline].

(Accepted 15 April 2002)