An epidemiological needs assessment of carotid endarterectomy in an English health region. Is the need being met?BMJ 1998; 317 doi: https://doi.org/10.1136/bmj.317.7156.447 (Published 15 August 1998) Cite this as: BMJ 1998;317:447
- G Ferris, research fellowa,
- P Roderick (), senior lecturera,
- A Smithies, research fellowa,
- S George, senior lecturera,
- J Gabbay, professora,
- N Couper, research fellowa,
- A Chant, consultant vascular surgeonb
- a Wessex Institute for Health Research and Development, University of Southampton, Southampton General Hospital, Southampton SO16 6YD
- b Department of Vascular Surgery, Southampton University Hospitals' Trust, Southampton SO16 6YD
- Correspondence to: Dr P Roderick, Wessex Institute for Health Research and Development, Mail point 805, Level B, South Academic Block, Southampton General Hospital, Southampton SO16 6YD
- Accepted 8 May 1998
Objective: To compare the level of provision of carotid endarterectomy (an intervention of proved efficacy for prevention of stroke in patients with symptomatic high grade carotid artery stenosis) with estimates of need.
Design: Comparison of regional, district, and age-sex specific operation rates derived from hospital episode statistics with estimates of need based on demographic and epidemiological data; interviews with regional vascular surgeons and a joint provider-purchaser workshop to discuss implications.
Setting: Former Wessex Regional Health Authority, 1991-2 to 1995-6.
Subjects: All residents covered by Wessex region treated for carotid artery reconstruction.
Main outcome measures: Regional, district, and age-sex operation rates as three year average 1993-6 (use) compared with respective estimates of need for carotid endarterectomy among those who presented with symptomatic carotid disease—transient ischaemic attack or minor stroke.
Results: The operation rate more than doubled between 1991-2 and 1995-6, from 35 to 89 per million population, compared with an estimated level of need in the region's general population of 153 per million population (transient ischaemic attack 77, minor stroke 76). The ratio of use to need was 0.47 (95% confidence interval 0.4 to 0.54); district ratios were 0.28 (0.19-0.38) to 0.81 (0.62 to 1.06). The annual use:need ratio rose over the three years 1993-6 from 0.38 to 0.59. Use:need ratios were lower in elderly and female patients. Providers were keen to develop guidelines for referral and to increase access to diagnostic facilities; purchasers were more reluctant, given the limited impact of this intervention on the incidence of stroke and the relatively high cost of the operation.
Conclusion: Although treatment rates increased in Wessex there is still unmet need. Further research is needed to determine the referral pathways of patients with symptomatic carotid disease for diagnosis and operation and to evaluate strategies to improve access to diagnostic facilities.
Robust evidence exists that carotid endarterectomy is an effective intervention for patients with symptomatic carotid disease and who have 70-99% stenosis
Operation rates increased in one English region after the production of national guidelines but were still half the estimate of population need
The ratio of operation rates to estimated need varied considerably by district health authority and was lower in elderly and female patients
Providers wanted to address this underprovision by improving referral and access to diagnostic ultrasound; purchasers emphasised the limited impact of carotid endarterectomy on the incidence of stroke in the general population
Even when agreement exists about the strength of evidence for an intervention, getting it into practice may not be straightforward when it is costly and dependent on complex pathways for diagnosis and treatment
Stroke is the third commonest cause of death in the United Kingdom and the commonest cause of physical disability.1 Each year 64 000 deaths (12% of all deaths) are attributed to stroke.1 Treating and managing patients who have had a stroke is estimated to consume about 4.0% of NHS resources.2
Carotid endarterectomy (the removal of atherosclerotic lesions from the inner wall of the common carotid artery extending up to the internal carotid artery) has a small but significant part to play in preventing disabling stroke. 2 3 Two randomised controlled trials—the North American symptomatic carotid endarterectomy trial and the European carotid surgery trial—showed the efficacy of carotid endarterectomy in preventing strokes in symptomatic patients (those with transient ischaemic attacks, amaurosis fugax, and minor stroke) with over 70% stenosis of the ipsilateral carotid artery. 4 5 The number needed to treat to prevent one stroke is estimated at 7-10 patients over a two to three year follow up. 4 5
In 1992 the Association of British Neurologists published guidelines recommending that, irrespective of age, all reasonably fit patients with a transient ischaemic attack, amaurosis fugax, or minor ischaemic strokes in the carotid artery territory who have made a good recovery within six months, should be investigated for carotid stenosis and other risks.6
Estimates suggest that if carotid endarterectomy were carried out on all eligible patients with transient ischaemic attack in England, the annual incidence of first ever strokes would decrease by 0.2-0.5%. 3 7 No estimates of the impact on minor strokes are available.
We compared the rate of carotid endarterectomy with estimated levels of need among patients who had presented to the NHS with symptomatic disease. We present information on the ratio of use to need overall, by district, and by age and sex, and we include the views expressed by regional vascular surgeons and purchasers. We discuss the implications for stroke prevention and for implementation of research evidence.
Current rates for carotid endarterectomy were derived from routine returns of inpatient activity hospital episode statistics by using the Wessex “Postbox” system. This database system enables purchasers and providers to exchange information about episodes of inpatient care.
We extracted entries for all carotid artery reconstructions (L29, according to operations coding by the Office of Population Censuses and Surveys8) performed on all residents covered by the former Wessex Regional Health Authority for the financial years 1991-2 to 1995-6. To improve the validity of the data we identified duplicates with cross checks on postcode, episode start and end dates, and patients' sex and date of birth. We judged records with the same postcode, date of birth, and sex as being valid or not depending on the episode dates in question. Thirty records were identified as duplicates and removed. We validated patients' ages against their date of birth. When missing, the age was calculated from the episode start date and the patient's date of birth.
The numbers of operations recorded per provider unit were confirmed during interviews with all the vascular surgeons performing carotid endarterectomy in Wessex and checked against the computer system run by surgeons in the largest surgical centre in Southampton. An estimated 30 operations were performed in the private sector in 1996 (A Chant, personal communication). For the years 1993-4 to 1995-6 we calculated three year average age-sex treatment rates, and district standardised treatment ratios for the six health authorities using the direct method of standardisation with the whole region as a standard population.9
To estimate the level of need for carotid endarterectomy, we applied the data on the incidence of transient ischaemic attack and stroke from the Oxford community stroke project 10 11 to the age-sex population structure of the six district health authorities in Wessex. This assumes a similar incidence of stroke in the two regions (the age standardised mortality for stroke for those under 65 years (average for 1990-2) was 9.63 per 100 000 in Oxford and 9.75 per 100 000 in Wessex12).
We then estimated the number of cases of transient ischaemic attack eligible for carotid endarterectomy according to various scenarios (fig 1). We used the age bands in the Oxford project. Age itself is not a bar to treatment, and during 1993-5, 8% of procedures in Wessex were in patients aged over 80 (2% in patients over 85). We assumed the percentage of patients with transient ischaemic attack with stenosis in the carotid territory to be 80%13 and of those with 70-99% stenosis to be 20%14 on the basis of a hospital series of cases of transient ischaemic attack referred for carotid angiography.15 In the European carotid surgery trial 778 cases (36%) had 70-99% stenosis.5 Patients not fitting the criteria were all excluded.
We used a similar process to produce a range of estimates for the number of eligible patients with minor stroke in Wessex (fig 1). Non-ischaemic strokes (estimated at 10-15% of all minor strokes2) were excluded by using the incidence of ischaemic strokes only from the Oxford project11). Major and fatal strokes, estimated at 75% of all first ever strokes, were excluded. We applied the same distribution and level of carotid stenosis proportions as for transient ischaemic attacks. Estimates for eligible patients with stroke included all patients with minor ischaemic stroke with 70-99% stenosis.
We compared regional level, district level, and age-sex specific estimates of need with their respective combined operation rates, giving a use:need ratio. Operation and use:need ratios are presented with 95% confidence limits.16 For overall estimate of need we included all age groups.
All the findings presented here were discussed at a workshop with eight vascular surgeons (representing all but one of the region's units performing the operation), four regional purchasers, six other clinicians, one superintendant radiographer, and one provider manager. All vascular surgeons were also interviewed individually by one of us (AS) to explore the organisational and attitudinal background to carotid surgery.
During 1995-6, 266 Wessex residents underwent a carotid artery reconstruction, a crude rate of 89 per million population and an overall increase of 63 operations on the previous financial year. The number of annual operations had increased substantially since 1991-2 (from 104 to 266). In 1995-6 the proportions of these operations performed by the providers in the region were 46% by Southampton, 19% by Royal United Bath, 12% by Bournemouth, 10% by Portsmouth, 5% by Winchester and 2% by North Hants (6% were performed by non-Wessex providers). The age distribution for carotid endarterectomy (average for 1993-6) was 7% for 0-54 years, 22% for 55-64, 47% for 65-74, 22% for 75-84, and 2% for 85 years and older. Directly standardised district rates for carotid endarterectomy for 1993-6 showed significant variation (fig 2).
We estimated an incidence of transient ischaemic attack of 0.48 per 1000 people and a rate of first ever stroke of 1.9 per 1000, according to the estimates derived from the Oxford data. 10 11 About 1429 transient ischaemic attacks and 5656 first ever strokes could be expected in Wessex annually, on the basis of the Office for National Statistics' mid-year population estimate for Wessex for 1994 (2.98 million). The estimates for patients eligible for carotid endarterectomy presenting with a transient ischaemic attack were 77 per million population (51 in those aged under 75) and with minor stroke 76 (36 in those aged under 75) (table 1). These levels varied depending on age groups included.
Comparison between the three year average provision of 213 operations (72 per million population) in 1993-6 and the expected level of provision for the same years (435 operations (153 per million population)) showed a use:need ratio of 0.47 (table 2). The annual use:need ratio rose from 0.38 to 0.59 over the three years 1993-4 to 1995-6.
There was substantial variation between districts in use:need ratios (0.28 to 0.81). There was no direct relation between this ratio and a district's standardised mortality ratios for stroke.
Table 3 presents the rate of carotid endarterectomy by age and sex. Lower use:need ratios were present among female Wessex residents, and considerable variations were found between the different age groups, with those over 75 having the lowest use:need ratios.
At the workshop all participants agreed that carotid endarterectomy performed for appropriate indications and by experienced surgeons was an effective intervention and that it should be part of a comprehensive strategy for preventing and managing stroke. However, providers were more positive than purchasers about developing guidelines for referring patients for investigation of symptomatic carotid stenosis. Purchasers were more reluctant to tackle unmet need given the pressure on resources, the relatively high cost of carotid endarterectomy,17 and the limited impact it has on the incidence of stroke in the general population.
These data suggest that between 1991-2 and 1995-6 some patients in Wessex needing carotid endarterectomy did not receive it—despite a doubling in the number of operations over the three to four years since the Association of British Neurologists' guidelines were published. Operation rates in district health authorities varied considerably, suggesting inequity in access in relation to need; this was particularly marked in elderly and female patients.
To address the discrepancy between the current and expected level of provision we need first to examine the robustness of the data and the assumptions of the estimates of need. Our estimate of need for patients with transient ischaemic attacks was based on the following premises: that all those with such attacks should be considered for surgery and therefore undergo diagnostic assessment; that only those with a carotid stenosis of 70-99% should be eligible for treatment; and that all ages should be included. These assumptions are based on evidence from the North American symptomatic carotid endarterectomy trial and the European carotid surgery trial; estimates from work by Hankey and Warlow 13 14 ; and data from the Oxford community stroke project. 10 11 However, this underestimates the true rate of transient ischaemic attack in the community (and hence the need for carotid endarterectomy); in the Oxford project a small subgroup of patients did not report their transient ischaemic attack to their doctor until after their first stroke, and another subgroup was not included as incident cases of transient ischaemic attack because the patients had a stroke during follow up. If combined, these would add another 27% to the overall incidence of transient ischaemic attack. Moreover, we have not considered patients with asymptomatic carotid disease who had severe stenosis; although the asymptomatic carotid atherosclerosis study18 suggests that these patients may benefit from surgery, the findings of the asymptomatic carotid surgery trial19 are awaited for clarification of the potential risk and benefits.
We used the same methods to calculate the number of eligible patients with minor ischaemic stroke. The same proportions for the distribution and level of carotid stenosis were applied as for transient ischaemic attack. We did not include cases from the Oxford project in which patients had an “uncertain” type of stroke, some of whom may have had ischaemic strokes. Such cases were predominantly in the very elderly age groups.
We could not ascertain from routine data whether current operations were being performed for appropriate indications, though vascular surgeons stated that the vast majority of patients were symptomatic and had over 70% stenosis of the appropriate internal carotid artery. If some of the operations performed were in symptomatic patients who had less than 70% stenosis or in asymptomatic patients, this would increase the level of unmet need for those with symptoms who had over 70% stenosis. Moreover, the study did not address directly the effectiveness of the services provided in terms of patient outcomes; nor could routine data indicate the appropriateness of surgery.
What of overestimation of need? We have not been able to adjust for comorbidity that may predicate against referral or consideration for surgery because of poor prognosis or unfitness for surgery. This may have partly accounted for the lower use:need ratios in older groups. Certainly comorbidity exclusion criteria had been applied, especially in the North American study.4 The vascular surgeons indicated that patients usually have other vascular disease and that this is not a reason to exclude them from the operation. Without further evidence to ascertain the true case mix of patients in the referral, eligibility, and treatment pathways, we cannot determine if we have overestimated unmet need in patients with minor stroke. The incidences of transient ischaemic attack and stroke were based on general practice populations in the Oxford region in the 1980s. Wessex and Oxford have comparable overall health status and stroke mortality. However, stroke incidence may have declined along with the fall in stroke mortality; if so, estimates of need will be too high.
A substantial underascertainment of NHS operations is unlikely as the surgeons confirmed the approximate number of operations. Our estimate of current provision excludes private operations, but anecdotal evidence from our vascular surgeons suggests that the number of private operations was fairly small (about 30 a year—less than 13% of the total). Inclusion of data on the number of private operations, even if double the suggested level, would not raise the level of current provision to the expected level.
If our estimation of unmet need is accurate we needed to look at the wider issues to explain the gap between provision and need. Our workshop discussions indicated that the block was not with vascular surgeons but with referral for diagnostic assessment. This may have been due to a lack of awareness of the clinical indications for carotid endarterectomy, despite the availability of the national guidelines, leading to underreferral of patients with transient ischaemic attack or minor stroke for diagnostic assessment. Lack of access to duplex ultrasound scanning of the carotid artery may have contributed to this. The cost effectiveness of open access and “one stop” vascular clinics needs to be addressed, as these are potential strategies for increasing referrals and reducing delay in assessment. Routine data with breakdown of carotid endarterectomy by diagnosis of transient ischaemic attack or minor stroke were not available at this stage. An audit of vascular surgery cases would be needed to determine this, as the prime target groups of health professionals for referring patients with transient ischaemic attack are general practitioners and for referring patients with minor stroke are geriatricians, general physicians, and general practitioners.
We showed inequity by age and sex. Discussion with the vascular surgeons indicated that such inequity was not primarily due to variation in surgical practice. There may be implicit rationing by age, which may or may not reflect poor prognosis or reduced likely benefit because of associated comorbidity. Moreover, patient choice may be a factor, with older patients less likely to agree to surgery. Sanderson et al have shown how estimates of need for prostatectomy are sensitive to clinical severity and perceived impact of the condition, but also to patients' preferences about whether to undergo surgery, although the effect of age was inconsistent.20 Patients' preferences may partly explain the age and sex differences seen for carotid surgery.
Sex differences in treatment rates have been shown in other vascular interventions—notably, coronary artery bypass grafts.21 Further research is needed into the referral patterns of patients with symptomatic carotid disease to explore the reasons for the patterns of treatment seen.
The interdistrict analysis showed substantial variation in the use:need ratio. This could not be fully accounted for by comparison with stroke mortality ratios, as a proxy measure of stroke related need, which partly takes into account the socioeconomic characteristics of the population. The variation partly reflected the concentration of services—districts with a high use:need ratio tended to have one of the main provider sites. This is another example of demand being related to supply but not oversupply, as has often been implied.
This approach to determining use:need ratios is necessarily rather crude, relying on routine data and extrapolation from primary epidemiological studies. Nevertheless it has shown that despite robust evidence of the efficacy of carotid endarterectomy for patients with severe carotid stenosis, a considerable amount of unmet need and inequity of service provision at district level and by age-sex group still exists in an English health region. It will be important to see if operation rates continue to increase and to what extent this reduces inequity. Epidemiological data on the patterns of disease subgroups with the clinical indications for NHS interventions are important in understanding treatment patterns.
Even when general agreement exists about the strength of evidence for an intervention, getting it into practice will not necessarily be straightforward when it is costly and dependent on complex referral pathways for diagnosis and treatment.
We thank all the clinicians and purchasers who took part in the workshop and interviews.
Contributors: All authors were members of the project team that developed and implemented the review, and all contributed to the workshop and to the writing of the paper. AS and GF reviewed the literature, AS conducted the interviews, and GF undertook the data analysis. PR coordinated the writing of the paper.
Funding: The study was funded by South and West Research and Development Directorate.
Conflict of interest: None.