- Simon Coulton, senior research fellow ()1,
- Colin Drummond, professor2,
- Darren James, trainee clinical psychologist3,
- Christine Godfrey, professor1,
- J Martin Bland, professor1,
- Steve Parrott, research fellow4,
- 1 Department of Health Sciences, University of York, York YO10 5DD
- 2 Section of Addictive Behaviour, Division of Mental Health, St George's Hospital Medical School, University of London, London SW17 0RE
- 3 Department of Clinical Psychology Training, Whitchurch Hospital, Cardiff CF14 7XB
- 4 Centre for Health Economics, Alcuin College, University of York
- 5 Department of Biochemistry, King's College, University of London, London WC2R 2LS
- Correspondence to: S Coulton
- Accepted 10 January 2006
Objective To evaluate the efficacy and relative costs of different screening methods for the identification of alcohol use disorders in an opportunistic screening programme in primary care in the United Kingdom.
Design Comparative study.
Setting Six general practices in south Wales.
Participants 194 male primary care attendees aged 18 or over who completed an alcohol use disorders identification test (AUDIT) questionnaire.
Main outcome measures Scores on alcohol use disorders identification test and measures of γ-glutamyltransferase, aspartate aminotransferase, per cent carbohydrate deficient transferrin, and erythrocyte mean cell volume. Hazardous alcohol consumption, weekly binge consumption, and monthly binge consumption were ascertained using the time line follow back method over the previous 180 days. Alcohol dependence was determined using the Diagnostic and Statistical Manual of Mental Disorders, fourth edition. Unit costs were established from published resource references and from actual costs of analysing the biochemical tests.
Results A significant correlation was observed be alcohol consumption and score on the alcohol use disorders identification test (Pearson's correlation coefficient r = 0.74) and measures of γ-glutamyltransferase (r = 0.20) and per cent carbohydrate deficient transferrin (r = 0.36) but not aspartate aminotransferase (r = 0.08) or erythrocyte mean cell volume (r = 0.02). The alcohol use disorders identification test exhibited significantly higher sensitivity, specificity, and positive predictive value than all of the biochemical markers for hazardous consumption (69%, 98%, and 95%), weekly binge consumption (75%, 90%, and 71%), monthly binge consumption (66%, 97%, and 91%), and alcohol dependence (84%, 83%, and 41%). The questionnaire was also more cost efficient, with a lower cost per true positive for all consumption outcomes.
Conclusion The alcohol use disorders identification test questionnaire is an efficient and cost efficient diagnostic tool for routine screening for alcohol use disorders in primary care.
The prevention of alcohol related morbidity and mortality is a key priority of the UK government's health strategy.1 However, alcohol consumption in men and the proportion drinking above recommended “safe levels”—drinking in excess of 21 units of alcohol in any one week—has remained constant for over a decade, with increases in some subgroups.1 Furthermore, evidence is emerging that the incidence of binge alcohol consumption (consuming more than the daily recommended safe level in a single episode) is increasing in the general population.1 Excessive alcohol consumption has an important effect on individuals and society, imposing a major financial burden on the NHS.2 3 An estimated 20% of hospital inpatients have some form of alcohol related problem, although few seek treatment.4
About 20% of all patients presenting to general practitioners in the United Kingdom consume alcohol at excessive levels, yet 98% of these are not identified in the general practice setting.5 Good evidence shows that brief interventions for excessive alcohol use, aimed at reducing consumption and subsequent alcohol related harm and dependence, are both clinically and cost effective.6–10 Primary care is viewed as the most promising location to offer brief interventions.11 To offer such interventions, however, general practitioners need access to screening instruments that are high in sensitivity and specificity, quick and easy to apply, and can be carried out at reasonable cost.
Several studies have questioned the value of measuring traditional biochemical markers of excessive alcohol consumption for screening in primary care, such as γ-glutamyltransferase, aspartate aminotransferase, erythrocyte mean cell volume, and per cent carbohydrate deficient transferrin.12 13 The alcohol use disorders identification test (AUDIT) is a 10 item questionnaire specifically developed for use as a short screening instrument for the identification of hazardous, harmful, or dependent alcohol users.14 15 A detailed receiver operating characteristic analysis of the screening properties of the IMG, γ-glutamyltransferase, aspartate aminotransferase, erythrocyte mean cell volume, and per cent carbohydrate deficient transferrin has not previously been undertaken in a primary care population in the United Kingdom.
We evaluated the sensitivity, specificity, and positive predictive value of the alcohol use disorders identification test and biochemical markers in the context of an opportunistic screening programme in primary care. We also carried out an economic analysis to establish the relative costs per true positive for each of the screening methods.
Our study was carried out before we embarked on a randomised controlled trial evaluating the effectiveness and cost effectiveness of stepped care interventions for alcohol use disorders in primary care.16 Research nurses asked male attendees in primary care to complete an alcohol use disorders identification test questionnaire embedded within a general lifestyle questionnaire while awaiting appointments in six participating general practices in south west Wales.
All patients, irrespective of score, were informed of the study and invited to take part in a more detailed assessment. Those patients who consented to the detailed assessment were interviewed by a researcher in the practice who assessed frequency and quantity of alcohol use in the previous 180 days using the time line follow back method.17 The researcher was blind to the patient's score. This method was used to establish the number of weeks in the previous 180 days the patient had exceeded the “safe level” of alcohol consumption (greater than 21 units of alcohol in any one week) and the frequency with which the patient engaged in binge alcohol consumption (greater than eight units of alcohol in any one day) in the past 180 days. This was used as a criterion for hazardous and binge alcohol consumption and is inclusive of harmful alcohol consumption and dependence.
The researcher established a diagnosis of alcohol dependence according to the Diagnostic and Statistical Manual of Mental Disorders, fourth edition, by administering the alcohol dependence element of the short form composite international diagnostic interview.18 Blood samples were then taken from each patient by venepuncture. Analysis of γ-glutamyltransferase, aspartate aminotransferase, and per cent carbohydrate deficient transferrin was carried out at the Department of Clinical Biochemistry, King's College, London, and analysis of erythrocyte mean cell volume was carried out at the Department of Haematology, Singleton Hospital, Swansea. Blood tests were carried out blind to the patient's score on the alcohol use disorders identification test.
The time line follow back method is a reliable and valid method for deriving quantity and frequency of alcohol consumption in clinical and non-clinical populations.17 The method is completed by a trained researcher and takes on average 45 minutes to complete. The quantity and frequency of alcohol consumption is standardised into units of ethanol consumption and can be utilised as either continuous or categorical values.
The alcohol use disorders identification questionnaire is a 10 item self completed questionnaire that addresses frequency of alcohol consumption, alcohol related problems, and dependence symptoms.4 14 The questionnaire takes on average three minutes to complete and was embedded in a general lifestyle questionnaire to reduce the patient perceived threat. Each item is scored from 0-4. The overall score—the sum of responses to each of the 10 questions—ranges from 0-40. A score of 8 or more indicates hazardous alcohol consumption and has high levels of sensitivity (92%) and specificity (94%) for identifying alcohol use disorders.15
The alcohol dependence section of the short form composite international diagnostic interview18 is a valid and reliable method for the diagnosis of alcohol dependence as classified by the Diagnostic and Statistical Manual of Mental Disorders, fourth edition. The instrument is administered by a trained researcher and assesses seven symptoms of alcohol dependence: role interference, use in hazardous situations, emotional and psychological problems, urge to consume alcohol, increasing recovery time, consuming more than intended, and increasing consumption to maintain effect. The instrument is scored by summing individual responses to all items, and a score of 3 or more indicates alcohol dependence.
Biochemical markers of alcohol use are widely used indicators of alcohol use disorders in general practice. They measure indirect consequences of alcohol consumption. Research has questioned the sensitivity and specificity of blood measures in screening for alcohol use disorders.19 γ-glutamyltransferase is used clinically as a measure of non-specific liver toxicity, and serum γ-glutamyltransferase levels increase with exposure to alcohol. The normal reference range for γ-glutamyltransferase is 0-55 IU/l for men. The sensitivity and specificity of γ-glutamyltransferase varies depending on the clinical population, with lower sensitivity and specificity in general practice populations than in alcohol inpatient populations.13 The reference range for aspartate aminotransferase is 10-50 IU/l in men. Increased levels are an indicator of hepatocyte damage and have been found associated with alcohol consumption in usually healthy populations.13 Aspartate aminotransferase has been found to be less sensitive than γ-glutamyltransferase in alcohol inpatient populations.19 Per cent carbohydrate deficient transferrin measures the ratio of carbohydrate deficient transferrin to total transferrin levels in serum and is considered to be more reliable than absolute levels of carbohydrate deficient transferrin because it addresses differences in total transferrin within individuals. Per cent carbohydrate deficient transferrin beyond the normal reference range for men (> 2.5%) better detects chronically heavy consumers of alcohol than infrequent hazardous consumers and is more specific than γ-glutamyltransferase or aspartate aminotransferase.20 Erythrocyte mean cell volume measures the mean volume of erythrocytes and has been recognised as increasing with excessive alcohol use. Results beyond the normal reference range of greater than 95 fl have been found to have a relatively high specificity but low sensitivity for excessive alcohol use in general practice settings.13
We compiled and analysed the results using SPSS v11 and Stata 8. As the patients were stratified by whether their test score was less than 8 or greater than or equal to 8, with different sampling fractions in the two strata, stratification was allowed for in the analysis using the svy commands of Stata. We used correlation after applying normalising transformations to compute linear associations between quantity of alcohol consumed, standard drinks consumed per drinking day and test score, γ-glutamyltransferase, aspartate aminotransferase, per cent carbohydrate deficient transferrin, and erythrocyte mean cell volume. The ability of tests to predict alcohol consumption was tested by logistic regression. We explored the accuracy of the tests in identifying hazardous alcohol consumption, weekly or monthly binge consumption, and alcohol dependence by constructing receiver operating characteristic curves on the basis of all possible continuous values of the test results. This was done by expanding the sample to give true proportions in each stratum. We investigated the accuracy of each test method in each scenario by the calculation of sensitivity, specificity, and positive and negative predictive values.
We carried out an economic analysis of each screening method by establishing the unit cost of each method and establishing a cost per true positive for each screening method.
Overall, 1794 men were consecutively approached in six general practices in south west Wales and completed the alcohol use disorders identification test questionnaire. Of these, 447 (24.9%) were positive for alcohol use disorders and 112 (25% of patients with a positive test result) agreed to take part. We randomly sampled, stratified by practice, 450 of the 1347 patients with a negative result, of whom 82 (18% of patients with a negative result sampled) agreed to take part in the study. Patients with a negative test result who did or did not take part in the study showed no significant difference in age (50.3 v 51.0; P = 0.18) or test score (3.53 v 3.78; P = 0.28). Patients with a positive test result who did or did not take part in the study showed no significant difference in age (43.1 v 37.4; P = 0.27) or test score (13.5 v 12.0; P = 0.06).
The average age was 46.2 years (range 18.1-80.9 years). The majority of patients were married (63%) and in employment (58%). Fifty patients (26%) fulfilled the criteria for alcohol dependence according to the Diagnostic and Statistical Manual of Mental Disorders, fourth edition, 121 (62%) fulfilled the criteria for hazardous alcohol consumption, 117 (60%) engaged in binge alcohol consumption at least monthly, and 4 (2%) were abstinent. Table 1 lists the personal and alcohol consumption variables for the patients.
Using the sample to estimate the prevalence of drinking behaviours in the general practice population, the prevalence of hazardous alcohol consumption was 34% (95% confidence interval 28% to 40%), monthly binge consumption 35% (29% to 42%), weekly binge consumption 24% (19% to 29%), and alcohol dependence 12% (9% to 16%).
Significant correlations were found between alcohol consumption, measured as number of standard drinks consumed per drinking day (standard drink equates to 8 g of ethanol) over the previous 180 days, and alcohol use disorders identification test score (Pearson's correlation coefficient r = 0.74; P < 0.001), γ-glutamyltransferase (r = 0.20; P = 0.04), and per cent carbohydrate deficient transferrin (r = 0.36; P < 0.001) but not aspartate aminotransferase (r = 0.03; P = 0.7) or erythrocyte mean cell volume (r = 0.02; P = 0.9). Screening characteristics of the questionnaire and biochemical markers were tested against the criteria for hazardous alcohol consumption, monthly binge consumption, weekly binge consumption, and alcohol dependence through the construction of receiver operating characteristic curves on the basis of all possible continuous values of the test results (table 2 and figure) and the calculation of areas under the curve. The questionnaire was clearly better than any of the biochemical predictors and had a highly significant relation with alcohol consumption for all classifications. None of the significant biochemical predictors remained significant after controlling for questionnaire score. The questionnaire score also produced far higher areas under the receiver operating characteristic curve than any of the biochemical markers for all classifications. The questionnaire had areas under the receiver operating characteristic curve of 0.94 to 0.96 for all classifications, close to the maximum area of 1.00 for a perfect test, whereas only per cent carbohydrate deficient transferrin produced any area above 0.70, and aspartate aminotransferase produced some areas in the region of 0.50, as would be expected for a test unrelated to the outcome.
The questionnaire score cut-off of 8 or more had moderate sensitivity (69%) for identifying hazardous alcohol consumption, with high specificity (98%) and positive predictive value (95%). The questionnaire performed almost as well in identifying monthly binge consumption, although its sensitivity, specificity, and positive and negative predictive values were all slightly lower. For weekly binge consumption the specificity fell to 90% and positive predictive value fell correspondingly, although the sensitivity increased to 75%. For alcohol dependence, sensitivity was highest at 84%, but specificity was lowest at 83%, and the positive predictive value fell to 41%. Negative predictive value was highest for this classification, rising to 97%. Hence a positive questionnaire score is a good indication of hazardous alcohol consumption and a negative score is a good indication of no alcohol dependence.
Producing a copy of the alcohol use disorders identification test questionnaire embedded within a general lifestyle questionnaire cost 10p, and administering and analysing the questionnaire took five minutes of practice nurse time. Using 2000-1 prices, the cost of five minutes of practice nurse advice was £1.10 (including salary, employer's national insurance and superannuation contributions, and a management overhead of 8% of the salary cost). We also added the cost of premises, at 50p/m2/h. Assuming that a room measured 12 m2 the cost of screening in such premises was 50p per patient. Therefore the total cost of administering the test was estimated at £1.70 per patient. The cost of taking and analysing the biochemical markers was estimated using a standard cost of venepuncture of £9.00,21 using 2000-1 prices, divided by the number of tests (n = 4) derived from a single sample and the real cost of analysis carried out in the laboratories taking part in the study. This gave a cost associated with each blood test of £5.25 for γ-glutamyltransferase and aspartate aminotransferase, £27.25 for per cent carbohydrate deficient transferrin, and £8.25 for erythrocyte mean cell volume.
The alcohol use disorders identification test questionnaire had the lowest costs associated with administration and interpretation. Analysis of costs per true positive for hazardous, monthly binge, weekly binge, and dependent consumption indicate that the test is the most cost efficient screening method for all these categories of consumption. Table 3 shows the full costs for screening 1000 men.
A simple screening instrument, the alcohol use disorders identification test (AUDIT) questionnaire, is an effective and cost efficient means for identifying hazardous and harmful drinkers in the primary care setting who could benefit from brief interventions. This contrasts with the current poor level of identification of alcohol use disorders by general practitioners.5 Overall, 25% of attendees who were screened scored positive on the test, an indication of the prevalence of alcohol use disorders in this population.
The alcohol use disorders identification test and levels of γ-glutamyltransferase and per cent carbohydrate deficient transferrin correlate with increasing alcohol consumption, but the test is a more efficient method for opportunistic screening in primary care than is measurement of γ-glutamyltransferase, aspartate aminotransferase, per cent carbohydrate deficient transferrin, and erythrocyte mean cell volume, in terms of sensitivity, specificity, positive predictive value, and cost. Routine screening in primary care should focus on the alcohol use disorders identification test questionnaire rather than biochemical markers of alcohol consumption. Biochemical markers of alcohol consumption often have short half-lives and require sustained consumption of alcohol at high levels. Because of this they fail to address the underlying longer term drinking behaviours that constitute hazardous and harmful alcohol consumption.
Owing to the detrimental effect of hazardous and harmful alcohol use on health, the widespread and routine implementation of intervention strategies is likely to have large benefits for public health and the health of the individual. A substantial evidence base exists for the efficacy of brief interventions in the primary care setting, including empirical studies22 23 and systematic reviews.6–10 The most recent of these6 concluded that brief interventions are effective in reducing alcohol consumption 12 months after intervention, and a review carried out by the United States Preventative Taskforce concluded that “brief counselling interventions for risky/harmful alcohol use among adult primary care patients provide an effective component of a public health approach to reducing risky/harmful alcohol use.”8 Another study questioned the feasibility of opportunistic screening in primary care for excessive alcohol use,24 but our study indicates that the alcohol use disorders identification test questionnaire, completed by the patient and scored by a practice nurse, produces more true positive cases of excessive alcohol use than the studies included within their meta-analysis. Successfully implementing brief interventions in part depends on identifying those patients who are most likely to benefit. The questionnaire is a clinically and cost efficient screening instrument for identifying patients who would benefit from brief interventions of proved effectiveness.
Primary care provides an excellent environment to combine opportunistic screening mechanisms and early intervention strategies to reduce the burden of excessive alcohol consumption on individuals, the NHS, and society. Further research is required to tackle the most effective means of implementing screening and brief intervention strategies within primary care.
We recognise that our study is limited by its focus on male attendees in primary care and that this limitation was structural rather than intentional. We would recommend a replication of the study with female attendees. We also recognise the possibility that those patients with a negative test score had misreported their alcohol consumption and were less likely to consent to a more detailed examination. Although evidence suggests that this form of bias is limited,11 our study was a pragmatic evaluation of screening instruments using real patients in a real NHS setting. In recruiting the sample for the study we stratified the population by status on the basis of alcohol use disorders identification test score. We took this stratification into account in the analysis.
Routine screening of all attendees in primary care should be considered throughout the NHS. This requires appropriate training, resources, and incentives for staff. Identifying those patients in primary care who are likely to benefit from brief interventions will help to achieve targets set out in the national harm reduction strategy for England.1
What is already known on this topic
The use of biochemical markers in identifying patients consuming alcohol at excessive levels has been questioned
A recent study highlights the low level of identification of alcohol use disorders in primary care
What this study adds
A short, self completed instrument in primary care—the alcohol use disorders identification test questionnaire—exhibited higher sensitivity, specificity, and positive predictive value, and cost less to apply than biochemical markers
We thank those who contributed to the Stepwice project, including staff and patients at the six general practices that took part.
Contributors SC, CD, DJ, CG, SP, and TP designed and carried out the study. SC and JMB carried out the statistical analysis. All authors commented on successive drafts of the manuscript and approved the final version for submission. SC and JMB are guarantors.
Funding The study was funded as part of the stepped care treatment evaluation in primary care funded by the Welsh Office of Research and Development. The authors have no connection with this organisation beyond the recipients of the original grant.
Competing interests None declared.
Ethical approval Brigend, Neath, Port Talbot, and Swansea local research ethics committee.