Long term predictive values of cytology and human papillomavirus testing in cervical cancer screening: joint European cohort studyBMJ 2008; 337 doi: http://dx.doi.org/10.1136/bmj.a1754 (Published 13 October 2008) Cite this as: BMJ 2008;337:a1754
- Joakim Dillner, professor1,
- Matejka Rebolj, researcher2,
- Philippe Birembaut, professor and head of department3,
- Karl-Ulrich Petry, professor4,
- Anne Szarewski, clinical consultant and honorary senior lecturer5,
- Christian Munk, researcher 6,
- Silvia de Sanjose, researcher79,
- Pontus Naucler, research fellow1,
- Belen Lloveras, researcher7,
- Susanne Kjaer, professor68,
- Jack Cuzick, professor and head of department5,
- Marjolein van Ballegooijen, professor2,
- Christine Clavel, professor3,
- Thomas Iftner, professor and head of section10
- 1Lund University, Medical Microbiology, University Hospital MAS, 205 02 Malmö, Sweden
- 2Department of Public Health, Erasmus MC, PO Box 2040, 3000 CA Rotterdam, Netherlands
- 3CHU Reims, Service d’Anatomie Pathologique, INSERM UMR-S 903, Laboratoire Pol Bouin, Reims, France
- 4Department of Obstetrics and Gynaecology, Teaching Hospital Wolfsburg, Germany
- 5Cancer Research UK, Wolfson Institute of Preventive Medicine, London
- 6Institute of Cancer Epidemiology, Danish Cancer Society, DK-2100, Copenhagen, Denmark
- 7Catalan Institute of Oncology, Hospital Duran i Reynals, Barcelona, Spain
- 8Gynecologic Clinic, Rigshospitalet, Copenhagen University Hospital, Denmark
- 9CIBER Epidemiologia y Salud Pública (CIBERESP), Spain
- 10Section of Experimental Virology, Institute of Medical Virology, University Hospital of Tübingen, Germany
- Correspondence to: J Dillner
- Accepted 30 July 2008
Objective To obtain large scale and generalisable data on the long term predictive value of cytology and human papillomavirus (HPV) testing for development of cervical intraepithelial neoplasia grade 3 or cancer (CIN3+).
Design Multinational cohort study with joint database analysis.
Setting Seven primary HPV screening studies in six European countries.
Participants 24 295 women attending cervical screening enrolled into HPV screening trials who had at least one cervical cytology or histopathology examination during follow-up.
Main outcome measure Long term cumulative incidence of CIN3+.
Results The cumulative incidence rate of CIN3+ after six years was considerably lower among women negative for HPV at baseline (0.27%, 95% confidence interval 0.12% to 0.45%) than among women with negative results on cytology (0.97%, 0.53% to 1.34%)). By comparison, the cumulative incidence rate for women with negative cytology results at the most commonly recommended screening interval in Europe (three years) was 0.51% (0.23% to 0.77%). The cumulative incidence rate among women with negative cytology results who were positive for HPV increased continuously over time, reaching 10% at six years, whereas the rate among women with positive cytology results who were negative for HPV remained below 3%.
Conclusions A consistently low six year cumulative incidence rate of CIN3+ among women negative for HPV suggests that cervical screening strategies in which women are screened for HPV every six years are safe and effective.
Cytological screening has reduced the incidence of cervical cancer in countries with organised screening,1 but in Europe in 1995 there were still an estimated 68 000 incident cases.2 Cytology has limited reproducibility,3 and both meta-analyses and pooled analyses of cross sectional studies have established that tests for human papillomavirus (HPV) have higher sensitivity than cytology in detecting high grade cervical intraepithelial lesions (CIN)4 5 and that combined HPV and cytology testing has high negative predictive values for CIN.6 7 8 Cost effectiveness modelling of screening strategies, however, depends greatly on reliable and generalisable estimates of the longitudinal, long term predictive values of testing. The long term negative predictive value is the main determinant of the safe screening interval to use, a key factor for the cost efficiency of a screening programme. The long term positive predictive value is an important measure of the extent of unnecessary procedures induced by screening, another major factor in evaluations of cost efficiency. As low and moderate grades of CIN often regress, predictive values to be used for modelling should ideally use CIN grade 3 or cancer (CIN3+) as the outcome.9
Several randomised controlled trials are currently being conducted to compare primary screening based on HPV detection with conventional cytology screening.10 11 12 13 14 15 16 Data from these trials indicate that HPV based screening results in detection of more high grade CIN lesions (a higher sensitivity) but a reduced specificity compared with cytology based screening. The randomised trials found that the increased sensitivity for CIN3+ is not merely overdiagnosis as there is a correspondingly lower incidence of CIN3+ in the future,11 12 13 14 further establishing the validity of using CIN3+ as end point in studies of HPV based cervical screening.
Most of the cohort studies and the randomised trials, however, have observed only limited numbers of cases of CIN3+ on longer term follow-up, resulting in reduced statistical power for estimating the critical factor for deciding the appropriate screening interval: the rate of CIN3+ among women with negative results at screening. Furthermore, clinical and diagnostic practices vary between European countries, and different studies have often used different methods for evaluation, making meta-analyses difficult.
To obtain large scale and generalisable data on long term predictive values for CIN3+, we obtained primary data from seven HPV screening studies in six EU countries, each investigating the predictive value of primary HPV screening for future CIN3+; assessed variability between studies; and estimated the overall long term predictive values for CIN3+.
The seven prospective HPV studies supplied data to a common database for joint statistical analysis. Table 1 provides details of the design of the seven studies, inclusion and exclusion criteria, setting, and location⇓. All studies used routine cytology as currently practised in their country. Table 1 also describes the different HPV tests used for each country. For all studies the people executing either test were unaware of the results of the other test. Comparability and reproducibility of the two main HPV tests used (hybrid capture II and GP5+/6+ polymerase chain reaction) was evaluated with κ statistics.17 Recruitment was consecutive and data collection prospectively planned.
In 1993-5 women in the general population were enrolled in a prospective cohort study of the clinical course of HPV and cervical neoplasia. They were interviewed and underwent a cervical smear tests for cytology and cervical swabs for detection of HPV DNA with hybrid capture II.18 Each woman’s unique 10 digit personal identification number was linked to the national pathology data bank (a nationwide computerised pathology register containing all cytological and histological diagnoses) to allow follow-up. Data from women with negative results on both tests were supplied to the joint database.
Germany: Hannover and Tübingen studies
In 1999-2000 women aged ≥30 were invited to the medical universities in Hannover or Tübingen for a prospective cohort study (HAT trial) on HPV screening.6 In Hannover women were followed with colposcopy every 6-12 months if they had a positive result on a hybrid capture 2 test or positive cytology at baseline. Women with negative results on both tests underwent annual cervical smear tests and 5% were referred for colposcopy five years later. In Tübingen, women with negative results on both tests at baseline were followed up with cytology and hybrid capture II test after five years; and if either test result was positive then they were referred for colposcopy.
The UK study included women attending routine screening in west London to evaluate HPV based screening in women aged ≥35 during 1994-7.19 DNA analysis was initially performed with the polymerase chain reaction/SHARP system to detect HPV types 16, 18, 31, 33, 54, 51, 52, 56, and 58. Women with positive results on HPV tests or abnormal cytology were referred for colposcopy. The samples were retrospectively analysed with hybrid capture I for the first half of the study and by hybrid capture II for the second half of the study. HPV results reported in our analyses are based on hybrid capture results. All women were followed up with the National Health Service computerised call/recall system, which records all smear tests and their results. In addition, all women were invited to a follow-up visit with HPV test and colposcopy, and 507 out of 2982 attended.
Women who participated in biennial or triennial routine screening in 1997-2002 in Reims, France, were invited to participate in a study to evaluate HPV testing with hybrid capture II in cervical cancer screening.20 All women with abnormal results on cytology were referred for colposcopy. Women with a positive HPV test but normal cytology results were recalled after 6-12 months for a repeat cytological smear and HPV test. If a cytological abnormality was found or if the woman had a persistent HPV infection she was referred for colposcopy. Women with normal cytology results and a negative HPV test at baseline were followed with standard biennial or triennial cervical screening. A random 15% of women with negative results on both tests at baseline were also referred for colposcopy.
In 1997-2000 women aged 32-38 who took part in organised cervical screening in five regions of Sweden (Gothenburg, Malmö, Stockholm, Umeå, and Uppsala) were invited to participate in a randomised population based trial of primary HPV screening with general primer GP5+/6+ polymerase chain reaction.21 In the intervention arm, women with a positive HPV test were invited for a second cytology and HPV test at least a year later, together with a similar number of women randomly selected from the control arm. Women with persistent HPV infection, as well as a similar number of women from the control arm, were invited for colposcopy.21 Women with abnormal cytology were referred for colposcopy in accordance with established clinical algorithms. We included all women in the intervention arm and the randomly selected women from the control arm. All study participants were followed by registry linkages with comprehensive regional cytology and pathology registries by using unique personal identification numbers.
In 1997-2001 women randomly selected from the general population of the Barcelona metropolitan area or who were attending one of nine family planning clinics for routine screening were enrolled.22 Both enrolment strategies performed frequency matching to the underlying general population. The study estimated the incidence and prevalence of genital HPV infection and evaluated the predictive value of cytology and HPV testing for future CIN at one and five years’ follow-up. HPV testing was done with hybrid capture II. Women from the general population were referred for colposcopy if they had abnormal cervical cytology or were persistently positive for HPV at the end of follow-up. Women from the family planning clinics were referred for colposcopy if they had abnormal cervical cytology or two consecutively positive HPV test results.
From the joint cohort, we included only women with adequate cytology and HPV tests at baseline and with at least one follow-up cytological or histological test. We regarded abnormal cytology as the equivalent of atypical squamous cells of uncertain significance (ASCUS) or worse for all the participating studies. Women were followed up from the date of the baseline test. Incidence depends on the number of person years of follow-up, and, for a disease detectable by screening, follow-up requires the person to have attended screening. Therefore, we censored follow-up at the date of diagnosis of the CIN3+ lesion (CIN3 or invasive cancer, including squamous and adenocarcinoma) or at the last registered testing date.
Firstly, we estimated the specific cumulative incidence rate of CIN3+ by original baseline group (cytology−/HPV−, cytology−/HPV+, cytology+/HPV−, and cytology+/HPV+) for each country, with 95% confidence intervals, using the non-parametric Kaplan-Meier product limit estimator for log(hazard).23 Secondly, to determine whether lack of homogeneity between the different studies in the joint cohort influenced results we used comparative analysis of systematically drawn subsamples of the joint cohort, so called bootstrap analysis.24 The bootstrap stratified random subsample was constructed by drawing, with replacement, firstly from studies and then from individuals within studies. We constructed and analysed 1000 bootstrap replications in the same manner as the original country specific analysis and used the mean of these 1000 replicas as the pooled estimate of the cumulative incidence rate corrected for heterogeneity, with 2.5 and 97.5 centiles as estimates for the 95% confidence interval. As a measure for heterogeneity, we compared the original cohort specific 95% confidence intervals with those obtained from the multilevel bootstrap. This can be transformed into an estimate of the overdispersion parameter (or “scale” parameter), where 1 points to no heterogeneity among the studies and >1 points to increasing levels of heterogeneity.25 26 Thirdly, we calculated the test performance indices for cytology alone, HPV test alone, and cytology and HPV test combined (at least one of the two positive). Because we did not have complete data for all four original baseline groups, we excluded studies from Denmark and Tübingen from these analyses. These indices were calculated using 2×2 tables based on the cumulative incidence rate at 72 months for the different baseline test combinations, weighted by the proportion (adjusted for heterogeneity) of each of these subgroups at baseline.27 The 95% confidence intervals around the indices were obtained by bootstrapping.25 All analyses used S-PLUS 6.0 Professional Release 1.
Out of 24 295 women included in the pooled analyses, 381 developed histologically confirmed CIN3+ during six years’ of follow-up (table 2)⇓. The positive predictive value for future CIN3+ was highest among women with abnormal cytology and positive HPV test at baseline (cytology+/HPV+) (cumulative incidence rate 34%, 95% confidence interval 26.8% to 45.4%) (fig 1)⇓. Women with normal cytology but positive HPV test (cytology−/HPV+) had a continuously increasing cumulative incidence rate of CIN3+, eventually reaching 10% (6.2% to 15.1%) after six years. Women with abnormal cytology and negative HPV test (cytology+/HPV−) had a cumulative incidence rate for CIN3+ of 2.7% (0.6% to 6.0%). Women with both normal cytology and negative HPV test (cytology−/HPV−) had a low risk of future CIN3+ (0.28%, 0.10% to 0.47%). We compared the cumulative incidence rate of CIN3+ after being cytology−/HPV− with that of CIN3+ for normal cytology alone and negative HPV test alone (fig 2)⇓. At six years of follow-up, the rate of CIN3+ was significantly lower among women negative for HPV (0.27%, 0.12% to 0.45%) than among women with negative cytology results (0.97%, 0.53% to 1.34%). By comparison, the rate of CIN3+ at the most commonly recommended screening interval in Europe (three years) was 0.51% (0.23% to 0.77%) for women with negative cytology results and 0.12% (0.03% to 0.24%) for women negative for HPV. At five and four years of follow-up, the rates were 0.25% (0.12% to 0.41%) and 0.19% (0.08% to 0.32%) for women negative for HPV compared with 0.83% (0.50% to 1.13%) and 0.69% (0.39% to 0.98%) for women with negative cytology results. There was little difference in rates for CIN3+ between women with negative results on both tests and women negative for HPV (fig 2). The rate for CIN3+ among women positive for HPV was lower than for women with abnormal results on cytology but increased continuously and gradually approached the rate of women with positive results on cytology (fig 3)⇓.
Analysis with an alternative outcome definition that included all high grade lesions (CIN grade 2 or worse; CIN2+) showed essentially similar results but was based on a higher number of cases (n=585). For example, at six years of follow-up, the cumulative incidence rate of CIN2+ was 0.67% (0.39% to 1.11%) among women negative for HPV and 1.76% (1.00% to 2.47%) among women with negative cytology results. The rates at three years of follow-up were 0.19% (0.07% to 0.38%) and 0.79% (0.43% to 1.16%), respectively.
As the prevalence of HPV infection is highly age dependent and as cytological performance also varies with age, we analysed positive and negative predictive values, sensitivity, and specificity of the screening tests stratified by age group (tables 3, 4, and 5)⇓ ⇓ ⇓. The sensitivity and negative predictive value of cytology improved with age (table 3). Both cytology (table 3) and the HPV test (table 4) had higher specificity for women above 35 years but did not improve any further among women above 49.
The seven studies included in the pooled analyses had estimates of cumulative incidence rate for CIN3+ that were not significantly different among cytology−/HPV−, cytology−/HPV+, or cytology+/HPV− women (scale parameters: 2.48, 1.80, 2.23; P values 0.14, 0.36, 0.1). The cumulative incidence rate of CIN3+ among women with positive cytology and HPV test, however, was clearly different between studies (scale parameter 4.77; P=0.01) (fig 4)⇓.
Main findings and strengths
Using pooled data from seven HPV screening studies in six European countries we estimated a cumulative incidence rate for future histologically confirmed CIN3+ during six years of follow-up. The uniformly low rate among women with negative results on both cytology and HPV tests suggests that double negativity confers a long lasting protective effect that is remarkably robust, considering that the participating studies used several different types of HPV tests in several different settings and in several different age groups. The long lasting protective effect was similarly low in women negative for HPV and women with negative results on both tests.
That several studies in different settings in different countries and with different infrastructure and intensity of follow-up gave largely similar results is a strength of the study, as it implies that the data are generalisable to various settings. Similarly, that we studied the actual cytological tests used in the different countries implies that the data are generalisable—for example, the largest study in the joint cohort (France) used the most modern cytology technique (liquid based cytology) and several other cohorts used the same routine conventional cytology as is used in organised programmes with a documented preventive effect on cancer.
Consistency with other studies
Our results agree with the results from a US cohort of 20 810 women that found that cytology−/HPV− women had a cumulative incidence rate of CIN3+ of 0.16% after 45 months and 0.79% after 122 months.7 Similarly, in a German cohort of 4034 women, 0.7% of cytology−/HPV− women developed CIN3+ during five years of follow-up8 and in a Dutch cohort of 2810 women there was only one case of CIN3+ among women with negative results on both tests during 4.6 years of follow-up.28
Limitations and other considerations
As expected, the HPV test was less specific than cytology. The higher specificity in women aged over 35 suggests that restricting HPV testing to older women would reduce overdiagnosis. With increasing length of follow-up, however, the cumulative incidence rate for CIN3+ increased more among women positive for HPV than among women with positive cytology results. This implies that the problem of HPV based screening resulting in increased overdiagnosis, with women unnecessarily referred for clinical procedures, is attenuated in evaluations with longer follow-up—some of the HPV positivity that seems to be false positivity in cross sectional evaluations will turn out to be true, but earlier, detection of CIN3+.
Verification bias might overestimate the performance of screening tests when only women with a positive screening test result are referred for colposcopy. Only some of the included studies performed colposcopies in women with negative results on both tests. It is, however, rare to diagnose CIN3+ by colposcopy in such women29 30 and the fact that there was limited variability between studies also suggests that verification bias has not materially affected our estimates.
Nevertheless, as assessment of the incidence of CIN3+ by baseline group during follow-up depends on the intensity of screening our estimates should be interpreted as relative rather than absolute.31 We included only women who had been screened at least once during follow-up, and the follow-up time was longer than the recommended screening intervals in all the included countries.32
In one study (Spain), no action was taken because of positive results of HPV tests at baseline whereas four studies mandated extra testing or colposcopy, or both (Sweden, Hannover, UK, and France). As we did not include Denmark and Tübingen in the follow-up of women with positive results on cytology or HPV tests, our cumulative incidence rate of CIN3+ is almost entirely based on active follow-up of HPV tests and should reflect the outcome of active HPV based screening strategies.
As prevalence of CIN3+ is associated with prevalence of HPV some heterogeneity between studies might be explained by differences in prevalence of HPV—for example, Spain has a low prevalence of HPV.22 Another possible source of variability is the fact that the German, French, Danish, British, and Spanish studies used hybrid capture II for HPV detection, while the Swedish study used polymerase chain reaction. The agreement between the two is substantial,33 34 and there was no obvious difference in results depending on the HPV test used. The most obvious source of heterogeneity between countries was the variability in interpretation of cervical smear tests, as the proportions of positive cytology results ranged from 2% in Sweden to over 4% in Hannover and Spain, 5% in the UK, and 7% in France; these differences cannot be entirely explained by the observed differences in the prevalence of HPV.
In conclusion, these joint European data suggest that screening intervals could safely be lengthened to six years among women with a negative result on an HPV test. This could at least partly compensate for the increased referral rate resulting from HPV based screening strategies.
What is already known on this topic
Cervical screening with HPV testing is more sensitive for detection of cervical intraepithelial neoplasia grade 3 or cervical cancer (CIN3+)
Cost efficiencies of cervical screening strategies combining cytology with HPV testing depend on the duration of the protective effect of negative testing as this determines the optimal screening interval
What this study adds
A joint analysis of seven different studies in six European countries consistently found a low six year cumulative incidence rate of CIN3+ among women negative for HPV
Cervical screening strategies with HPV testing every six years is safe and effective
Cite this as: BMJ 2008;377:a1754
We thank Caspar Looman for statistical advice and all participating patients and the gynaecologists and midwives who helped out with enrolment or follow-up of the cohort; Michael Menton and Annette Stubner for enrolment in Tübingen; C Coll, R M Vilamala, M Badia, R Font, F Martinez, A Avecilla, A Ramirez, H Mausbach, F J García, C I Rera, R Bosser, M P Cañadas, P Felipe, R Almirall, M Olivera, and J Klaustermeiyer for enrolment in Spain; B G Hansson, W Ryd, A Strand, G Wadell, E Rylander, and S Törnberg (steering group members, Sweden); and C Quereux, O Graesslin, J P Bory, C Pia, and M F Poncelet for enrolment in France.
Contributors: PB and CC (France); K-UP and TI (Germany); AS and JC (UK); SdeS and BL (Spain); SK and CM (Denmark); JD and PN (Sweden) were the principal investigators or coprincipal investigators and designed or coordinated the study in each country. TI coordinated the joint analysis project. The joint database was established and primarily analysed by MR under the supervision of MvB and JD. JD, PN, and MR primarily drafted the manuscript, to which all authors contributed. JD is guarantor.
Funding: European Union Biomed 5 contract HPV-based cervical cancer screening (QLG4-CT2000-01238). Digene provided the HPV kits (Tübingen). Digene and the Spanish Ministry of Health funded the Spanish study (grant Nos 99/1207 and CIBER SP 06-0073); Swedish Cancer Society and Europe against Cancer funded the Swedish study; and ARC (Association de Recherche contre le Cancer), the Region Champagne-Ardenne, and Cancéropôle Grand Est funded the French study.
Competing interests: K-UP has received speaker’s honorarium from Digene and Roche and research grants from Digene; TI has received speaker’s honorarium from Digene; JC is on the speaker’s bureau of Digene and the advisory board for Roche and has received research grants from Roche; SK is on an advisory board for Merck and has received research grants from Merck and SPMSD; CM has received travel grants from Merck; SdeS has received travel grants from Digene and GSK and research grants from GSK and Merck/Sanofi Pasteur. The Department of Public Health of the Erasmus MC in Rotterdam, Netherlands, has received a research grant from GSK.
Ethical approval: All studies were approved by the ethical review boards in their respective countries.
Provenance and peer review: Not commissioned; externally peer reviewed.
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.