Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 24 September 2009, doi:10.1136/bmj.b3537
Cite this as: BMJ 2009;339:b3537
Benny Holmström, urologist1,2, Mattias Johansson, postdoctoral fellow2,3, Anders Bergh, professor of pathology4, Ulf-Håkan Stenman, professor of clinical chemistry5, Göran Hallmans, professor of nutritional research6, Pär Stattin, professor of urology2
1 Department of Surgery, Gävle Hospital, S-801 87 Gävle, Sweden, 2 Department of Surgical and Perioperative Sciences, Urology and Andrology, Umeå University, S-901 85 Umeå, Sweden, 3 International Agency for Research on Cancer (IARC), 150 cours Albert Thomas, 69008 Lyon, France, 4 Department of Medical Biosciences, Pathology, Umeå University, 5 Department of Clinical Chemistry, Helsinki University Central Hospital, Biomedicum, POB 700, FIN-00029 HUS, Finland, 6 Department of Public Health and Clinical Medicine, Nutritional Research, Umeå University
Correspondence to: M Johansson, Genetic Epidemiology Group (GEP), International Agency for Research on Cancer (IARC), 150 cours Albert Thomas, 69008 Lyon, France JohanssonM{at}fellows.iarc.fr
Design Case-control study nested in longitudinal cohort.
Setting Västerbotten Intervention Project cohort, Umeå, Sweden.
Participants 540 cases and 1034 controls matched for age and date of blood draw.
Main outcome measure Validity of prostate specific antigen for prediction of subsequent prostate cancer diagnosis by record linkage to cancer registry.
Results Blood samples were drawn on average 7.1 (SD 3.7) years before diagnosis. The area under the curve for prostate specific antigen was 0.84 (95% confidence interval 0.82 to 0.86). At prostate specific antigen cut-off values of 3, 4, and 5 ng/ml, sensitivity estimates were 59%, 44%, and 33%, and specificity estimates were 87%, 92%, and 95%. The positive likelihood ratio commonly considered to "rule in disease" is 10; in this study the positive likelihood ratios were 4.5, 5.5, and 6.4 for prostate specific antigen cut-off values of 3, 4, and 5 ng/ml. The negative likelihood ratio commonly considered to "rule out disease" is 0.1; in this study the negative likelihood ratios were 0.47, 0.61, and 0.70 for prostate specific antigen cut-off values of 3, 4, and 5 ng/ml. For a cut-off of 1.0 ng/ml, the negative likelihood ratio was 0.08.
Conclusions No single cut-off value for prostate specific antigen concentration attained likelihood ratios formally required for a screening test. Prostate specific antigen concentrations below 1.0 ng/ml virtually ruled out a prostate cancer diagnosis during the follow-up. Additional biomarkers for early detection of prostate cancer are needed before population based screening for prostate cancer should be introduced.
Cross sectional studies have shown that approximately 10% of middle aged men have prostate specific antigen concentrations above 4 ng/ml and approximately a quarter of these men have prostate cancer on biopsy.8 9 Studies of this design can provide accurate data on the positive predictive value of prostate specific antigen for diagnosis of prostate cancer, as men with high prostate specific antigen concentrations have biopsy for verification of the diagnosis. These studies can also provide relatively accurate estimates of specificity given that prostate cancer is relatively rare among men with low prostate specific antigen concentrations.10 11 12 However, in cross sectional studies, cancer status is not verified in men with prostate specific antigen concentrations below the threshold for biopsy, so such studies cannot provide accurate estimates of sensitivity. Estimates of sensitivity are necessary for calculation of likelihood ratios,13 which describe the likelihood that a given test result would be expected in a person with a disease compared with the likelihood that the same result would be expected in a person without the disease. A positive likelihood ratio above 10 for a diagnostic test is considered to be a strong evidence to "rule in" disease, whereas a negative likelihood ratio below 0.1 is considered sufficient evidence to "rule out" disease.14 Importantly, likelihood ratios are not affected by the prevalence of the disease13; likelihood ratios are, therefore, powerful tools for evaluating biomarkers.
Sensitivity, specificity, and likelihood ratios can be calculated only when case status is known for all participants in a study. Case status is known both in studies in which all men have biopsy regardless of prostate specific antigen concentration and in longitudinal cohort studies in which prostate specific antigen is measured in cases identified by subsequent linkage to a cancer registry and in matched controls.15 16 17 18 19 20 21
The aim of this study was to evaluate prostate specific antigen as a screening test by calculating the sensitivity, specificity, and likelihood ratios of prostate specific antigen concentrations in predicting subsequent diagnosis of prostate cancer in a case-control study nested in a longitudinal cohort.
In January 2006 we linked the Västerbotten Intervention Project cohort to the regional cancer registry and identified 654 incident cases of prostate cancer. Of these cases, 540 (83%) men had a prospectively collected blood sample available for biochemical analysis for this study. Clinical characteristics of tumours, including local stage, lymph node stage, metastasis at bone scan, tumour differentiation, and serum prostate specific antigen concentration at the time of diagnosis came from the Northern Sweden part of the National Prostate Cancer Register.24 We re-evaluated core biopsies in accordance with Gleason and measured the length of the core biopsies and cancer tissue in the cores. We defined high risk prostate cancer as local tumour stage T3 or T4, Gleason score 8 or higher, World Health Organization grade III (WHO grading was assessed on fine needle aspirate done in 64 men), or presence of lymph node metastasis, bone metastasis, or serum prostate specific antigen concentrations above 20 ng/ml. No formal screening programme for prostate cancer has been or is in operation in the source population.
As the Västerbotten Intervention Project participants are recruited at even decades, 98% of our study group consisted of three age clusters: one cluster of men aged 39-40 (n=16) at the time of blood draw, one cluster of men aged 49-50 (n=129), and one cluster of men aged 59-60 (n=386). To keep the large cluster intact in subgroup analyses, we divided the participants into one group younger than 59 years at recruitment (n=148 cases) and one group aged 59 or older at recruitment (n=392 cases). For each case, we randomly selected two controls (1.9 on average; 1034 in total) who were alive and free of cancer at the time of diagnosis for the index case, within sets matched to the index case for age (six months younger or older than the index case) and date of recruitment (within two months before or after blood draw of the index case). All participants gave written informed consent at the time of recruitment.
Biochemical analysis
Baseline plasma prostate specific antigen concentrations were determined with Wallac Delfia assays (AutoDelfia, Wallac Oy, Turku, Finland) at the Department of Clinical Chemistry, Helsinki University Central Hospital, Helsinki, Finland. Cases and their matched controls were analysed in the same batch, and laboratory personnel were blinded to case-control status. At prostate specific antigen concentrations between 0.2 and 100 ng/ml, the intra-assay and inter-assay coefficients of variation were in the range 2-4%. Serum prostate specific antigen concentrations in blood drawn shortly before the diagnostic biopsies had been determined with either Hybritech Tandem-R (Hybritech Inc, San Diego, CA) or the IMx prostate specific antigen assay (Abbot Laboratories, Abbot Park, IL), and values had been recorded in the National Prostate Cancer Register. The coefficient of correlation between the two assays was 0.990 (IMx value=(1.22xTandem value)–2.80).25
Statistical methods
We used conditional logistic regression to calculate odds ratios for diagnosis of prostate cancer. We calculated specificity and sensitivity for a series of prostate specific antigen cut-off values and estimated the area under the curve in receiver operating characteristics curves for the full study group and for subgroups stratified according to low/high risk cancer, age at blood draw (<59 years and
59 years), and time from blood draw to diagnosis. We calculated the positive likelihood ratio as sensitivity/(1–specificity) and the negative likelihood ratio as (1–sensitivity)/specificity. We used the positive and negative likelihood ratios to estimate the probability of diagnosis of prostate cancer during follow-up given the information of the prostate specific antigen concentration (post-test probability), assuming a baseline probability of diagnosis of prostate cancer during follow-up of 10%.13 26 We used SAS 9.1 for statistical analyses.
|
|
Validity of prostate specific antigen in predicting subsequent prostate cancer diagnosis during follow-up
In the full group, the area under the curve for prostate specific antigen was 0.84 (95% confidence interval 0.82 to 0.86). It was higher for cases with a short lag time than for those with a long lag time, higher among cases aged under 59 at the time of recruitment than in those over 59, and higher for high risk tumours than for low risk tumours (table 2
).
|
|
|
Prostate specific antigen based screening
The European Randomized Study of Screening for Prostate Cancer (ERSPC) recently showed that screening and early intervention can reduce the rate of death from prostate cancer but at the cost of considerable overdiagnosis and overtreatment.7 The Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial found no significant difference in the rate of death from prostate cancer between the screening group and the control group.28 However, the PLCO result probably reflects contamination among controls of whom a large proportion had been tested for prostate specific antigen.
Best available biomarker for cancer
In comparison with other putative biomarkers, prostate specific antigen confers extremely high odds ratios even for modestly raised concentrations,29 30 and our estimates of sensitivity, specificity, and area under the curve were largely similar to results obtained in previous studies with the same longitudinal study design, despite relatively large differences in age at recruitment, lag time, and characteristics of the tumours.16 17 18 19 20 21 These results confirm that circulating prostate specific antigen is a robust marker with a relatively high validity in predicting a future diagnosis of prostate cancer.
However, when screening a population with a relatively low prevalence of prostate cancer, extremely high validity must be achieved. In particular, the specificity should exceed 95% to avoid unnecessary, potentially harmful and costly follow-up procedures in a large number of healthy people.31 32 In our study, a prostate specific antigen cut-off value of 5.0 ng/ml was needed to achieve a specificity of 95%, a cut-off resulting in a sensitivity of merely 33%. The difficulties in finding a prostate specific antigen cut-off value resulting in a sufficiently high specificity concurrently with a reasonably high sensitivity (that is, above 50%) are graphically illustrated in figure 1
by the large overlap in the distribution of prostate specific antigen concentrations in cases and controls.
Likelihood ratios
Estimates of likelihood ratios are powerful tools in evaluating the clinical usefulness of a screening test, as likelihood ratios are not affected by the prevalence of a disease.13 However, to the best of our knowledge, likelihood ratios have not been used to evaluate prostate specific antigen as a screening test for prostate cancer. The usefulness of a screening test is determined by how well it predicts disease, and this can be evaluated by using likelihood ratios while adapting for various existing risk factors for disease. Hence, a risk estimate can be estimated on the basis of a combination of risk factors, rather than using a single cut-off value.13 A positive likelihood ratio above 10 for a diagnostic test is considered to be strong evidence to "rule in" disease, whereas a negative likelihood ratio below 0.1 is considered sufficient evidence to "rule out" disease.14 In our data, no single cut-off value for prostate specific antigen resulted in positive and negative likelihood ratios close to these values. However, a cut-off of 1.0 ng/ml resulted in a negative likelihood ratio of 0.08, and only six (1.2%) men diagnosed as having high risk cancer had pre-diagnostic prostate specific antigen concentrations below 1.0 ng/ml, suggesting that this cut-off may be useful in identifying men with very low risk of prostate cancer. This result is in accordance with data from a screening study in Gothenburg, Sweden, in which no man with a prostate specific antigen concentration below 1.0 ng/ml was diagnosed as having prostate cancer during three years of follow-up.26
Strengths and limitations
Baseline characteristics of a study population influence estimates of validity. In particular, characteristics of tumours affect estimates of sensitivity, and one advantage of our study was that the case mix mirrored that of the source population, a property strengthening the external validity of our study.24 The standardised incidence rate ratio for prostate cancer in the Västerbotten Intervention Project cohort was 1.05 (95% confidence interval 0.96 to 1.16) compared with the source population up to 2002. Another advantage of our study was the relatively low frequency of testing for prostate specific antigen. Notably, our dataset represented a "best case scenario," in that the likelihood ratios in populations with a higher uptake of testing for prostate specific antigen and consequently a larger proportion of low risk tumours will be substantially less advantageous than we observed.15
Characteristics of controls affect estimates of specificity, and the median concentration and distribution of prostate specific antigen concentrations in our controls were very similar to those in the European Randomized Study of Screening for Prostate Cancer.8 The specificity estimates obtained in our study were also similar to those obtained in other investigations with similar, and different, study designs.15 19 20 Hence, the results of this study can be extrapolated to other white European populations in which no widespread screening with prostate specific antigen tests is ongoing. However, the lack of long follow-up is a limitation of our study.
Conclusions
Although prostate specific antigen has a relatively high validity for prediction of subsequent prostate cancer, this longitudinal study shows that no cut-off value for prostate specific antigen attains the likelihood ratios formally required for a screening test. However, prostate specific antigen concentrations below 1.0 ng/ml virtually ruled out a diagnosis of prostate cancer during follow-up, and higher prostate specific antigen concentrations expressed a continuum of prostate cancer risk. Taken together, our study and the recent findings from screening trials strongly indicate that in addition to serum concentrations of prostate specific antigen, further biomarkers are needed before population based screening for prostate cancer can be recommended.
|
Cite this as: BMJ 2009;339:b3537
Contributors: PS, MJ, and GH contributed to study conception and design. PS, BH, MJ, U-HS, and AB contributed to analysis and interpretation of the data. U-HS did the biochemical analysis. AB was responsible for revision of core biopsies. BH, MJ, and PS contributed to drafting of the article. All authors critically revised the article for important intellectual content and gave final approval. GH provided the study participants. MJ provided statistical expertise. PS obtained funding. BH, MJ, and PS are the guarantors.
Funding: This study was supported by grants from the Swedish Cancer Foundation and the Lions Cancer Research Foundation at Umeå University. The funding source had no role in the study design; collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The researchers were all independent from the funding source.
Conflicts of interest: None declared.
Ethical approval: The research ethical committee at Umeå University Hospital approved of the study.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?
Read all Rapid Responses