Natural experiment examining impact of aggressive screening and treatment on prostate cancer mortality in two fixed cohorts from Seattle area and ConnecticutBMJ 2002; 325 doi: https://doi.org/10.1136/bmj.325.7367.740 (Published 05 October 2002) Cite this as: BMJ 2002;325:740
- Grace Lu-Yao, directora,
- Peter C Albertsen, professor of surgeryb,
- Janet L Stanford, member and head, Program in Prostate Cancer Researchc,
- Therese A Stukel, professor of biostatisticsd,
- Elizabeth S Walker-Corkery, research coordinatore,
- Michael J Barry, associate professor of medicine, Harvard Medical School ()e
- aHealthStat, PO Box 7501, Princeton, NJ 08543, USA
- bDivision of Urology, Department of Surgery, University of Connecticut Health Center, MC 3955, Farmington, CT 06030, USA
- cDivision of Public Health Sciences, Programs in Epidemiology and Prostate Cancer Research, Fred Hutchinson Cancer Research Center, 1100 Fairview Avenue North, MW-814, Seattle, WA 98109, USA
- dCenter for the Evaluative Clinical Sciences, Dartmouth Medical School, 7251 Strasenburgh, Hanover, NH 03755, USA
- eMedical Practices Evaluation Center, Massachusetts General Hospital, 50 Staniford Street, 9th floor, Boston, MA 02114, USA
- Correspondence to: M J Barry
- Accepted 24 June 2002
Objective:To determine whether the more intensive screening and treatment for prostate cancer in the Seattle-Puget Sound area in 1987-90 led to lower mortality from prostate cancer than in Connecticut.
Design: Natural experiment comparing two fixed cohorts from 1987 to 1997.
Setting: Seattle-Puget Sound and Connecticut surveillance, epidemiology, and end results areas.
Participants: Population based cohorts of male Medicare beneficiaries aged 65-79 drawn from the Seattle (n=94 900) and Connecticut (n=120 621) areas.
Main outcome measures: Rates of screening for prostate cancer, treatment with radical prostatectomy and external beam radiotherapy, and prostate cancer specific mortality.
Results: The prostate specific antigen testing rate in Seattle was 5.39 (95% confidence interval 4.76 to 6.11) times that of Connecticut, and the prostate biopsy rate was 2.20 (1.81 to 2.68) times that of Connecticut during 1987-90. The 10 year cumulative incidences of radical prostatectomy and external beam radiotherapy up to 1996 were 2.7% and 3.9% for Seattle cohort members compared with 0.5% and 3.1% for Connecticut cohort members. The adjusted rate ratio of prostate cancer mortality up to 1997 was 1.03 (0.95 to 1.11) in Seattle compared with Connecticut.
Conclusion: More intensive screening for prostate cancer and treatment with radical prostatectomy and external beam radiotherapy among Medicare beneficiaries in the Seattle area than in the Connecticut area was not associated with lower prostate cancer specific mortality over 11 years of follow up.
What is already known on this topic
Screening for prostate cancer with the prostate specific antigen test is widely practised in the United States and has resulted in a remarkable increase in incidence of diagnosed disease
Randomised trials are under way to determine whether early detection and aggressive treatment reduce mortality from prostate cancer
Recent reductions in prostate cancer mortality in the United States have been attributed to screening and treatment, raising questions about whether continuing the trials is ethical
What this study adds
Prostate cancer screening and treatment were much more intensive among men in the Seattle-Puget Sound area than in Connecticut early in the “prostate specific antigen era”
Over 11 years of follow up, no difference in prostate cancer mortality was seen in the two cohorts
The lack of association between more intensive screening and treatment and lower prostate cancer mortality suggests that trials should continue in order to settle this question
During the early 1990s the incidence of prostate cancer in the United States rose dramatically after the introduction of testing for prostate specific antigen. The subsequent decline in incidence probably represents depletion of prevalent cases from the pool of men undergoing screening.1 2In the mid-1990s population based prostate cancer mortality peaked and then decreased by about 15%2.3 Although the decline in mortality may be attributable to screening, several studies have highlighted difficulties in making inferences about causation from cross sectional population based data.4–6
The dissemination of prostate cancer screening and treatment was associated with substantial regional variations.7Several studies have documented that the frequency of prostate specific antigen testing, prostate biopsy, and radical prostatectomy among Medicare age men in the Seattle-Puget Sound area was initially higher than in Connecticut. 17
If the recent national downturn in mortality from prostate cancer is in part attributable to screening and treatment, then an earlier and larger decline in prostate cancer mortality would be expected in Seattle than in Connecticut. The age adjusted prostate cancer death rates in the two regions were almost identical before prostate specific antigen testing (155.8 v 155.6 deaths per 100 000 person years for white men aged 65-79 and 317.2 v 323.3 deaths per 100 000 person years for African-American men aged 65-79 from 1977 to 1986) (US data by SEER region, age, and race provided L Ries, Cancer Statistics Branch, National Cancer Institute).
This paper presents an 11 year longitudinal study of two cohorts of male Medicare beneficiaries from the Seattle-Puget Sound area and Connecticut exposed to different intensities of prostate cancer screening and treatment during the “early prostate specific antigen era,” which we defined a priori as 1987-90. The institutional reviewboards of Partners Healthcare System and the participating institutions approved the study.
Data sources and inclusion criteria
Medicare provides health insurance for people aged 65 and over in the United States and is administered by the Centers for Medicare and Medicaid Services, formerly the Health Care Financing Administration. Medicare pays treatment claims under two programmes: part A covers hospital, nursing home, and home health care, and part B covers physician and outpatient care. The US National Cancer Institute's surveillance, epidemiology, and end results (SEER) program collects cancer incidence and survival data from 11 population based cancer registries covering approximately 14% of the US population.
We used four specific data sources for this study: Medicare denominator and vital status files, SEER-Medicare linked database, and local SEER registry data. We used the denominator and vital status files, containing information on county of residence, to identify men in the participating SEER areas. Medicare analysts then matched the preliminary study cohort with an existing SEER-Medicare linked file and sent the data to the two local SEER registries. The SEER registries excluded men diagnosed as having prostate cancer before 1987 and supplied updated information on survival and cause of death on the remainder.
To create the SEER-Medicare linked database, each SEER registry sends Medicare information on each person diagnosed as having cancer in its area. Medicare then uses a deterministic matching algorithm to link this data with claims files. To ensure confidentiality, unique identifiers are assigned. We obtained data from the most recent linkage for 1987-96, for which a 93% match rate was achieved.8 The file included prostate specific antigen, prostate biopsy, and radical prostatectomy claims for 100% of prostate cancer cases up to 1996 and prostate specific antigen and biopsy claims for a 5% sample of cases without prostate cancer only up to 1993.
We included men who were Medicare beneficiaries aged 65-79 without prostate cancer as of 1 January 1987 and resident within the Seattle-Puget Sound or Connecticut SEER region from 1 January 1987 to 31 December 1990.
Measurement of screening and treatment intensity
We used rates of claims for both prostate specific antigen tests and prostate biopsies as measures of screening intensity. Biopsy rates reflect the intensity of screening with digital rectal examinations as well as prostate specific antigen. As prostate specific antigen and biopsy data were available for 100% of cancer cases and 5% of non-cancer cases up to 1993, we calculated the biopsy rate by using a weight of 1 for non-cancer cases and 0.05 for cancer cases. We identified prostate specific antigen tests by current procedural terminology codes 86316 and 84153 (first available in 1988) and biopsies or ultrasound guided biopsies by codes 55700, 55705, 76942, and 76943. We excluded a small percentage of beneficiaries enrolled in health maintenance organisations or without part B coverage from the analyses of screening, as their claims were incomplete. We excluded prostate specific antigen tests and biopsies that occurred after diagnosis of prostate cancer.
In the prostate specific antigen era screening drives incidence of prostate cancer1; we therefore used prostate cancer incidence as a secondary measure of screening intensity. Prostate cancer incidence data were available up to 1996.
Data on the use of radical prostatectomy were available for all cancer cases from 1987 to 1996. We used SEER data alone to document the use of external beam radiation within four months of diagnosis for the same years.
Prostate cancer mortality
The primary end point for this study was prostate cancer mortality for the two cohorts from 1987 to 1997. We based this on survival data provided directly from the SEER registries.
We expressed estimated rates of death, screening, and treatment as numbers of events per 100 000 person years. We summed the number of patients alive to the end of the year and half of the patients who died or were lost to follow up during the year to calculate the person years in each cohort annually. We used Poisson regression models to calculate adjusted relative rates of screening, treatment, and death between regions.9 This method produces similar relative rate estimates to Cox regression,10 as the grouped one year time intervals are short.11 We obtained SEER-Medicare linked data on all outcomes grouped by age (65-69, 70-74, 75-79 years), year of study, and registry area. All analyses used the age group-year-area stratum as the unit of analysis, weighted by the number in the stratum. All models controlled for age group, race, area of residence, study year, and an age-race interaction. We censored follow up at year of death or 1997, whichever was earlier. We incorporated variance overdispersion in the estimates of all standard errors to account for possible clustering of outcomes within strata due to common life or practice style influences.9This adjustment increased the width of the confidence intervals negligibly for prostate specific antigen and biopsy, 1.5-fold for radical prostatectomy, and 2.1-fold for cancer incidence. Mortality was not clustered within strata, so we report the Poisson based rate ratios and confidence intervals.
We used life table methods to determine the cumulative incidence of a first prostate specific antigen test (1988-93) and of a prostate cancer diagnosis, radical prostatectomy, and external beam radiation (1987-96) in the two regions.10To show population based prostate cancer mortality trends over time in the two study regions we present cross sectional death rates, adjusted to the age of the study population in 1992. All statistical tests were performed at the 5% level and were two sided.
Table 1shows the race and age distributions for the 215 521 eligible men in both cohorts. Cohort members in the Seattle-Puget Sound region were 5.39 (95% confidence interval 4.76 to 6.11) times more likely to undergo prostate specific antigen testing in 1988-90 (table 1) and 2.20 (1.81 to 2.68) times more likely to undergo prostate biopsy in 1987-90 (table 1) than their counterparts in Connecticut. Differences in prostate specific antigen testing and biopsy rates narrowed considerably in 1991-3; the Seattle to Connecticut adjusted rate ratio was 1.61 (1.48 to 1.75) for prostate specific antigen and 1.14 (0.93 to 1.40) for biopsy. Figure 1 displays the cumulative incidence of a first prostate specific antigen test among cohort members in the two regions from 1988 to 1993.
Prostate cancer incidence reflects screening rates (fig 2). The adjusted cumulative incidence of prostate cancer was 93% (81% to 107%) higher among men in Seattle-Puget Sound than in Connecticut in 1987-90. The difference in incidence diminished over time; during 1991-6 the cumulative prostate cancer incidence was only 11% (4% to 18%) higher in the Seattle area.
Between 1987 and 1990 men in the Seattle area were more likely to have radical prostatectomy or external beam radiation than their counterparts in Connecticut. Men in the Seattle area had a 5.9-fold (5.0 to 6.9) higher rate of radical prostatectomy and 2.3-fold (2.2 to 2.5) higher rate of external beam radiation during 1987-90. The 10 year cumulative incidences of radical prostatectomy and external beam radiation from 1987 to 1996 were 2.7% and 3.9% for Seattle-Puget Sound cohort members and 0.5% and 3.1% for Connecticut cohort members (fig 3
No significant difference in prostate cancer mortality existed between the Seattle and Connecticut cohorts over the entire 11 year follow up period. The adjusted rate ratio of prostate cancer mortality to 1997 was 1.03 (0.95 to 1.11) in Seattle compared with Connecticut (table 4). As any effect of more aggressive screening and treatment on mortality may have been delayed, we compared prostate cancer mortality separately for the earlier (1987-92) and later (1993-7) years of follow up. No significant differences occurred in either period—rate ratios 0.97 (0.81 to 1.16) versus 1.08 (0.98 to 1.20). Fig 4displays cross sectional prostate cancer mortality for men aged 65-79 from 1987 to 1997, documenting similar decreases in both areas.
Given the greater intensity of screening, diagnosis, and treatment documented among cohort members in the Seattle-Puget Sound area than in Connecticut, we would have expected to see lower prostate cancer mortality in the Seattle region over time. However, we found no significant difference in prostate cancer mortality over 11 years of follow up. The confidence interval around the rate ratio for mortality was inconsistent with more than a 5% reduction in prostate cancer mortality in Seattle. Moreover, the overall drop in prostate cancer mortality seemed similar in the two regions (fig 4). The results of this study therefore do not support the hypothesis that the intensity of screening and treatment with surgery or radiation was related to the reduction in prostate cancer mortality seen in the two regions.
A recent report has documented decreases in population based prostate cancer mortality in Tyrol compared with other states in Austria after the introduction of mass prostate specific antigen screening in Tyrol.12Our results are in conflict with these for unclear reasons; although the intensity of screening in Tyrol seems similar to that in the Seattle area (about two thirds of men screened at least once over five years), the intensity of treatment in Tyrol and the intensities of both screening and treatment in the rest of Austria were not presented in that report.
Limitations of the study
Our study has several limitations. Firstly, the cohorts included only men aged 65 and over in 1987. Screening and treatment for prostate cancer may have a larger impact on younger men. However, as prostate cancer death is rare before age 70,3if recent decreases in prostate cancer mortality in the United States are attributable to screening and treatment with surgery and radiation this impact would almost certainly be seen among Medicare age men.
Secondly, during 1987-90 Medicare did not routinely pay for prostate specific antigen screening tests. Claims may not have always been submitted, therefore, and numbers of prostate specific antigen tests may be underestimated. Nevertheless, the relative rates of testing between the two regions should not be biased, and the differences in biopsies and incidence confirm the higher intensity of screening in the Seattle area.
Thirdly, follow up over 11 years may not have been long enough to see a difference in prostate cancer mortality. However, if the decreases in population based prostate cancer mortality noted in both these areas (fig 4) are indeed attributable to screening and treatment with surgery or radiation, the time frame should have been sufficient to see an effect. Nevertheless, further follow up is planned.
Fourthly, we used SEER data to capture new diagnoses of prostate cancer, so records of diagnosis or cause of death for cohort members who moved out of their SEER areas after 1990 were unavailable. A differential rate of death from prostate cancer among men who moved after 1990 could introduce bias. However, Medicare enrolment files indicated that less than 1% of cohort members without prostate cancer moved out of their regions before dying. As only about 3% of these men would be expected to die of prostate cancer, the impact of any differential rate of death from prostate cancer should be minimal.
Fifthly, as the primary outcome measure was prostate cancer specific mortality a differential assignment of cause of death among prostate cancer patients in the two regions could bias comparisons. Earlier studies have shown a relatively high agreement (over 90%) between medical records and underlying causes of death as recorded on death certificates.13Our group has shown a high level of agreement between medical records and the cause of death as listed on the death certificate among patients with prostate cancer in Connecticut—91% for men dying in 1995 and 82% for men dying in 1985—with no change in the coding of cause of death among prostate cancer patients dying in the pre-prostate specific antigen (1985) and prostate specific antigen (1995) eras.14 Moreover, as part of the current study, we replicated this analysis for patients with prostate cancer who died in the Seattle area in 1995; once again, the agreement between death certificates and medical records on cause of death was greater than 90%.15
Sixthly, prostate specific antigen and biopsy data were incomplete for men enrolled in a Medicare health maintenance organisation in the two SEER areas during the early prostate specific antigen era. The men enrolled in health maintenance organisations were included in the primary analyses of treatment and mortality rates. Perhaps men enrolled in health maintenance organisations were not as intensively screened in the Seattle area, which would tend to dilute any mortality benefit attributable to screening. However, excluding men enrolled in health maintenance organisations from the mortality analysis did not affect the results: rate ratio=1.0 (0.9 to 1.1).
Finally, men in the two cohorts may have differed on important risk factors for prostate cancer. Although only randomised trials can yield truly unbiased estimates of the efficacy of screening and treatment on prostate cancer mortality, their external validity might be limited.16This longitudinal cohort study, which applied uniform selection criteria at “zero time”for determining eligibility and included a broad representation of the population at risk, may provide complementary and important insights into what might be expected at the population level.
Why has mortality decreased?
This study does not shed light on the reasons for the decline in prostate cancer mortality in these two regions. More effective treatment for advanced disease may have improved mortality in both areas; rates of androgen deprivation, a primary treatment for advanced prostate cancer, could not be tracked with the data available. Additionally, changes in lifestyle or environmental factors that may affect the progression of prostatecancer may have had a role in these mortality trends.
More intensive screening for prostate cancer and treatment with surgery or radiation among a cohort of Medicare beneficiaries in the Seattle-Puget Sound area compared with a cohort in Connecticut has not led to significantly lower mortality from prostate cancer over 11 years. Longer follow up will be necessary to fully assess the outcome of this natural experiment. Meanwhile, ongoing randomised trials assessing the effectiveness of screening and treatment for prostate cancer should be supported.
The study used the linked SEER-Medicare database; the interpretation and reporting of these data are the sole responsibility of the authors. We acknowledge the efforts of the Applied Research Program, National Cancer Institute; the Office of Information Services and the Office of Strategic Planning, HCFA; Information Management Services (IMS); and the Surveillance, Epidemiology, and End Results (SEER) Program tumour registries in the creation of the SEER-Medicare database. Additionally, we thank E Robert Greenberg of the Norris Cotton Cancer Center at Dartmouth-Hitchcock Medical Center for providing insightful comments, Maribel Franey and Edward Franey at HCFA/CMS for processing our data request and matching our cohort with the SEER-Medicare linked file, and the Seattle-Puget Sound and Connecticut SEER registries for updating and evaluating cancer incidence and mortality in the study cohrts.
Contributors: GL-Y, PCA, JLS, ESW-C, and MJB participated in the conception and design of the study and acquisition of data. GL-Y, PCA, JLS, TAS, and MJB participated in planning the analysis and interpreting the results. GL-Y performed the statistical analyses. All authors contributed to writing and revising the manuscript. GL-Y is the guarantor.
Editorial by Thornton
Funding Agency for Health Care Research and Quality, grant Nos HS 08397 and HS 10278.
Competing interests None declared