Intended for healthcare professionals

CCBYNC Open access
Research

International variation in radiation dose for computed tomography examinations: prospective cohort study

BMJ 2019; 364 doi: https://doi.org/10.1136/bmj.k4931 (Published 02 January 2019) Cite this as: BMJ 2019;364:k4931

Linked editorial

Unacceptable variation in radiation doses from CT scans

  1. Rebecca Smith-Bindman, professor1,
  2. Yifei Wang, biostatistician2,
  3. Philip Chu, biostatistician2,
  4. Robert Chung, demographer3,
  5. Andrew J Einstein, director of cardiac CT research4,
  6. Jonathan Balcombe, radiologist5,
  7. Mary Cocker, clinical scientist6,
  8. Marcos Das, head of department7 8,
  9. Bradley N Delman, radiologist9,
  10. Michael Flynn, medical physicist10,
  11. Robert Gould, professor2,
  12. Ryan K Lee, clinical associate professor11,
  13. Thomas Yellen-Nelson, professor12,
  14. Sebastian Schindera, professor13,
  15. Anthony Seibert, professor14,
  16. Jay Starkey, radiologist15,
  17. Saravanabavaan Suntharalingam, radiologist16,
  18. Axel Wetter, radiologist17,
  19. Joachim E Wildberger, professor8,
  20. Diana L Miglioretti, professor18 19
  1. 1Department of Radiology and Biomedical Imaging Epidemiology and Biostatistics, Obstetrics Gynecology and Reproductive Sciences, Philip R Lee Institute for Health Policy Studies, University of California San Francisco, San Francisco, CA, USA
  2. 2Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA
  3. 3Department of Demography, University of California Berkeley, Berkeley, CA, USA
  4. 4Department of Medicine, Division of Cardiology and Department of Radiology, Columbia University Medical Center, New York, NY, USA
  5. 5Assuta Medical Center, Tel Aviv-Yafo, Israel
  6. 6Department of Medical Physics, Churchill Hospital, Oxford University Hospitals NHS Foundation Trust, Oxford, UK
  7. 7Department of Diagnostic and Interventional Radiology, Helios Kliniken Duisburg, Duisburg, Germany
  8. 8Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, Netherlands
  9. 9Department of Radiology, Icahn School of Medicine at Mount Sinai, New York, NY, USA
  10. 10Henry Ford Health System, Radiology and Public Health Sciences, Detroit, MI, USA
  11. 11Department of Radiology, Einstein Healthcare Network, New York, NY, USA
  12. 12University of California San Diego, San Diego, CA, USA
  13. 13Cantonal Hospital Aarau, Aarau, Switzerland
  14. 14Department of Radiology, University California Davis Medical Center, Sacramento, CA, USA
  15. 15St Luke’s International Hospital, Tokyo, Japan
  16. 16Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen, Germany
  17. 17Institute of Diagnostic and Interventional Radiology and Neuroradiology, Essen University, Essen, Germany
  18. 18Department of Public Health Sciences, University of California Davis School of Medicine, Sacramento, CA, USA
  19. 19Kaiser Permanente Washington Health Research Institute, Kaiser Permanente Washington, Seattle, WA, USA
  1. Correspondence to: R Smith-Bindman, School of Medicine, 350 Parnassus Avenue, San Francisco CA 94117, USA Rebecca.Smith-Bindman{at}ucsf.edu
  • Accepted 30 October 2018

Abstract

Objective To determine patient, institution, and machine characteristics that contribute to variation in radiation doses used for computed tomography (CT).

Design Prospective cohort study.

Setting Data were assembled and analyzed from the University of California San Francisco CT International Dose Registry.

Participants Standardized data from over 2.0 million CT examinations of adults who underwent CT between November 2015 and August 2017 from 151 institutions, across seven countries (Switzerland, Netherlands, Germany, United Kingdom, United States, Israel, and Japan).

Main outcome measures Mean effective doses and proportions of high dose examinations for abdomen, chest, combined chest and abdomen, and head CT were determined by patient characteristics (sex, age, and size), type of institution (trauma center, care provision 24 hours per day and seven days per week, academic, private), institutional practice volume, machine factors (manufacturer, model), country, and how scanners were used, before and after adjustment for patient characteristics, using hierarchical linear and logistic regression. High dose examinations were defined as CT scans with doses above the 75th percentile defined during a baseline period.

Results The mean effective dose and proportion of high dose examinations varied substantially across institutions. The doses varied modestly (10-30%) by type of institution and machine characteristics after adjusting for patient characteristics. By contrast, even after adjusting for patient characteristics, wide variations in radiation doses across countries persisted, with a fourfold range in mean effective dose for abdomen CT examinations (7.0-25.7 mSv) and a 17-fold range in proportion of high dose examinations (4-69%). Similar variation across countries was observed for chest (mean effective dose 1.7-6.4 mSv, proportion of high dose examinations 1-26%) and combined chest and abdomen CT (10.0-37.9 mSv, 2-78%). Doses for head CT varied less (1.4-1.9 mSv, 8-27%). In multivariable models, the dose variation across countries was primarily attributable to institutional decisions regarding technical parameters (that is, how the scanners were used).

Conclusions CT protocols and radiation doses vary greatly across countries and are primarily attributable to local choices regarding technical parameters, rather than patient, institution, or machine characteristics. These findings suggest that the optimization of doses to a consistent standard should be possible.

Study registration Clinicaltrials.gov NCT03000751.

Introduction

Radiation doses for computed tomography (CT) vary substantially across patients, institutions, and countries.1234 Ionizing radiation is a known carcinogen,5678910 and CT radiation is associated with increased cancer incidence.11121314 Therefore, it is important to minimize exposure from medical imaging and reduce unnecessary variation by optimizing examination protocols. Evidence suggests that in many instances, CT doses can be reduced by 50% or more without reducing diagnostic accuracy.15 However, differences in patient populations and inconsistencies in data collection and analysis have challenged both accurate quantification of dose variations and determination if variability is driven primarily by patient characteristics (patient size, indications for imaging), institution type (eg, academic, private, trauma facility, or 24 h/day provider of CT), machine factors (eg, machine age, specific manufacturer and model, or use of updated software that permits dose reduction), or regional choices that affect dose optimization or image quality (or both). For example, the European Union collects dose levels in Europe, but differences in definitions and data collection techniques across member states confound the identification of factors that explain the observed variation.3 To develop optimization activities likely to meaningfully affect CT doses, we must understand the factors that influence them.

Various approaches have been used to optimize CT radiation doses. For example, doses for individual patients can be minimized by refining the scan coverage, altering technical parameters (eg, the machine’s x ray tube current) or by techniques such as iterative reconstruction.16 One widely used approach to standardize radiation doses is the creation of target dose levels17 or diagnostic reference levels. Levels are defined for groups of patients receiving broadly defined study types with the expectation that under best practices, levels will not be exceeded for average sized patients.3 Levels are frequently the 75th percentile of the observed dose distribution for a geographical area.31819 Target doses and diagnostic reference levels are often set locally, on the assumption that dose variation is driven by differences in equipment or patients.2021 However, without understanding precise factors behind variation in reported doses, it is unknown whether the setting of target levels locally is needed. For example, if dose variations between localities reflect differences in how CT machines are used rather than differences in underlying patient populations or machine manufacturer or specific models, setting standards and targets locally needlessly complicates optimization activities.

The University of California San Francisco CT International Dose Registry collects data from participating healthcare institutions worldwide that perform CT. In this study, we sought to use registry data to understand factors that influence CT dose, to inform development of dose optimization approaches, and to ultimately investigate the need (or lack of) to localize target levels.

Methods

Registry

The University of California San Francisco CT International Dose Registry was created to pool CT dose data from collaborating institutions on 100% of CT scans performed. Radiation and imaging data stored in digital imaging and communications in medicine (DICOM) format are exported onto a local server directly from the CT machines or via the picture archiving and communication systems (PACS) used to review these examinations. Data are stripped of patient identifying information other than study date and time, and transferred to the dose registry in real time.

Collaborating institutions

All healthcare institutions that used Radimetrics software (Bayer) in 2015 to monitor medical imaging radiation dose were invited by email to participate in the registry. The registry is a convenience sample and includes data from sites that expressed interest in participating and who were able to complete the logistical requirements of establishing data connections, complete data use agreements, receive institutional review board approval, and agree to complete the study aims. Institutions from seven countries were included.

Study population

We included diagnostic CT examinations of the abdomen (including any imaging through the abdomen or pelvis), chest, combined chest and abdomen, and head in adults aged 18 years and older between 1 November 2015 and 22 August 2017. Cardiac exams were excluded. The four groups included anatomical areas reflecting about 92% of all diagnostic CT exams during the study period. Spine CT, and exams performed across multiple anatomical areas comprised most of the excluded exams. CT exams for research, radiation oncology guidance, surgical or interventional procedures, or that were part of combined positron emission tomography-CT exams or single photon emission tomography-CT exams were excluded because of expected heterogenous doses for these study types.

Variables

Analyses were at the CT examination level, defined as a complete CT study, which could include several CT scans such as with and without intravenous contrast. Statistical analyses were performed separately for each anatomical area.

The analyses adjusted for a range of variables that we hypothesized might be associated with radiation doses. Patient characteristics extracted for each examination were age, sex, and size. Sex and size might be factors because the larger a patient, the greater the doses of radiation that must be used to generate an image equal in quality compared with doses needed in a smaller patient. Patient diameter, the proxy for size, was calculated as the average of the water equivalent diameter from each CT acquisition over the entire imaging range.22 Age could be important because institutions might lower doses for younger patients. Scanning indication could influence the radiation doses needed, because greater imaging quality might be needed for particular clinical questions, but was known for only a subset of examinations and could not be used to adjust for possible case mix differences across institutions. Instead, differences in dose were assessed by examination time of day, because those taking place at night (between 10 pm and 5 am) should primarily reflect acute imaging.

The type of institution might reflect the types and complexity of the patients seen at that institution, and therefore could predict doses use for imaging. The type of institution was extracted from a survey completed by each institution, which also included trauma center status, whether imaging was provided 24 h/day and 7 days/week (24/7), and self identification as an academic or private institution. Average machine and institutional practice volumes could be associated with dose based on volume-outcome associations described in many other areas of medical practice. Volumes were calculated on the basis of all CT examinations performed on weekdays.

Machine characteristics included manufacturer and model. These factors could be associated with dose because the technical capacity of machines have changed over time. Further, newer machines sometimes offer dose reduction software.

The technical parameters23 (including x ray tube parameters (kV and mAs), acquisition parameters (pitch and acquired slice thickness), scan length, and number of scans per examination) and CT dose metric parameters (volumetric CT dose index and dose length product) were stored for each CT scan. The volumetric CT dose index reflects the average dose value within a section (slice) of the scanned volume, whereas the dose length product reflects the total emitted radiation imparted to the patient (defined as volumetric CT dose index×scan length). Effective dose, which is proportional to total imparted radiation, is an estimate that accounts for estimated future cancer risk based on irradiated organs. If multiple CT scans were performed during an examination, a weighted average of the technical parameters was used. The number of CT scans did not include localizers or contrast bolus timing scans, although the radiation from the contrast bolus was included in the dose calculations. Effective dose was calculated for each examination by use of the dose length product and published conversion factors.22

Statistical analysis

We calculated descriptive statistics for CT scans by patient, institution, practice volume, machine, and country. The dose metrics of interest were effective dose (mean, standard deviation, median, and interquartile range) and the prevalence of high dose studies, defined as studies whose effective dose exceeded the 75th percentile during the first six months of study (1 November 2015 to 30 April 2016). Variation by less than 50% was considered modest variation.

Variation in radiation doses across institutions and countries and by predictive variables

We calculated the distribution in radiation doses for abdominal CT by institution and for all anatomical areas by country after adjusting for patient characteristics. The mean effective dose (and standard deviation) and proportion of high dose studies by institution, practice volumes, machine, and country are shown unadjusted and adjusted for patient characteristics to show how the doses vary by these factors. The adjusted effective dose and adjusted prevalence of high dose examinations were estimated by log-linear regression and logistic regression, respectively.

Multivariate analysis to identify factors that are associated with dose

To understand the contribution of patient, institution, practice volume, machine, country, and technical factors to the variation of effective dose between machines and countries, we fit a series of log-linear mixed effects models predicting effective dose. We graphically show a series of models displaying how the doses vary across the 290 machines included in the University of California San Francisco CT International Dose Registry. The first model contained no predictors except for a random effect accounting for clustering by machine and showed the average dose for each machine for abdomen CT. The second model added patient characteristics, showing the average dose for each machine after accounting for patient characteristics. Additional predictors were subsequently added to each model so that the final fully adjusted model included all of the predictor variables and log-transformed technical parameters (kVp, mAs, pitch, number of CT scans, scan length, and slice thickness).

To quantify variation in dose across the different machines and the reduction in variation after accounting for each predictor variable, we randomly sampled random effects for 10 000 pairs of machines from the estimated distribution and computed the ratio of the estimates for each pair. We presented the median, 75th percentile, and 95th percentile of these 10 000 bootstrapped ratios as relative doses. The 95% in the relative dose was used to quantify the variation between two randomly selected machines. The larger the ratio between two randomly selected machines, the greater the variation in dose across machines in the registry. A sharp decline in the variability of relative dose among machines and countries after a predictor was added indicates that the predictor accounted for a large amount of the variation. We also computed the expected mean effective dose in each country for each model, also shown in the figures.

The magnitude of the associations between dose and patient, institution, practice volume, machine, and country are also shown. The effect sizes were defined as the multiplicative change in dose for each standard deviation change in the associated covariate; the larger the estimated effect, the more important the variable. Lastly, we showed the effect of the inclusion of technical factors on the observed variation in dose across countries.

Sensitivity analysis

To remove the potential effect of case mix (that is, different reasons why patients underwent CT), we illustrated the variation in effective doses for one specific imaging indication: suspected pulmonary embolism. We also did a subanalysis for this indication using data from one machine model (Somaton Definition AS, Siemens Healthineers) to illustrate representative differences in technical parameters chosen by institutions for this indication and on this scanner. The main analyses were repeated using volumetric CT dose index as the outcome, and restricting to single phase CT examinations. We compared doses in the registry to published benchmarks, extracting combined data across age, sex, and size categories.342425262728 We abstracted effective doses from published reports, or calculated these from dose length product values using published conversion factors.22

Patient and public involvement

Patients were included as stakeholders in the project and contributed as part of in-person meetings and webinars to help guide the project direction.

Results

During the study period, 151 institutions from seven countries (Switzerland, Netherlands, Germany, United Kingdom, United States, Israel, and Japan) performed just over 2.0 million CT scans on about 1.7 million adults. Examinations were performed on 290 machines from four machine manufacturers and 49 machine models (table 1). Of the included CT scans, about one third were abdomen (n=724 627, 36%), one third head (682 701, 34%), and one third chest (n=515 007, 26%) or combined chest and abdomen (n=83 124, 4%). Numbers of examinations by patient, institution, practice volumes, machine, and country are shown in table 1.

Table 1

Characteristics of computed tomography (CT) examinations, institutions, and machines included in analyses

View this table:

Factors associated with CT dose

After accounting for patient characteristics, the median effective doses for abdominal CT across institutions ranged from 5 to 32 mSv (fig 1). The distribution in effective dose by country for each anatomical area (fig 2) demonstrated the greatest variation in median doses for abdomen and combined chest and abdomen CT.

Fig 1
Fig 1

Distribution in effective radiation dose by institution for abdomen CT, after adjustment for patient characteristics. Each column signifies one institution, ranked by mean effective dose. Light purple columns=5th and 95th percentiles of effective dose; dark purple, pink, and yellow column sections=25th and 75th percentiles of effective dose; lines=medians; horizontal solid line and dashed line=benchmark and target doses for abdomen, defined as the 75th and 50th percentiles of dose for all abdominal scans performed before 30 April 2016

Fig 2
Fig 2

Distribution of effective radiation dose by country and scan region, after adjustment for patient characteristics. Each column signifies one country or the European Union, with one horizontal line denoting each observation within the country. IL=Israel; JP=Japan; pink lines=within 25th and 75th percentiles; orange lines=two standard deviations from the mean; purple lines=outliers; horizontal solid line and dashed line=benchmark and target doses for each anatomical area, defined as the 75th and 50th percentiles of dose for all scans of that type performed before 30 April 2016

The mean effective dose and proportion of high dose examinations by institution, practice volume, machine, and country after adjustment for patient characteristics are shown in table 2 (corresponding unadjusted values in table S1). The adjusted mean effective doses varied modestly (typically by 10-20%; occasionally by up to 40%) by institutional characteristics and practice volumes. For example, mean effective dose for abdomen CTs was 12.1 mSv at trauma centers compared with 12.5 mSv at a non-trauma center (relative dose 0.97 mSv). The adjusted mean effective dose also varied modestly by manufacturer. In contrast with other factors considered, mean doses varied widely across countries, particularly for abdomen, chest, and combined chest and abdomen CT. Mean effective dose for abdomen CT ranged fourfold across countries (7.0 mSv in the Netherlands to 25.7 mSv in Japan), and the relative proportion of high dose studies varied more than 17-fold (4-69%). Variation was similar for effective dose for chest and combined chest and abdomen CT, with fourfold differences in mean dose across countries. Dose variation in head CT was more modest, with a relative mean dose between the highest dose and lowest dose countries of 1.3 (range 1.4-1.9 mSv).

Table 2

Computed tomography (CT) effective radiation doses and proportion of high dose examinations by institution and machine characteristics, adjusted for patient age, sex, and size

View this table:

In the subanalysis of patients who underwent CT for suspected pulmonary embolism scans, the variation in effective dose was substantial across countries (table 2). Mean effective dose ranged from 2.2 mSv to 33.2 mSv, and the relative proportion of high dose studies ranged from 0% to 89% (table 2). Variation in doses across countries were generally greater, rather than reduced, after adjustment for patient factors (table 2v table S1).

Factors explaining CT dose variation

The multivariable analyses highlighted that most factors considered (patient, practice volumes, machine factors) had only a small effect on the dose variation across different machines in the registry or between the different countries (fig 3, figures S1a-d). For abdomen CT examinations, the unadjusted 95th percentile of relative dose was 2.65, and the mean effective dose ranged from 7.3 mSv in Switzerland and Germany to 15.7 mSv in Israel, reflecting large variation between machines and countries. Subsequent adjustment for patient factors had no effect on relative dose (2.65) and resulted in a small increase (rather than decrease) in the differences in mean dose by country (range of 8.1 to 22.9 mSv). This suggests that despite the effective dose being highly correlated with patient characteristics (specifically patient size; table S1, table 3), patient size does little to explain the variability across machines or countries (fig 3, model 2). Sequential adjustment for institution and machine characteristics also had little effect on relative dose, although these adjustments slightly attenuated dose variation across countries (fig 3, models 3-5).

Fig 3
Fig 3

Mean effective radiation dose by machine in abdomen computed tomography (CT) scans, with different levels of adjustment. Model 1=unadjusted results; subsequent adjustments included: model 2, patient characteristics; model 3, institutional characteristics; model 4, machine manufacturer; model 5, machine model; and model 6, technical parameters. Rows=mean relative effective dose and 95th percentile of relative dose for two randomly chosen machines, with mean dose by country at the corresponding level of adjustment within multivariable model. Lines=dose for single machines. For abdomen examinations in model 1, 95th percentile of relative dose was 2.65 and mean effective dose ranged from 7.3 mSv (Switzerland) to 15.7 mSv (Israel)

Table 3

Multivariable regression results for change in mean computed tomography (CT) effective dose per standard deviation for continuous variables and relative dose for categorical variables. SD=standard deviation; asterisks=P<0.05

View this table:

The final adjustment including the specific technical factors substantially reduced or eliminated large differences in relative dose between machines and reduced or eliminated the large differences across countries. In model 6 (fig 3), the technical factors explained nearly all dose variation (95th percentile relative dose 1.42), and average doses among countries were similar after this final adjustment. Results were similar for the chest, combined chest and abdomen, and the subanalysis for pulmonary embolisms (figures S1a, b, and d). We saw large differences in the relative doses across machines and countries that were reduced or eliminated only after inclusion of the technical parameters. We found less variation in doses for head CT even without adjustment (figures S1c).

Effect of each predictive factor in multivariable models

Table 3 shows the magnitude of the association between effective dose and patient, institution, practice volume, machine, and country characteristics, based on the multivariate results. Patient size was a significant predictor of mean dose in the fully adjusted multivariable models with large effect sizes; for each standard deviation increase in patient size, mean dose increased by 36-47% for chest, abdomen, and combined chest and abdomen CT, and increased by 19% for head CT. We saw only small differences in dose by institutional characteristics; mean doses were slightly but significantly higher for chest and head CT at trauma centers, and head CT doses were higher at private institutions and those with scanning provided 24 h/day and 7 days/week. Most other institutional characteristics were not significantly associated with mean dose.

Abdomen, chest, and combined chest and abdomen CT doses did not differ significantly by manufacturer, although machines from Canon Medical Systems (Toshiba) were associated with modestly increased doses for head scans and machines from Siemens were associated with modestly reduced doses for suspected pulmonary embolism scans.

Although most predictive factors had relatively small effects on dose, large differences in dose persisted among countries for abdomen, chest, and combined chest and abdomen CT and for pulmonary embolism CT. The differences among countries was largest for suspected pulmonary embolism CT. We saw no significant differences in mean effective dose by country for head CT after accounting for other factors, suggesting a greater degree of protocol standardization for head imaging. The addition of specific scan parameters to the multivariable models (eg, x ray tube and acquisition parameters; table 4) attenuated or eliminated the differences between countries. This suggests that the differences among countries in the mean doses were not attributable to patient, institution, or machine factors (which all had small effects in table 3), but to the technical parameters.

Table 4

Multivariable linear regression results for relative computed tomography (CT) effective dose by country, accounting for all patient, institute, and machine characteristics with and without technical factors. Asterisks=P<0.05

View this table:

Effect of technical parameters on CT dose for one indication

Subanalysis of one specific indication (suspected pulmonary embolism) highlighted differences in technical parameters chosen by different institutions using the same machine make and model that resulted in the large observed differences in effective dose (table 5). We found a greater than 15-fold difference in mean effective doses between the institutions with the highest tenth versus lowest tenth in dose (mean effective dose 31.0 v 2.0 mSv). Accounting for patient size resulted in a slightly greater difference between the highest tenth and lowest tenth in protocols (mean effective dose 27.5 v 1.6 mSv). Compared with institutions in the highest tenth of effective dose, those in the lowest tenth had a lower adjusted CT dose index (3.8 v 15.9 mGy), tube potential (102 v 119 kVp), tube current (113 v 188 mAs), slice thickness (1.9 v 3.9), number of CT scans per examination (1.0 v 2.7), and had higher pitch (1.2 v 0.8). Thus, as shown for the analyses at the anatomical area level, dose variations in pulmonary embolisms CT, even when restricted to the same machine model, were explained by differences in technical parameters rather than patient characteristics.

Table 5

Technical details of computed tomography (CT) protocols included in the registry for suspected pulmonary embolism CT examinations at institutions with Siemens Somatom Definition AS machines. Data are mean (with or without standard deviation), adjusted for patient age, sex, and size; table rows ordered by mean effective dose

View this table:

Sensitivity analyses

Results were similar when we used the volumetric CT dose index as the outcome dose metric (results not shown), and when limited to single CT scan examinations (results not shown). The unadjusted doses in the University of California San Francisco CT International Dose Registry were similar to data in the literature (table S2). For example, the published benchmark abdomen dose in Switzerland is 10 mSv, and is 10.3 mSv (95% confidence interval 9.9 to 10.6) in the University of California San Francisco registry.

Discussion

Principal findings

Using an international registry of CT doses, we found large variation in doses across the included countries even after accounting for patient characteristics, numerous institutional characteristics, average machine and institutional practice volumes, and machine factors. The variation in dose persisted when we limited our analysis to one clinical question where the radiation dose requirements would have been the same across the included countries. To better understand reasons for variability between countries, we included technical parameters in multivariable models, the inclusion of which attenuated or eliminated these intercountry differences. These technical factors reflect an intermediate step in which clinical staff make changes that alter dose levels and hence can increase dose variation. Thus, CT dose differences among countries were not attributable to patient or institutional characteristics or machine manufacturer or model, but were almost entirely associated with how institutions used the machines, presumably reflecting different decisions about technical parameters to yield optimal CT images.

Comparison with other studies

International efforts to improve radiation safety for medical imaging vary considerably across the included countries, so it is not surprising that we found CT dose differences.3242930313233343536 For example, the EU adopted legislation with mandatory directives about medical radiation exposure from CT where member states are required to establish and promote diagnostic reference levels for CT.31323334 The US has educational efforts by professional societies, such as the American College of Radiology,29 and recommendations from government agencies ask institutions to assess their CT doses.37 However, no US organization is tasked with collecting, monitoring, or reporting CT radiation doses, and no national US legislation sets CT dose standards.38 Only two US states (California and Texas) have legislation related to CT scanning. In Japan, a consortium group has proposed national diagnostic reference levels, but these have not been widely adopted.24 In Israel, a few institutions have established diagnostic reference levels, but adoption is not uniform, although currently the ministry of health is considering establishment of a national dose registry.

One approach to optimizing CT doses has been setting benchmarks for optimum target doses. Challenges in setting benchmarks include difficulty in deciding how they should be established—for example, by anatomical area, clinical indication, or protocol3242529—and difficulty in collecting sufficient data to reflect actual practice. The ideal approach to creating benchmarks would likely reflect a compromise, with target dose levels based on broad anatomical areas, supplemented by additional target dose levels for specific clinical indications that have unique contrast and spatial resolution needs not captured by these broad anatomic areas.39

Our analysis used broad anatomical areas and considered the entire CT examination for several reasons. Firstly, having fewer categories simplified comparisons across institutions. Secondly, institutional decisions to use particular approaches (eg, single or multiple CT scan examinations) affects the doses delivered, and to stratify results within these narrow categories would mask the primary contributor to dose variation. For example, if an institution routinely uses multiple CT scan examinations to assess pulmonary embolism, this will result in higher radiation doses to their patients compared with facilities that routinely use just one CT scan examination. Assessment of doses within narrowly defined categories of single or multiple phase would mask differences and would not enable identification of institutions whose doses are outside practice norms because they use multiple scan examinations. Furthermore, there are few evidence based guidelines for choosing different approaches to scanning most clinical indications (that is, little data are available to link dose requirements to specific indications or diagnostic accuracy), and thus the use of broad anatomical areas seems most useful. The primary disadvantage of our approach was that grouping of exams by anatomical area precluded accounting for variation in case mix for the few clinical indications that might have unique spacial resolution needs. Inclusion of institutional characteristics in our analyses probably minimized differences by institutions.

A widely held belief is that CT dose standards and benchmarks must be created individually by each hospital,30 region, or country,340 a tailored approach necessitated by variation in achievable targets that are largely determined by the specific types and models of CT machines used and characteristics of the local patient populations.2021 In the EU, large differences in doses across included nations have been reported, which has contributed to the widely held belief that country specific benchmarks must be created.340 We did not find that dose variation is largely attributable to variation in patient requirements, clinical circumstances, or machine factors. We found that variations persist even when we limited analysis to patients assessed for a specific clinical condition, adjusted for patient factors, and restricted analysis to patients scanned on a single instrument model. Machine make and model are only modest predictors of dose and that substantial variance for each device type. The largest driver of dose variation was how providers or clinical staff chose to set the machine technical parameters, not the machine. Our results suggest that dose variation and outlier doses could be diminished without new equipment, which would require the creation of consistent standards, and to create those standards, the collection of standardized data across all countries similar to the data we include.

Our findings suggest that work is needed to understand why doses vary among users. The variation in radiation dose across countries will reflect the variation in image quality, and user's willingness to accept noisier images. We need to determine how institutions set up their CT scanning protocols and how to develop consensus about balancing image quality with diagnostic accuracy. Education and collaboration in setting standards could offer the largest effect on optimizing dose.4142 Choosing appropriate CT protocol parameters might be less complex than widely believed. Institutions with lower doses shared scanning approaches. These institutions tended to limit the number of protocols, with each relying on the minimum dose required to answer the clinical question. They used multiple CT scanning infrequently, had lower settings for tube current and tube potential, and used higher pitch for most, if not all, imaging indications. The key to protocol optimization is updating physician awareness and recalibrating expectations about what constitutes a diagnostic CT scan based on better alignment of CT protocol parameter choices with diagnostic image quality requirements.

Strengths and limitations

The main advantages of our study are its large size and detailed and standardized collection of data that allowed us to determine potential contributors to radiation dose. This study also had several limitations. The number of participating institutions for each country outside the US was limited so our data cannot be considered representative of any country as a whole. However, country specific doses in our registry are similar to those reported elsewhere,3242540 suggesting our estimates are likely to reflect country norms. We report effective dose, but the results were similar when limited to volumetric CT dose index or to single CT scans. We do not have a measure of image quality and cannot be sure that institutions with the lowest doses had image quality sufficient for diagnosis; however, each institution determined that their protocols provided adequate diagnostic information for their patients.

Our analyses did not include several technical factors associated with dose (eg, use of iterative reconstruction software), but such software, when used in actual practice, has been shown to have only a modest effect on dose.43 The inclusion of these factors would probably further reduce dose variation. The availability of alternative imaging modalities (eg, magnetic resonance imaging) could affect the case mix of patients who undergo CT, and we did not have information on availability of other imaging modalities. Our report on dose variation for a single indication on a single machine model indicates that some variability might be due to how the machines were configured. Finally, the institutions included in this registry are a convenience sample of institutions that use Radimetrics dose monitoring software. Institutions that invest in dose monitoring software might systematically differ from institutions that do not, although our doses were similar to published accounts by country. We plan to diversify our CT registry, and invite any institution that would like to participate.

Conclusions and policy implications

CT scanning doses varied widely across included countries. Variation was chiefly driven by how machines were used, rather than by patient or machine manufacturer or model. Optimizing doses to a more consistent standard should be possible both within and between countries by modifying the decisions made by radiology teams in developing CT protocols for patients. Future research should focus on understanding factors that drive institutions, and scientifically comparing different approaches for optimizing doses.

What is already known about this topic

  • Radiation doses used for computed tomography (CT) are highly variable across patients, institutions, and countries

  • Lowering patients’ exposure to radiation, a known carcinogen, requires an understanding of factors contributing to this variation

  • Owing to differences in patient populations and inconsistencies in data collection and analysis, accurately quantifying the dose variation or determining whether differences are primarily driven by specific factors has been difficult

What this study adds

  • Variation in doses used for CT scanning across patients is primarily driven by how CT scanners are used, and not to factors related to the patient, institution, or machine

  • The large variation in doses across countries is mainly attributable to institutional decisions regarding the technical parameters that are used rather than to underlying differences in the patients scanned or the machines used

  • These findings suggest that optimizing doses to a consistent standard is possible, which will probably require more education of individuals who create protocols for CT, recalibration of image quality expectations targeted to answering the clinical question at hand, and greater sharing of protocols across institutions

Footnotes

  • Contributors: RS-B contributed to obtaining funding, performing literature searchers, study design, data collection, data analysis, data interpretation, and writing the manuscript, and is the study guarantor. YW contributed to data analysis, data interpretation, and writing of the manuscript. PC contributed to data collection, data analysis, data interpretation, and writing of the manuscript. RC contributed to data analysis, data interpretation, and writing of the manuscript. AJE contributed to performing literature searches, study design, data analysis, data interpretation, and writing of the manuscript. RG, TY-N, and AS contributed to the study design, data collection, data interpretation, and writing of the manuscript. DLM contributed to obtaining funding, study design, data collection, data analysis, data interpretation, and writing of the manuscript. The remaining authors contributed to data collection, data interpretation and writing of the manuscript. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.

  • Funding: Funded by the US National Institutes of Health (R01-CA181191); Patient-Centered Outcomes Research Institute (CD-1304-7043); Centers for Disease Control and Prevention; and the University of California Office of the President, Center for Health Quality and Innovation; Chris Tachibana edited this manuscript, funded by Kaiser Permanente Washington Health Research Institute. Funders had no role in study design, collection, analysis, interpretation, and reporting of data; or decision to publish.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: support from the US National Institutes of Health; Patient-Centered Outcomes Research Institute; Centers for Disease Control and Prevention; and the University of California Office of the President, Center for Health Quality and Innovation for the submitted work; RS-B reports grants from the US National Institutes of Health, Patient-Centered Outcomes Research Institute, Centers for Disease Control and Prevention, and the University of California Office of the President, is on a scientific advisory board, and has given talks for Bayer Healthcare; BND is on a scientific advisory board and has given talks for Bayer Healthcare; AJE has served as a consultant to GE Healthcare, and Columbia University has received support for other research from Toshiba America Medical Systems; MD reports grants and personal fees from Bayer Healthcare, grants and personal fees from Siemens Healthcare, grants from Philips Healthcare, personal fees from Cook Medical, outside the submitted work; AS reports non-financial support and is on Bayer Healthcare scientific advisory board; JS has given talks for Bayer Healthcare; JEW reports institutional grants from Agfa, Bard, Bayer, GE, Optimed, Philips, Siemens, personal fees (speaker’s bureau) from Bayer, Siemens, outside the submitted work; DLM is on an advisory board for Hologic; the remaining authors have nothing to disclose.

  • Ethical approval: The institutional review boards at the University of California San Francisco (and the collaborating institutions) approved the study or relied on the university’s approval.

  • Data sharing: No additional data currently available.

  • The lead author affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References

View Abstract