Intended for healthcare professionals

CCBYNC Open access
Research

Relation between hospital orthopaedic specialisation and outcomes in patients aged 65 and older: retrospective analysis of US Medicare data

BMJ 2010; 340 doi: https://doi.org/10.1136/bmj.c165 (Published 11 February 2010) Cite this as: BMJ 2010;340:c165
  1. Tyson P Hagen, rheumatology fellow12,
  2. Mary S Vaughan-Sarrazin, research scientist23,
  3. Peter Cram, associate professor23
  1. 1Division of Rheumatology, Department of Internal Medicine, University of Iowa Carver College of Medicine, Iowa City, IA 52242, USA
  2. 2Center for Research in the Implementation of Innovative Strategies for Practice (CRIISP), Iowa City Veterans Affairs Medical Center, Iowa City
  3. 3Division of General Internal Medicine, Department of Internal Medicine, University of Iowa Carver College of Medicine
  1. Correspondence to: T P Hagen tyson-hagen{at}uiowa.edu
  • Accepted 30 October 2009

Abstract

Objective To explore the relation between hospital orthopaedic specialisation and postoperative outcomes after total hip or knee replacement surgery.

Design Retrospective analysis of US Medicare data, 2001-5.

Setting 3818 US hospitals carrying out total joint replacement.

Population 1 273 081 Medicare beneficiaries age 65 and older who underwent primary or revision hip or knee replacement.

Main outcome measures Hospitals were stratified into fifths on the basis of their degree of orthopaedic specialisation (lowest fifth, least specialised; highest fifth, most specialised). The primary outcome was defined as a composite representing the occurrence of one or more of pulmonary embolism, deep vein thrombosis, haemorrhage, infection, myocardial infarction, or death within 90 days of the index surgery.

Results As hospital orthopaedic specialisation increased from the lowest fifth to highest fifth, the proportion of people admitted who were women or black, or who had diabetes or heart failure progressively decreased (P<0.001), whereas procedural volume increased. Compared with the most specialised hospitals (highest fifth), after adjustment for patient characteristics and hospital volume, the odds of adverse outcomes increased progressively with decreased hospital specialisation: lowest fifth (odds ratio 1.59, 95% confidence interval 1.53 to 1.65), second fifth (1.32, 1.28 to 1.36), third fifth (1.24, 1.21 to 1.28), and fourth fifth (1.10, 1.07 to 1.13).

Conclusions Increased hospital orthopaedic specialisation is associated with improved patient outcomes after adjusting for both patient characteristics and hospital procedural volume. These results should be interpreted with caution because the possibility that other unmeasured confounders related to socioeconomic status or different factors are responsible for the improved patient outcomes rather than hospital specialisation can not be excluded. The findings suggest that hospital specialisation may capture different components of hospital quality than the components captured by hospital volume.

Introduction

Hospital procedural volume is typically defined as the number of patients undergoing a specific procedure, such as bypass surgery, at a specific hospital over a circumscribed period. Since the 1980s numerous studies have found an association between higher hospital procedural volume and improved patient outcomes.1 2 3 4 5 6 7 8 On the basis of these data many payers and purchasers—most visibly an assortment of private sector businesses in the United States—have organised into the Leapfrog Group coalition to advocate for minimum volume thresholds for hospitals carrying out many complex procedures. In both the United States and Europe, efforts have been made to concentrate certain medical procedures in high volume hospitals, with hopes of improving patient outcomes at a population level.8 9 10 11

Hospital specialisation differs from hospital volume and can be defined as the proportion of a specific hospital’s admissions falling into a single disease category—for example, orthopaedics. Although hospital specialisation offers a range of theoretical benefits,12 13 empirical data are limited and most studies deal with hospital specialisation only tangentially. For example, an array of articles in both the lay press and the medical literature have highlighted “world class” hernia outcomes achieved by Shouldice Hernia Centre in Canada.14 15 More recently, hospital specialisation has gained favour in the United States with the development of physician owned specialty hospitals that typically focus on single diseases or procedures, such as heart disease or orthopaedic surgery.16 17 18 19 Analyses assessing outcomes in these hospitals have typically been limited by the small number of such hospitals and the fact that these analyses typically have treated hospital specialisation as a dichotomous measure (specialty hospitals, yes or no). In defining specialisation so narrowly these studies have overlooked the fact that hospital specialisation is actually a continuous measure that can be broadly applied to most hospitals. To the best of our knowledge, the relation between hospital specialisation and patient outcomes has not been investigated previously.

To examine the relation between hospital orthopaedic specialisation and postoperative surgical outcomes we carried out a retrospective cohort study of US Medicare beneficiaries (all Americans aged 65 and older) who underwent total hip replacement or total knee replacement. We developed a measure of a hospital’s orthopaedic specialisation and then compared the demographics, socioeconomic status, and prevalence of comorbid illness among patients who received total hip replacement or total knee replacement in hospitals with lower and higher degrees of orthopaedic specialisation. We then assessed the structural characteristics of less and more specialised hospitals. Lastly, we compared risk adjusted and volume adjusted outcomes of patients who underwent joint replacement surgery in hospitals with lower and higher degrees of orthopaedic specialisation. We hypothesised that hospitals with increased orthopaedic specialisation would have improved patient outcomes after adjusting for patient characteristics, hospital characteristics, and hospital procedural volume.

Methods

We used data files from Medicare provider analysis and review part A to identify beneficiaries who underwent total hip replacement (n=483 970) or total knee replacement (n=873 125) from 2001-5. Medicare is an insurance programme operated by the US government and serves as the primary insurance for all Americans aged 65 or older. Patients were identified using the ICD-9CM (international classification of diseases, ninth revision, clinical modification) procedure codes (81.51 and 81.53 for primary and revision total hip replacement, 81.54 and 81.55 for primary and revision total knee replacement).5 6 20 The part A files contain a range of data collected from discharge abstracts for all fee for service Medicare enrolees admitted to hospital, including patient characteristics, postal code of primary residence, ICD-9CM codes for primary and secondary diagnoses and procedures, admission source (for example, emergency department or transfer from outside hospital), admission and discharge dates, discharge disposition (for example, home, another acute care hospital, death), death occurring up to three years after discharge, each patient’s unique Medicare beneficiary number allowing for identification of readmissions, and each hospital’s unique six digit identification number. We obtained postal code level median household income for each patient by linking the postal code of residence in the Medicare provider analysis and review files to postal code level income data available from the 2000 US census.21 Comorbid illnesses were identified using algorithms described previously22 and updated by other researchers,23 which consider 30 specific conditions and exclude comorbidities that may represent complications of care or that are related to the primary reason for admission to hospital. Additional high risk conditions specific to joint replacement surgery (previous hip or knee replacement, acute fracture, and active joint infection) were identified using methods defined in previous studies using administrative data to assess orthopaedic outcomes, and were considered as additional comorbid conditions.5 24 25

As is customary in studies using administrative data to assess orthopaedic outcomes, we excluded several patient populations from our primary analysis, including patients who underwent joint replacement after transfer from another acute care hospital (n=3764), those with acute fractures (n=41 192), those who had partial hip replacements (n=465), and those who had received multiple joint replacements during the index admission (n=2831). These patient populations are generally excluded from studies assessing orthopaedic outcomes because they are usually heterogeneous and are at especially high risk of adverse outcomes in ways that may not be well captured using administrative data.5 6 17 We excluded patients that had missing data on race (n=5583) and on postal codes as this precluded us from obtaining socioeconomic measures for these patients through linkage with the US census data (n=31 447). We calculated primary and revision total hip replacement and total knee replacement volume as well as aggregate annual joint replacement volume for each hospital by summing the number of procedures done in each hospital in the Medicare provider analysis and review data during each year. By linking the Medicare data to the 2006 American Hospital Association annual survey26 27 we obtained additional hospital characteristics, including whether each hospital was a major teaching centre, whether each hospital was or was not owned by physicians, the total number of annual admissions, and the number of hospital beds. We excluded 24 hospitals (n=1577 patients) that could not be linked to the survey. In total, application of all exclusion criteria resulted in the exclusion of 84 014 patients (6% of the initial sample). The sum of the listed exclusions does not equal the total reported exclusions because some patients had more than one type of missing data.

Measurement of hospital orthopaedic specialisation

We calculated the degree of each hospital’s orthopaedic specialisation by building on methods developed for identification of physician owned specialty hospitals.16 17 28 29 Specifically, for each hospital we calculated the percentage of Medicare admissions classified as major diagnostic criteria 8 (diseases of the musculoskeletal system) during 2001-5; each hospital’s specialisation could range from 0 (no admissions for major diagnostic criteria 8) to 100 (all admissions classified as major diagnostic criteria 8). We used graphical techniques and univariate methods to examine the distribution of orthopaedic specialisation among all US hospitals carrying out major joint replacement. We then stratified the hospitals into fourths, fifths, and 10ths containing equal numbers of hospitals based on their degree of orthopaedic specialisation, with fifths serving as the basis for our primary analyses.

Statistical analysis

Firstly, we evaluated trends in personal characteristics, socioeconomic status, and prevalence of comorbid illness of patients admitted to hospitals across fifths of orthopaedic specialisation (lowest fifth, least specialised; highest fifth, most specialised). We used logistic regression for dichotomous patient characteristics, such as percentage with diabetes, and linear regression for continuous variables, such as patient’s age, while controlling for clustering of patients within hospitals. Secondly, we used similar statistical methods to compare the characteristics of less specialised with more specialised hospitals. Specifically we compared the annual number of Medicare admissions, annual orthopaedic (major diagnostic criteria 8) admissions, annual joint replacement volumes, number of beds, hospital ownership status, and hospital teaching status between each fifth of orthopaedic specialisation.

Thirdly, we compared rates of adverse outcomes and length of hospital stay across fifths of orthopaedic specialisation for patients treated in hospitals. In particular we examined rates of six separate adverse outcomes occurring during the index admission or within 90 days of surgery that have been used in previous studies using administrative data to assess orthopaedic outcomes, including5 6 25 30 31 pulmonary embolism, deep vein thrombosis, postoperative haemorrhage, deep wound infection, and death, as well as myocardial infarction during the index admission. The primary outcome was a composite representing the occurrence of one or more of these adverse outcomes. The secondary outcome of interest was death within 90 days of the index surgery.

Fourthly, we used multivariable generalised linear models with a logit link to compare the odds of both the composite outcome and mortality with hospital specialisation, from the least specialised hospitals (lowest fifth) to the most specialised hospitals (highest fifth the reference category).32 33 We used these models to compare both the unadjusted odds of adverse outcomes and the adjusted odds of adverse outcomes with hospital specialisation after accounting for the differences in patient and hospital characteristics, and hospital procedural volume. We further accounted for the clustering of patients within hospitals with models using random effects. In developing the multivariable models we specified that key covariates, including patient characteristics and procedure type (primary or revision total hip replacement or total knee replacement), be included in our models; whereas other variables such as comorbid illnesses were included in the model only if they were significantly associated with the outcome at an α ≤0.15. The final model for the composite outcome contained 40 variables (see web extra appendix 1). For each multivariable model we carried out a test for trend for the hospital specialisation variable (P<0.01). Model discrimination was evaluated using the c statistic (mortality 0.80 and composite 0.70) and calibration was assessed using the Hosmer-Lemeshow statistic.34 35 All analyses were done using SAS 9.0.

Sensitivity analysis

To ensure the robustness of our findings we carried out several secondary analyses. Firstly, we repeated our analyses while including patient populations excluded in our primary analyses (for example, those admitted after hospital transfer, those with acute fractures) (see web extra appendix 2). Secondly, we repeated our analyses using alternative definitions of hospital specialisation including stratifying hospitals into fourths (see web extra appendix 4) and 10ths (see web extra appendix 5) of orthopaedic specialisation and including hospital specialisation as a continuous measure rather than a categorical one. Thirdly, we repeated our regression analyses to examine the association between fifth of hospital specialisation and each of the individual components of the composite outcome, such as deep vein thrombosis, infection, or myocardial infarction. Fourthly, we divided hospitals into low (<25 total hip replacement and total knee replacement procedures annually), medium (26-100), and high (>100) volume strata and repeated our multivariable analyses, to explore whether the relation between hospital specialisation and outcomes was similar among hospitals with similar joint replacement volumes. Finally, we carried out separate analyses for patients receiving each of the four types of procedure (primary and revision total hip replacement and total knee replacement) (see web extra appendix 3).

Results

The 3818 study hospitals carried out 1 273 081 major joint replacements from 2001-5. Patient characteristics and comorbidity varied as hospital specialisation increased (table 1). In particular, more specialised hospitals treated a lower proportion of women and African-Americans (P<0.001 for each) and those with fewer comorbid illnesses, including diabetes and heart failure (table 1).

Table 1

 Demographics, socioeconomic measures, and comorbidity of Medicare patients who underwent major joint replacement from 2001-5. Values are numbers (percentages) unless stated otherwise

View this table:

Hospital characteristics

The mean orthopaedic specialisation for the 3818 study hospitals was 12.4% (median 10.5%; figure). The mean orthopaedic specialisation for hospitals in the lowest fifth was 5.5%, second fifth 8.5%, third fifth 10.5%, fourth fifth 12.9%, and highest fifth 24.5% (table 2). More specialised hospitals on average carried out significantly greater volumes of both primary and revision joint replacements (P<0.001). Hospitals with the greatest degree of specialisation (highest fifth) were more likely than hospitals in the other fifths to be physician owned, but even among the most specialised hospitals only 8.4% were physician owned (table 2).

Figure1

Range of orthopaedic specialisation among US hospitals carrying out major joint replacement on Medicare beneficiaries, 2001-5

Table 2

 Characteristics of hospitals carrying out major joint replacement on Medicare beneficiaries, 2001-5. Values are medians (interquartile ranges) unless stated otherwise

View this table:

Outcomes

As hospital orthopaedic specialisation increased, unadjusted rates of each of the five adverse outcomes decreased progressively (table 3). For example, 90 day mortality for patients who received joint replacement decreased from 1.4% in the least specialised hospitals to 0.7% in the most specialised hospitals, and rates of the composite outcome for the most specialised hospitals declined from 5.9% to 3.8% (P<0.001; table 3).

Table 3

 Outcomes in Medicare beneficiaries undergoing major joint replacement, 2001-5. Values are numbers (percentages) unless stated otherwise

View this table:

In unadjusted regression models that accounted for clustering of patients within hospitals the odds of both the composite outcome and mortality declined progressively as hospital specialisation increased (highest fifth the reference category; table 4). After adjustment for patient characteristics, comorbidity, hospital characteristics, procedure type, and procedure volume, increased specialisation continued to be associated with lower odds of the composite outcome, mortality, and each of the individual components of the composite outcome (table 4). In each of our additional sensitivity analyses the results remained similar. For example, after stratifying study hospitals into low, medium, and high volume groups, the adjusted odds of the composite outcome decreased as specialisation increased among hospitals with a similar volume of orthopaedic procedures (table 5). The best outcomes were in the most specialised high volume centres (table 5).

Table 4

 Unadjusted and adjusted odds of 90 day mortality or composite outcome and adjusted odds of individual outcomes among patients undergoing major joint replacement at progressively more specialised hospitals, with most specialised hospitals (highest fifth) as reference

View this table:
Table 5

 Adjusted odds* (95% confidence intervals) of 90 day composite outcome among patients undergoing major joint replacement at progressively more specialised hospitals, with highest volume most specialised hospital (>100 cases, top fifth) as reference

View this table:

Discussion

Hospitals with a higher degree of orthopaedic specialisation had improved orthopaedic outcomes, as measured by administrative data in patients aged 65 and older. The superior results in more specialised hospitals persisted after adjusting for differences in patient and hospital characteristics and hospital orthopaedic volume. The improved outcomes we observed in more specialised hospitals were robust to an array of sensitivity analyses, including alternative measures of hospital specialisation, assessment of an assortment of diverse orthopaedic outcomes, and alternative definitions of our study population. In aggregate, these findings suggest that hospital specialisation may be an important new metric for assessing hospital performance.

Limitations of the study

Our study has several limitations. Firstly, our analysis focused on US Medicare beneficiaries aged 65 and older who had joint replacement surgery, so our results should be extrapolated with caution to other patient populations such as younger patients and those being treated outside the United States. Given the well recognised differences between the US healthcare system and the rest of the world in both the financing and delivery of care, our results require validation using data from other countries. That being said, there is no a priori reason to assume that the benefits of specialisation that we observed would not apply outside the United States. Secondly, our analysis was done using administrative data. The use of ICD-9 codes to assess clinical status is the most notable drawback in using administrative databases to measure outcomes. ICD-9 codes may not be able to capture abnormalities detected in the laboratory or on physical examination that have important prognostic value. Coding practices as well as errors in coding may differ between individual physicians and institutions. Thus our results are subject to an array of potential biases, including differences in unmeasured severity between patients treated in more and less specialised hospitals or differences in capture of adverse outcomes across hospitals.31 Likewise, our reliance on administrative data limited our ability to assess other important measures of orthopaedic outcomes, including patient satisfaction and functional status that are not captured by administrative data. Thirdly, our study focused on the relation between orthopaedic specialisation and orthopaedic outcomes and caution should be used in generalising the relation to other types of specialisation and procedures such as paediatrics, cancer care, and cardiovascular diseases.

Finally, and perhaps most importantly, although our study suggests that greater orthopaedic specialisation is associated with improved patient outcomes, we do not examine the direction of this relation.36 It is possible that hospitals with better baseline orthopaedic performance “choose” to specialise in orthopaedics over time while avoiding other areas of care. Alternatively, it is possible that hospitals that “choose” to specialise in orthopaedics develop improved outcomes as a consequence of their specialisation.37 Another scenario is that patients who are predisposed to improved outcomes in ways that were not captured by our risk adjusted models may seek care at the more specialised hospitals. For example, wealthier or better educated patients may be expected to have better health status in both measured and unmeasured ways. If such patients choose to have surgery at more specialised hospitals, this could give the appearance of better outcomes in such hospitals when observed differences are actually due to residual confounding. We were unable to adjust for several variables that could have an impact on postoperative outcomes, including body mass index, educational attainment, and tobacco use. Likewise, although we were able to adjust for some aspects of socioeconomic status (postal code level median income) this is known to be an imperfect measure of individual patients’ socioeconomic status. Our finding that the median income of the patients in the study increased along with hospital specialisation may suggest that an unmeasured aspect of socioeconomic status is acting as a residual cofounder. Thus we can not exclude that unmeasured variables, rather than hospital specialisation, are responsible for the improved postoperative patient outcomes observed in the study. We did attempt to control for this potential relation by adding variables for both patient income and area of residence into the analysis. That said, we recognise that it is impossible to eliminate completely the risk of residual confounding.

Overview of previous studies

While many studies have shown an association between higher hospital volume and improved patient outcomes, not all have found this to be the case.7 38 This has led investigators to question whether the volume-outcome relation might differ for surgical and non-surgical conditions, whether the relation might be declining over time, and whether the observed advantage of high volume centres might be an artefact of incomplete adjustment of case mix.39

The relation between hospital specialisation and patient outcomes has received relatively little attention outside analyses focusing on the small number (<150) of physician owned specialty hospitals currently operating in the United States. These studies have found that patients treated in physician owned specialty hospitals may have 15-20% reductions in risk adjusted adverse outcomes, with a greater improvement in outcomes among specialty orthopaedic hospitals compared with specialty cardiac hospitals.16 17 19 Far fewer studies have looked at the more general relation between hospital specialisation and patient outcomes and all have focused exclusively on cardiac specialisation. One study grouped US hospitals into three strata of cardiac specialisation and then examined the relation between cardiac specialisation and outcomes after coronary artery bypass surgery.18 While the investigators found no improvement in outcomes among the more specialised group of hospitals, about 84% of the hospitals were classified as “low specialisation,” with only 1.8% of the hospitals being classified as “high specialisation.” Another study found improved outcomes for patients with ST elevation myocardial infarction treated in hospitals with a greater degree of specialisation in percutaneous coronary intervention.40 To the best of our knowledge our analysis is the first study of the relation between hospital orthopaedic specialisation and orthopaedic outcomes in a highly representative patient population.

Measurement of hospital volume, hospital specialisation, and outcomes

In interpreting our results it is important to recognise that although volume and specialisation both provide quantitative measure of a hospital’s activities, they represent fundamentally distinct measures of hospital care. Hospital volume is typically calculated as the number of specific procedures (for example, bypass surgery) carried out or patients admitted with a specific diagnosis, such as pneumonia, during a circumscribed period. Alternatively, hospital specialisation is measured as the proportion of a hospital’s total admissions during a circumscribed period that have a specific procedure (for example, hip replacement surgery) or fall into a single disease category, such as orthopaedics. While hospital volume appears to be closely correlated with hospital size (total number of beds), it does not seem that hospital specialisation is as closely correlated with hospital size. In our study, hospital specialisation was not related to the number of beds and no clear trend was observed between total Medicare admissions and degree of specialisation. Intuitively, a large hospital is more likely to have high volumes for all diagnoses and procedures, but being high volume for multiple diagnoses would tend to reduce hospital specialisation. Conversely, a small or medium sized hospital as measured by the number of beds could be highly specialised by focusing on a single disease or disease category.

Mechanisms of action for volume and specialisation leading to improved outcomes

In considering our results it is also important to reflect on how volume and specialisation might affect patient outcomes. While early studies focused on the association between higher hospital volume and improved patient outcomes, more recent studies have shown that the association between physician volume and patient outcomes is as strong if not stronger than the hospital volume effect.4 41 42 Given the limited data assessing the relation between hospital specialisation and patient outcomes, further study is required to examine the robustness of our findings for other medical diagnoses and study settings.

Despite an abundance of studies using administrative data sources to document the association between higher hospital or provider volume or specialisation and improved patient outcomes, more detailed analyses showing potential mechanisms of action are limited. We suspect that the association may reflect what is commonly described as the learning curve or “practise makes perfect.”43 44 Alternatively, we would hypothesise that hospital volume and specialisation may reflect different aspects of the experience of the entire clinical care team with a specific population of patients. However, empirical studies assessing the factors underlying the associations between volume, specialisation, and outcomes are in their infancy.12 45

Conclusions and implications

Our findings suggest that increased hospital orthopaedic specialisation is associated with improved patient outcomes. Our results require rapid and rigorous replication using data on patients with other diseases, such as cancer or cardiovascular disease, and data from other countries. If our findings were validated, these results would have significant implications for where patients might select to receive their care and the organisation of that care. Until such studies are completed, our work suggests that older patients requiring joint replacement surgery in the United States, and their physicians, should consider both the specialisation and the volume of available hospital choices.

What is already known on this topic

  • Numerous studies have shown an association between higher hospital procedural volume and improved patient outcomes

  • Recent analyses also suggest improved outcomes for patients treated in a limited number of US hospitals focusing on orthopaedic care, but it is uncertain whether such specialisation is more broadly associated with improved patient outcomes

What this study adds

  • Even small increases in orthopaedic specialisation are associated with significant improvements in patient outcomes after adjusting for both patient characteristics and hospital procedural volume

  • The possibility that unmeasured aspects of socioeconomic status or other confounding factors, rather than hospital specialisation, are responsible for the improved outcomes in specialty hospitals cannot be excluded

  • Hospital specialisation may capture different components of hospital quality of care than hospital volume

Notes

Cite this as: BMJ 2010;340:c165

Footnotes

  • Contributors: All authors conceived and designed the study, analysed and interpreted the data, drafted the article or revised it critically for important intellectual content, and gave final approval of the version to be published. TPH is guarantor.

  • Funding: MSV-S is a research scientist in the Center for Research in the Implementation of Innovative Strategies in Practice (CRIISP) at the Iowa City VA Medical Center, which is funded through the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development Service. PC is supported by a K23 career development award (RR01997201) from the National Center for Research Resources, National Institutes of Health; the Robert Wood Johnson faculty scholars programme; and R01 HL085347-01A1 from the National Heart, Lung, and Blood Institute, National Institutes of Health. The views expressed in this article are those of the authors and do not necessarily represent those of the Department of Veterans Affairs.

  • Competing interests: All authors have completed the unified competing interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare (1) no financial support for the submitted work from anyone other than their employer; (2) no financial relationships with commercial entities that might have an interest in the submitted work; (3) no spouses, partners, or children with relationships with commercial entities that might have an interest in the submitted work; and (4) no non-financial interests that may be relevant to the submitted work.

  • Ethical approval: This study was approved by the University of Iowa and Iowa City Veterans Affairs Medical Center institutional review boards.

  • Data sharing: Results for additional sensitivity analyses are available from the corresponding author at tyson-hagen{at}uiowa.edu.

This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.

References