- Gerry McCartney, specialist registrar in public health1,
- Sian Thomas, systematic reviewer2,
- Hilary Thomson, senior investigator scientist1,
- John Scott, public health librarian3,
- Val Hamilton, freelance information scientist4,
- Phil Hanlon, professor of public health5,
- David S Morrison, clinical senior lecturer in cancer epidemiology and director6,
- Lyndal Bond, professor and associate director1
- 1Medical Research Council Social and Public Health Sciences Unit, Glasgow
- 2Sandside, Isle of Graemsay, Stromness, Orkney
- 3Public Health Resource Unit, NHS Greater Glasgow and Clyde, Glasgow
- 4VRH Information Services, Aundorach House, Nethy Bridge, Highlands
- 5Section of Public Health and Health Policy, University of Glasgow, Glasgow
- 6West of Scotland Cancer Surveillance Unit, University of Glasgow, Glasgow
- Correspondence to: G McCartney
- Accepted 2 March 2010
Objective To assess the effects of major multi-sport events on health and socioeconomic determinants of health in the population of the city hosting the event.
Design Systematic review.
Data sources We searched the following sources without language restrictions for papers published between 1978 and 2008: Applied Social Science Index and Abstracts (ASSIA), British Humanities Index (BHI), Cochrane database of systematic reviews, Econlit database, Embase, Education Resources Information Center (ERIC) database, Health Management Information Consortium (HMIC) database, International Bibliography of the Social Sciences (IBSS), Medline, PreMedline, PsycINFO, Sociological Abstracts, Sportdiscus, Web of Knowledge, Worldwide Political Science Abstracts, and the grey literature.
Review methods Studies of any design that assessed the health and socioeconomic impacts of major multi-sport events on the host population were included. We excluded studies that used exclusively estimated data rather than actual data, that investigated host population support for an event or media portrayals of host cities, or that described new physical infrastructure. Studies were selected and critically appraised by two independent reviewers.
Results Fifty four studies were included. Study quality was poor, with 69% of studies using a repeat cross-sectional design and 85% of quantitative studies assessed as being below 2+ on the Health Development Agency appraisal scale, often because of a lack of comparison group. Five studies, each with a high risk of bias, reported health related outcomes, which were suicide, paediatric health service demand, presentations for asthma in children (two studies), and problems related to illicit drug use. Overall, the data did not indicate clear negative or positive health impacts of major multi-sport events on host populations. The most frequently reported outcomes were economic outcomes (18 studies). The outcomes used were similar enough to allow us to perform a narrative synthesis, but the overall impact of major multi-sport events on economic growth and employment was unclear. Two thirds of the economic studies reported increased economic growth or employment immediately after the event, but all these studies used some estimated data in their models, failed to account for opportunity costs, or examined only short term effects. Outcomes for transport were also similar enough to allow synthesis of six of the eight studies, which showed that event related interventions—including restricted car use and public transport promotion—were associated with significant short term reductions in traffic volume, congestion, or pollution in four out of five cities.
Conclusions The available evidence is not sufficient to confirm or refute expectations about the health or socioeconomic benefits for the host population of previous major multi-sport events. Future events such as the 2012 Olympic Games and Paralympic Games, or the 2014 Commonwealth Games, cannot be expected to automatically provide benefits. Until decision makers include robust, long term evaluations as part of their design and implementation of events, it is unclear how the costs of major multi-sport events can be justified in terms of benefits to the host population.
In 2012 the Olympic Games and the Paralympic Games will take place in London, and in 2014 the Commonwealth Games will be hosted by Glasgow. A major consideration in bidding to host the events in London and Glasgow was the potential for the games to generate a wide range of benefits for the population of the host city.1 2 3 4 Such purported benefits—collectively termed the “legacy”—include improvements in employment levels, the economy, housing, national and local pride, the environment, and sports provision. These outcomes represent key socioeconomic determinants of health,5 which suggests that the investment has the potential to improve health.
Detailed theories of how the legacy of hosting the games might influence health were outlined in the Department of Health’s recent review of the potential physical activity and health legacy from the London 2012 Olympic Games and Paralympic Games,6 and in the Scottish Government’s 2014 Commonwealth Games legacy consultation document.3 The likelihood of benefits arising from major sports events and the relative cost has been re-examined since, however, and the previous Olympics minister for the United Kingdom, Tessa Jowell, has said, “Had we known what we know now, would we have bid for the Olympics? Almost certainly not.”7
A large amount of research on the impact of major sports events on host populations is available,8 but this body of research has not been systematically brought together to allow decision makers to make informed judgments on the basis of the known effects and the known areas of uncertainty.9 The aim of this systematic review was to assess the impact of major sporting events (1978-2008) on the health, and the determinants of health, of the host population.
We designed the review and published a brief online protocol in March 2008.10
Data sources and searches
During February and March 2008, we searched without language restrictions the following sources for articles published between 1978 and 2008: Applied Social Science Index and Abstracts (ASSIA); British Humanities Index (BHI); Cochrane database of systematic reviews; Econlit database; Embase; Education Resources Information Center (ERIC) database; Health Management Information Consortium (HMIC) database; International Bibliography of the Social Sciences (IBSS); Medline; PreMedline; PsycINFO; Sociological Abstracts; Sportdiscus; Web of Knowledge; and Worldwide Political Science Abstracts.
An extensive search of the “grey literature” was conducted between April 2008 and October 2008 using the following resources: BUBL; Centre for Education in the Built Environment (CEBE); Chartered Institute of Housing (CHI); Copac National, Academic, and Specialist Library Catalogue; Economic and Social Research Council (ESRC) Society Today; Google; IDOX information services; Index to Theses in Great Britain and Ireland; US Department of Housing and Urban Development (HUD); Intute; Proquest Dissertations and Theses database; Royal Town Planning Institute; Sapling.info; Scirus; System for Information on Grey Literature in Europe (SIGLE); Transportation Research Information Service (TRIS); Urban Age; and WorldCat. There was no restriction on the publication date or language.
The search terms we used are detailed in web table A. The reference lists and bibliographies of all the included articles and reviews were searched by hand. A request for relevant studies was distributed using the International Society for Urban Health newsletter and UK and international email lists for health impact assessments.
Study inclusion criteria
We included studies of any design that had investigated the impact on the host population of any “one off,” international, multi-sport event focused on a single city or area that took place between January 1978 and January 2008. We did not include earlier events because of the increasing focus by host cities on the potential for legacy—rather than national showcasing—after 1978.11
We included outcomes relating to health, wellbeing, quality of life, health service use, and physical activity or functioning, and any measures of the socioeconomic determinants of health as described by Dahlgren and Whitehead,5 including access to services and transport, environment, crime, housing, demography, and cultural and economic outcomes. Studies exclusively investigating the impacts on visitors, athletes, or spectators; the host population’s support for the event; the non-host population’s opinions about the host area; media portrayals of the event; and economic impacts by using exclusively estimated data were excluded. Studies that used a mix of real and estimated data were included. Commentaries that did not present original data or analysis were not included in the review. Simple lists of construction activity related to events (for example, new stadia) were not included, although studies describing the impact of construction on any of the determinants of health (for example, access to facilities or economic growth) were included.
Study selection, assessment of study quality, and data extraction
Two reviewers independently screened all references identified by the searches before duplicates were removed. Studies that were identified as potentially relevant were then retrieved where possible and independently screened for relevance.
All retrieved studies were critically appraised independently by two reviewers. Disagreements were resolved by discussion between reviewers. The quality of all the included studies was assessed using a modified version of the Hamilton quality assessment tool (web table B).12 Models that assessed economic impact were appraised with additional questions recommended by experts, because no relevant critical appraisal framework could be identified (web table C). Some economic studies used only real time data rather than a mix of real time and estimated data. Variations in data characteristics were part of the critical appraisal tool but were not reflected adequately in the overall grading, so an indication of the studies that used only real time data is provided in the synthesis. An additional set of appraisal questions based on the approach outlined by Dixon-Woods and colleagues was used for qualitative studies (web table D).13
A modified version of the Health Development Agency guidelines was used to classify the level of evidence reported in each quantitative study (ranging from 1++ for the highest quality evidence to 4 for evidence based on expert opinion; web table E).14 The assignment of each level was on the basis of the design of the study and the risk of confounding, bias, or chance influencing the results, as determined by the critical appraisal. Those studies meeting all the critical appraisal criteria were classified as “high quality,” and those meeting the majority of criteria and with a low risk of selection bias (criterion 2 in web table B) were defined as “well conducted.”
The data were tabulated with an indication of study quality and grouped into nine broad categories according to outcome studied: health; recreation; transport and environment; crime, housing, and demography; volunteers; culture; economics; business; and tourism (tables 1⇓ and 2⇓). Where there were multiple studies with similar outcome measures, the data were synthesised narratively using Economic and Social Research Council guidelines.15 Synthesis was possible for some outcomes relating to economic growth, employment, tourism and transport. Where there were studies of varying quality, greater emphasis was put on the results of the better quality studies. A range of other diverse outcomes were reported that were not amenable to synthesis; these outcomes have been summarised narratively. The available data were not amenable to formal testing for bias across studies.
Fifty four studies met the review criteria and were included in our analysis, 25 of which were obtained from the grey literature (figure⇓). Thirty four potentially relevant studies were unobtainable (web extra 1). No systematic reviews were identified. The quality of the included studies was low and characterised by a high risk of bias: 69% of studies used a repeat cross-sectional design and 85% of quantitative studies were assessed as being below level 2+ on the Health Development Agency scale for appraisal of study quality, often because of a lack of comparison group. The level of evidence of the included individual quantitative studies was either 2+ (n=7) or 2− (n=41), whereas three of the studies from the grey literature were level 2+ and three were qualitative. A summary of the reported impacts is presented in tables 1⇑ and 2⇑, with more detailed data available in web table F.
Only one study included assessment of a direct health impact (table 1⇑).16 Shin and colleagues used a multivariate model to analyse the trends in suicide rates in Seoul, South Korea, during the 1988 Olympic Games (level 2+). They reported no change in the suicide rate.
During the 2002 Asian Games in Busan, South Korea, cars were restricted from entering the city on certain days by using car registration plate numbers as a rationing tool. One study (level 2+) reported that paediatric hospital admissions for asthma declined in the three weeks after the Busan event compared with during the games period and the three weeks before the games (relative risk (RR) 0.73, 95% confidence interval (CI) 0.49 to 1.11).17 This finding contrasted with the same period in the following year, in which hospital admissions increased compared with three weeks before and three weeks after (RR 1.78, 95% CI 1.27 to 2.48). A study reporting a similar outcome in Atlanta, GA, USA, at the time of the 1996 Olympic Games compared paediatric hospital admissions for asthma during the games period with the four weeks before and four weeks after the games.18 The authors found decreases in care events by using a variety of markers of health service use: Medicaid claims (RR 0.61, 95% CI 0.44 to 0.85), health maintenance organisation (US healthcare provider) claims (RR 0.56, 95% CI 0.31 to 1.02), data from two paediatric hospitals (admissions decreased by 11.1%), and data in the state of Georgia hospital discharge database (discharges decreased by 19.1%). The reported decrease in paediatric asthma events in Atlanta was associated with a 22.5% decrease in peak traffic counts during the Olympic Games and a 27.9% decrease in peak ozone levels in the city (P<0.001 for both compared with 4 weeks before the start of the games).
Another study of the 1996 Olympic Games reported that 263 children from outside the local catchment area were seen at Atlanta hospitals around the time of the games (13 July to 13 August).19 The mean age of these children was 6.7 years, and 24% were seen in tertiary care centres and 76% in urgent care centres. The children originated from 23 countries and had 15 primary languages. A greater proportion of these 263 children required hospital admission during the event compared with local children (27% v 13%, respectively, at the tertiary hospital and 7% v 3%, respectively, at the county hospital), and 44% of these children were uninsured.
A repeat cross-sectional study of presentations to hospital with problems induced by illicit drugs during the Olympic Games in Sydney, Australia, in 2000 and the two weeks before the games reported an increase in the mean daily number of presentations of 4.5 (from 8.8 to 13.3; P=0.04).20 Presentations peaked 24 hours after the closing ceremony (35.0 per day) and were higher at weekends (16.6 v with 9.2 during the week; P=0.001). Presentations of ecstasy related and amphetamine related problems increased during the games (daily mean of 5.1 compared with 1.7 during the two weeks before; P=0.007) but the level of heroin related presentations was unchanged (daily mean of 4.5 compared with 4.2; P=0.8). Australian residents comprised 90% of the presentations.
One study reported that overall sports participation (four or more times in the past four weeks, except walking) decreased in the Manchester area of the UK by 2% after the 2002 Commonwealth Games, and that the gap in participation rates between individuals in affluent areas and those in deprived areas widened significantly (table 1⇑).21 On the other hand, there was an upward trend in sports participation from the early 1980s until 1994 in association with the 1992 Olympic Games in Barcelona, Spain.22
A second study examining the 2002 Commonwealth Games in Manchester suggested that it was difficult to reap sports legacy gains in this case because of problems with funding and capacity, the exclusion of voluntary groups from using event branding, and a failure to retain key staff after the games. It was also suggested that the provision of new sports facilities benefited elite athletes after the event more than the host population.23 However, satisfaction with green spaces in Manchester did increase after the event (from 28% to 75%).24
The outcomes most commonly assessed in studies on the impacts of major multi-sports events were economic growth and employment (table 2⇑). Although most studies associated major multi-sports events with increased economic growth and employment, these studies often used largely estimated data, had a very short post-event data collection period, and failed to take account of the opportunity costs of hosting large events, thus limiting the validity of the overall results.24 25 26 27 28 29 30 31 32 33 34 35 36
Some of the studies with longer data collection periods, less estimated data, and more collected data described some negative growth and detrimental impacts on employment.32 37 38 Inflation increased in Barcelona31 39 and Atlanta,31 but not in Sydney,31 40 in the run up to hosting the Olympic Games. Investment in sports infrastructure in Sydney was associated with a delay in health and education capital investment.41
Two studies reported that becoming a host city for the Olympic Games was associated with higher investment, as approximated by increased stock market indices.42 43 Two qualitative studies of business development activity at the Sydney Olympic Games in 2000 found that regions that focused on the development of a long term business network to generate better networking and market access fared better than areas that focused on short term benefits from attracting visitors.44 45 Business was perceived to have benefited from the 1988 Olympic Games in Calgary, AB, Canada,46 and from business assistance offered during the 2002 Commonwealth Games in Manchester.35
Impacts on transport and the environment
Studies of five cities (Atlanta18 47; Busan17 48; Los Angeles, CA, USA49; Seattle, WA, USA 50; and Sydney51) examined the impact of transport mitigation strategies put in place during major sports events, such as restrictions on car use, increased public transport availability, promotion of car sharing, and increased working hours flexibility. A fall in air pollution was reported in two cities: Atlanta18 and Busan (level 2+).17 A lower quality study in Busan reported an increase in pollution.48 Road traffic volume decreased in Atlanta and Busan ,18 47 48 50 as did car journey time in Los Angeles and Sydney.49 51 A small study (n=12 households) reported increased aircraft noise and night time wakings around the time of the Olympic Games among residents living close to the airports in Atlanta.52
Impacts on volunteers
Three studies examined the impacts of major multi-sports events on event volunteers. They reported that volunteers at the 2002 Manchester Commonwealth Games had a mix of positive and negative experiences53; no change in their desire to volunteer in the future53 54; and no increase in sports participation.53 54 However, one study did find that volunteers at the 1994 Winter Olympic Games in Lillehammer, Norway, and the 2000 Olympic Games in Sydney perceived an increase in their skills after volunteering.55
Demand for police services in Atlanta increased and recorded crime decreased during the 1996 Olympic Games (level 2+).56 Reported vandalism decreased after the 2002 Commonwealth Games in Manchester, whereas satisfaction with the local area, housing, and supermarket access increased.24 There was consistent evidence from four Olympic cities (Barcelona, Atlanta, Sydney, and Athens) that house prices rose in host cities in comparison with other areas of the host country.31 39 57
It has been suggested that the Calgary Winter Olympics in 1988 were associated with depopulation in the immediate area next to the games venues,58 but another study has reported increased migration to the wider host area for all north American Olympic events.32 In Atlanta, a new “urban camping” law was reported to have been used at the time of the Olympic Games to move homeless people away from the games environs.59
A study of the Olympic Games in Sydney in 2000 reported data suggesting that hosting the games was associated with centralisation of decision making and a loss of local democracy.60 However, another study described enhanced community spirit and national pride following the games.61
Values among residents of the host country were found not to have changed after the 1994 Winter Olympics in Lillehammer.62 There was a reported decline in Catalan identification following the 1994 Barcelona Olympic Games, in contrast to increasing regional identification in other areas of Spain.63
The number of tourists visiting Lillehammer,64 65 Atlanta,31 Seoul,66 and Barcelona39 increased during the respective Olympic or Winter Olympic Games. On the other hand, the number of tourists visiting Calgary during the 1988 Winter Olympic Games was largely unchanged,65 and the number visiting Manchester during the 2002 Commonwealth Games decreased.67 The impact of the Olympic Games on tourist visits to Sydney in 2000 was mixed.38 68 Hotel occupancy rates during the Olympic Games decreased in Barcelona39 and increased in Atlanta.69
There is little evidence that major multi-sport events held between 1978 and 2008 delivered health or socioeconomic benefits for the population of the host country. The evidence addressing each outcome comprises a relatively small number of poor quality studies, and there are large gaps in the range of outcomes evaluated, particularly with respect to health outcomes. Restrictions on use of cars and promotion of public transport during events may be followed by reductions in air pollution, and this relation may in turn be associated with a drop in hospital admissions for childhood asthma. The evidence also suggests that economic growth and unemployment may both be associated with events, but findings from the economic evaluations that used high quality data (that is, non-estimated data) contradict this.
Both the commissioning of studies and their publication could well be biased towards positive results. Given this fact and our review’s extensive coverage of the published and unpublished literature, it is unlikely that we could have overlooked a large positive effect of major multi-sport events on health or on socioeconomic determinants of health. The available evidence does not refute expectations of a legacy, positive or negative, but it does establish that very little is known about the impacts of previous large multi-sport events and, therefore, the possible impacts of future events. This contrasts with official documentation used recently to promote such events.1 2
The potential impacts of major multi-sport events are multiple and encompass changes in health and in many of the socioeconomic determinants of health. In our analysis, however, no particular impact had a consistent pattern on outcomes across different events, nor was there evidence of a positive impact across a range of outcomes in any single event. A number of opinion articles have suggested other impacts for which we could find no evidence, including community regeneration, gentrification, and rising inequalities.9 40 70 71 72 73 74 75 These outcomes are not well researched, and no conclusion can be drawn from this review about whether such outcomes are likely to be associated with future events.
The quantity of evidence available for the review varied between events, with the more recent north American and Australian events researched most extensively. Also, the emphasis of event organisers changed from 1978 through to 2008, with later events focusing on regeneration and the creation of a positive legacy in the host city, in contrast to earlier events’ focus on entertainment and showcasing the city.40 This disparity limits our ability to generalise the impacts of the earlier events to contemporary events because the nature of the expected impact seems to have changed.
Strengths and limitations of study
The strength of our review is the broad range of outcomes assessed, which included health outcomes and the socioeconomic determinants of health. In addition, extensive attempts were made to identify both published and unpublished studies and to include a wide range of study designs, including economic models.
One limitation of our study is that we could not access several of the relevant studies identified. Of the 255 references identified, 34 could not be obtained for screening and appraisal (web extra 1). We could either not identify an institution holding the research or the institution (or author) was unable to provide access. Most of these studies were not peer reviewed studies and the quality was, therefore, likely to have been low. Although 34 represents a frustratingly large number of unobtainable studies, the extensive international search strategy we used is still justified on the basis of the number of additional studies we were able to include that would otherwise have been missed.
Decision makers should consider taking a different approach to the implementation of future events if the cost is to be justified by benefits to the population of the host country. Such approaches might include increasing democratic control of event related spending (for example, channelling funding through existing elected bodies), recasting the events as less costly and simpler sports events, or using impact assessment approaches to optimise the effects of the event “intervention.”
Knowledge of the impacts of major multi-sport events might improve if evaluations of future events are based on a framework that details a “theory of change” for the event.76 Improved reporting of evaluations, use of suitable contemporaneous comparison groups (ideally within longitudinal studies), and inclusion of long term outcomes would all be likely to increase the quality of future evidence. Economic studies in particular would be improved if they used real time data instead of estimates and incorporated opportunity costs in their models.
The cost of hosting a major multi-sport event such as the Olympic Games or the Commonwealth Games has increased over the past two decades, to the extent that it has become difficult to justify the expenditure on the basis of entertainment or national showcasing alone.7 Cities competing to host events are now judged on the prospect of a long term positive legacy being generated for the host population, among other factors.
Our review found insufficient evidence to confirm or refute expectations about the health or socioeconomic benefits for the host population of previous major multi-sport events. Benefits from future events—such as the 2012 Olympic Games and Paralympic Games in London or the 2014 Commonwealth Games in Glasgow—cannot be expected to occur automatically. There is a lack of evidence on the impacts of major multi-sport events on the host population, and until decision makers include robust, long term evaluations as part of their design and implementation of events, it is unclear how the costs can be justified in terms of host population benefits.
What is already known on this topic
Cities hosting major multi-sport events are under increasing pressure to justify expenditure by creating a positive legacy for the host population; for example, in terms of improvements in employment levels, health, and the economy
No attempts have been made to bring together the large amount of research on the impact of major multi-sport events on host populations
What this study adds
There is little or no evidence that major multi-sport events held between 1978 and 2008 had positive impacts on the populations of cities that hosted these events
A positive health or socioeconomic benefit for the host population cannot be expected from future major multi-sport events
How the impacts of events are evaluated needs to improve to allow decision makers pitching for future events to make informed judgments on the basis of known effects and known areas of uncertainty
Cite this as: BMJ 2010;340:c2369
Contributors: Sally Macintyre had the original idea for the review. GMcC, ST, and HT designed and planned the review. GMcC was the lead reviewer and ST was a co-reviewer. Both reviewers undertook study selection and appraisal, and data extraction and tabulation. HT provided advice on each aspect of the review methods. GMcC, ST, HT, JS, PH, DSM, and LB formed a review advisory group. JS and GMcC were responsible for searching the grey literature, and VH was responsible for database searching. Mary Robins, the staff at Glasgow University Library, and the staff of the Public Health Resource Unit library at NHS Greater Glasgow and Clyde assisted in the retrieval of articles. Adam Brown and Susie Palmer provided additional grey literature. Nigel Rice and Ken Gibb gave advice on the appraisal of economic studies. Erik Lenguerrand and Elena Sautkina assisted with translation of foreign language articles. GMcC, ST, and HT synthesised the data, and GMcC wrote the manuscript. All the authors critically revised the manuscript and approved the final version. The views expressed here are those of the authors and do not necessarily reflect the views of the Medical Research Council, the Chief Scientist Office at the Scottish Government Health Directorate, the University of Glasgow, or the NHS. GMcC is the guarantor.
Funding: GMcC, ST, HT, VH, and LB were funded by the Chief Scientist Office at the Scottish Government Health Directorate as part of the Evaluating Social Interventions programme at the Medical Research Council Social and Public Health Science Unit (wbs U.1300.00.002.00024.01). JS works as part of the Public Health Resource Unit at NHS Greater Glasgow and Clyde. PH and DSM are funded by the University of Glasgow. DSM is also partially funded by NHS Greater Glasgow and Clyde. This study was not commissioned and no project specific funding was received. The funders had no role in the study design; data collection, analysis, and interpretation; writing the manuscript; or the decision to submit the research for publication.
Competing interests: GMcC is a member of the Scottish Socialist Party and was previously involved in a project to have a velodrome built in the west of Scotland. All authors have completed the Unified Competing Interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: (1) No financial support for the submitted work from anyone other than their employer; (2) No financial relationships with commercial entities that might have an interest in the submitted work; (3) No spouses, partners, or children with relationships with commercial entities that might have an interest in the submitted work; (4) No non-financial interests that may be relevant to the submitted work.
Ethics approval: No ethics approval was required for this study.
Data sharing:No additional data available.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.