Papers

Evacuation decisions in a chemical air pollution incident: cross sectional survey

BMJ 2005; 330 doi: https://doi.org/10.1136/bmj.330.7506.1471 (Published 23 June 2005) Cite this as: BMJ 2005;330:1471
  1. S Kinra, lecturer in epidemiology and public health medicine (Sanjay.Kinra{at}bristol.ac.uk)1,
  2. G Lewendon, consultant in public health medicine2,
  3. R Nelder, public health information specialist2,
  4. N Herriott, environmental epidemiologist3,
  5. R Mohan, research engineer3,
  6. M Hort, research scientist4,
  7. S Harrison, consultant in communicable disease control5,
  8. V Murray, professor3
  1. 1 Department of Social Medicine, University of Bristol, Bristol BS8 2PR
  2. 2 Public Health Development Unit, Plymouth Teaching Primary Care Trust, Plymouth PL1 2AD
  3. 3 Chemical Hazards Unit, Health Protection Agency, Guy's and St Thomas' Hospital Trust, London SE14 5ER
  4. 4 Met Office, Exeter EX1 3PB
  5. 5 Southwest Peninsula Health Protection Unit, Devon Team, Dartington TQ9 6JE
  1. Correspondence to: S Kinra
  • Accepted 19 April 2005

Abstract

Objective To compare the health outcomes in sheltered and evacuated populations after a chemical incident in a plastics factory.

Design Cross sectional survey.

Setting Urban area in southwest England.

Participants 1750 residents from the area exposed to the chemical smoke, of which 472 were evacuated and the remaining 1278 were advised to shelter indoors.

Main outcome measure Number of adverse health symptoms. A case was defined by the presence of four or more symptoms.

Main results 1096 residents (63%; 299 evacuated, 797 sheltered) provided data for analyses. The mean symptom score and proportion of cases were higher in evacuated people than in the sheltered population (evacuated: symptom score 1.9, cases 19.7% (n = 59); sheltered: symptom score 1.0, cases 9.5% (n = 76); P < 0.001 for both). The difference between the two groups attenuated markedly at the end of two weeks from the start of the incident. The two main modifiable risk factors for the odds of becoming a case were evacuation (odds ratio 2.5, 95% confidence interval 1.7 to 3.8) and direct exposure to smoke for more than two hours on the first day of the incident (2.0, 1.7 to 2.3). The distance of residence from the factory or level of exposure before intervention (first six hours) had little effect on the odds of a person becoming a case.

Conclusions Sheltering may have been a better protective action than evacuation in this chemical incident, which is consistent with the prevailing expert view. Although this study has limitations, it is based on a real event. Evacuations carry their own risks and resource implications; increased awareness may help to reduce unnecessary evacuations in the future.

Introduction

The accidental release of toxic chemicals into the community may pose acute and long term health hazards (possibly including cancers, congenital malformations, and psychosomatic illnesses) and lead to tremendous public anxiety.13 In the event of such a chemical incident, where the public may be exposed to a cloud of toxic vapour, two options of protective action exist—sheltering or evacuation. The prevailing expert view for public health protection in chemical air pollution incidents is to shelter rather than evacuate the exposed population.47 However, this is based largely on experimental and modelling data, and we found no comparative data from actual incidents.

A fire started in a factory manufacturing plastic goods in southwest England. The factory was situated on an industrial estate adjoining a large urban residential area. The initial response of the emergency services was to start evacuating residents from their homes to a nearby leisure centre. This decision was subsequently reviewed by the members of the emergency response team, and further evacuation was stopped, with residents advised to shelter and stay inside their homes. The resultant partial evacuation offered an opportunity to compare the relative health protection offered by these two modes of intervention. We therefore carried out a cross sectional postal questionnaire survey on residents in the affected area and compared the health outcomes among the people evacuated (one third) and sheltered (two thirds).

Methods

We produced a health questionnaire that was administered to all people living in the area that was exposed to the chemical smoke (evacuated 472, sheltered 1278).

Questionnaire

We modified the questionnaire from model questionnaires produced by the Chemical Incident Response Service (Guy's and St Thomas' Hospital, London) and National Focus for Chemical Incidents (Department of Health, Cardiff). The questions related to demographic factors; places of residence over the 48 hour period after the incident; time spent outdoors; and likely symptoms of ill health and existing health status, such as medical conditions and smoking habits. We asked respondents to report health symptoms if they had occurred at all and if they persisted at the time of completion of the questionnaire (persistent symptoms). The questionnaire went out at the end of the first week of the incident, and a reminder was delivered at six weeks through an article in the local newspaper. A repeat questionnaire with a reminder went to people who had not replied at two months.

Defining exposure and outcome

We identified the exposed population on the map by drawing a semicircular arc from the incident site in the direction of the greatest density of smoke, which we established by chemical meteorological data. Where the arc intercepted small streets, we either included or excluded the whole street, whichever the greater proportion. The maximum distance from the factory that was permissible for inclusion in the study was 1000 metres.

Since we did not have any direct measures of individual exposure we used two proxy measures: distance of the place of residence from the factory and an objective measure of relative exposure at each of the places where the respondents stayed. We used easting (distance east) and northing (distance north) grid references for each postcode including the factory, to calculate the distances in straight lines (in metres) by using a formula based on the Pythagoras theorem. For the objective exposure, the Met Office undertook atmospheric dispersion modelling, using the Numerical Atmospheric dispersion Modelling Environment (NAME III).8 We used real time meteorological data from the nearby meteorological station to run the model to predict relative concentrations of pollutants over the 48 hour duration of the incident. We swapped the relative concentrations of pollutants at each of the postcodes on the geographical information system ArcView, version 3.0 (ESRI, Redlands, California, USA) for two time frames (the initial six hours and 48 hours); six hours being the median time to evacuation.

For our analyses, we considered the exposure score for the initial six hours as the primary exposure, since it represents the actual exposure before the intervention, on which the decision was based. We also calculated a cumulative exposure score over 48 hours by adding exposures over time spent by the participant at each of the postcodes. Of the people who were evacuated, roughly two thirds went to the designated evacuation site (leisure centre), and the remaining third went to other convenient places, such as homes of friends and family. We asked people who were evacuated to provide the address and postcode of the place where they stayed, if different from the leisure centre, and substituted these postcodes accordingly. If the evacuation postcode was also in the exposed area then we used the exposure score for that postcode; otherwise they were given a null value. The cumulative, 48 hour exposure score is difficult to interpret as it constitutes an inherent element of intervention, in addition to the participants being generally indoors (and so not necessarily exposed to that level of pollutants in the environment).

Acute symptoms produced by chemical smoke exposure are generally similar to those caused by common viral respiratory illnesses. Because of this lack of specificity of symptoms, we decided to define cases on the basis of number of symptoms. We established baseline prevalence of symptoms for the period (winter) by simultaneously administering the questionnaire to a random 10% sample (n = 1000) of residents from a neighbouring town with a similar demographic and socioeconomic profile. We calculated the mean symptom score (total number of symptoms per person) for the residents of the unexposed town and regarded all those with a symptom score greater than 2 standard deviations of the mean as cases. We defined persistent cases similarly, but with symptoms persisting at the time of completing the questionnaire (which was at least two weeks from the time of the incident). The symptoms considered were runny eyes, swollen eyelids, sore throat or nose, shortness of breath, cough, skin rash, skin burns, nausea, vomiting, abdominal pain, diarrhoea, fever, wheezing or asthma, palpitations, headache, lightheadedness, and blurred vision. We gave each symptom an equal weighting of one (present) or zero (absent).

Data from environmental sampling and healthcare services

Environmental samples, based on the expected emissions, were taken repeatedly over a 48 hour period. Among the gaseous emissions, samples we tested for included hydrogen chloride, hydrogen cyanide, hydrogen fluoride, isocyanides, and styrene. We used chemical tubes (Draeger, Aqua Air Industries, Louisiana, US) to carry out these tests. The first air testing started some 12 hours after onset of the fire, inside and immediately outside the burning factory, in dense acrid smoke, and 100 metres downwind within the smoke plume. Other environmental investigations included tests for acidity of surface water; asbestos fibre counts in air and on hard surfaces; and levels of dioxins and furans in soil, grass, debris, and water samples. We collected information about health effects from people seeking medical help as a result of exposure. We collected information from all relevant sources of medical advice including ambulance and emergency departments as well as the local general practitioners and telephone helplines.

Fig 1
Fig 1

Flow of participants through the study

Statistical analysis

We used multiple logistic regression to estimate the likelihood of a person becoming a case for each of the independent risk factors. We used Stata, version 8 (StataCorp, College Station, Texas, USA), for our analyses.

Results

We received 1096 (63%) completed questionnaires from the exposed residents; four respondents sent back unfilled questionnaires to say that they were away at the time, and we excluded these from further analyses. The respondents were older and the proportion of female respondents was higher than among the non-respondents (respondents: median age 49 years, 53% female; non-respondents: median age 33 years, 46% female).

Fig 2
Fig 2

Location of residences by initial six hour exposure

Of the people who received questionnaires in the adjacent unexposed town, 334 (33%) replied. The mean symptom score was 0.48 (SD 1.41). On the basis of this, we regarded all those with four or more symptoms as cases for the purposes of this study (case definition: greater than 2 standard deviations of the mean in unexposed area).

In the exposed area, the response rate (63%; respondents: 299 evacuated and 797 sheltered) and median response time (42 days; range: 1-66 days evacuated and 2-65 days sheltered) among the evacuated and sheltered populations were identical (fig 1). Figure 2 shows the location of the postcodes of residence of the sheltered and evacuated respondents in relation to the density and direction of smoke plume during the initial six hours. The figure and the calculated median distance from the factory (evacuated homes: 565 metres; sheltered homes: 572 metres; range for both: 217-791 metres) show that the evacuated and sheltered residents were similarly exposed to the smoke plume. Table 1 shows the characteristics of the evacuated and sheltered respondents. Multivariate analysis showed that evacuation and direct exposure to smoke on the first day of the incident were the two main modifiable risk factors for the odds of becoming a case, while the actual distance of residence from the factory or the exposure before the intervention (initial six hours) seemed to be of little importance (table 2).

Table 1

Characteristics of residents exposed to the chemical smoke. Values are numbers (proportions) of subjects unless otherwise indicated

View this table:
Table 2

Best model (R2=0.15) for odds of becoming a case

View this table:

Of the people who had been evacuated, 195 went to the designated site (leisure centre) and 104 (35%) to other places, such as homes of friends and family. Of those who evacuated to other sites, 73 people provided accurate addresses, and for these we used appropriate exposure scores (zero for 23 people who went out of area); for the remaining 31 people we could not calculate the 48 hour exposure. The mean 48 hour exposure score (based on slightly fewer subjects, n = 1065) was similarly higher for the sheltered residents (evacuated 0.01 (SD 0.03) g/m3 v sheltered 0.04 (0.11) g/m3; P < 0.001), and contributed little to the odds of a person becoming a case (crude odds ratio 0.99, 95% confidence interval 0.99 to 1.00); unchanged after adjustment for all other variables in table 2; fig 3).

Fig 3
Fig 3

Location of residences by 48 hour exposure

Environmental sampling

The first air testing carried out 12 hours after the start of the incident, inside and immediately outside the burning factory, in dense acrid smoke showed the maximum concentration of 5 parts per million of hydrochloric acid. Concentrations of other gases tested were less than 1 part per million. Tests 100 metres downwind within the smoke plume detected 1 part per million of hydrochloric acid and other gases below detection levels. Further tests carried out at various distances and timings over the next two days found readings below detection levels. Tests for the pH carried out on puddle water in the area showed neutral readings. Counts for airborne asbestos fibres and other bulk and swab samples did not show any evidence of asbestos. Samples tested for dioxins and furans showed concentrations at or below those expected under normal circumstances.

Health effects identified from people seeking medical help as a result of the exposure

Information available from medical inquiries included emergency services personnel (n = 31) and local residents (n = 23). The symptoms described were consistent with the mild symptoms described above, such as sore throat, cough, runny eyes, and skin irritation. Two people were admitted to hospital, one for acute attack of bronchial asthma and the other for suspected angina. Both had been evacuated and were admitted at the time of evacuation.

Discussion

In two groups of residents similarly exposed to smoke plume from a chemical incident, evacuation did not confer any additional health benefit over sheltering. If anything, evacuated residents seemed to have more ill health effects soon after the incident than sheltered residents, although the difference did not seem to persist beyond two weeks. Although our study has limitations, it is a comparative study that is based on a real incident. The results reinforce the prevailing expert view that favours sheltering over evacuation as a response to protect populations exposed to chemical air pollution incidents. Evacuations carry their own risks and resource implications; increased awareness may help to reduce unnecessary evacuations in the future.

Limitations of the study

The study has some limitations. An important concern is that the level and nature of smoke exposure could have been different between the evacuated and sheltered groups of residents. We have tried to estimate the exposure in two different ways: distance of the residence from the factory and atmospheric dispersion modelling of the pollutants by using the NAME III model. This model was originally designed for dispersion modelling of radioactive material, but it can also be used to model dispersion of chemicals in the atmosphere.8 Dispersion modelling of this type has some uncertainties—for example, we had no information about thermal buoyancy of the plume or the exact nature of the pollutants released. The NAME model, however, is widely used for dispersion modelling, and, given the closeness of the meteorological station, the results would be expected to be of reasonable accuracy.8 This type of work represents an improvement on standard methods of assessing exposure, such as simply using distance as a proxy for exposure.911

Self reported symptoms in the people who had been evacuated could be the result of a combination of physical effects of the smoke and the psychological impact of evacuation.12 13 We did not include any instruments to assess the psychological impact of the incident and so were unable to separate the two. However, self reported symptoms could be considered appropriate in this context where the perception of ill health is as relevant as physical ill health itself, especially with regards to long term psychological impact and anxiety. This study has looked at early health outcomes only, which may differ from long term health outcomes. Clustering of the responses and health effects among members of the same household is a limitation of this study, but we did not have the required data to incorporate in the analyses. Results, in one previous study that accounted for clustering, remained largely unaltered.10

Comparison with other studies

No other comparative studies are available to which we could relate our findings. Previous studies looking at the health effects of chemical incidents have entailed either sheltering or evacuation.10 11 1416 In one previous study of a fire in a plastics factory, the residents were advised to shelter and did not report any serious side effects.14 The theoretical basis for expert advice favouring sheltering over evacuation is that protection offered by barriers between the exposure and the population is at least as effective as the protection offered by increasing the distance between the exposure and the population—that is, evacuation. Evacuations generally entail taking the population out of the barrier zone and moving them through a much higher exposure, albeit for a shorter duration. Our results show that direct exposure to smoke is a more important determinant of ill health than the cumulative exposure to smoke and these results are consistent with those reported from other studies.6 11

What is already known on this topic

Populations exposed to chemical air pollution incidents are often evacuated by the emergency services as a means to safeguarding their health

Expert guidance favours sheltering indoors over evacuation as the emergency response; however, this advice is based on experimental and modelling data, and no comparative data from actual incidents exist

The lack of a good evidence base may be undermining adherence to expert guidance

What this study adds

Sheltering may have been a better protective action than evacuation in this chemical incident, which is consistent with the prevailing expert view

Evacuations carry their own risks and resource implications

Increased awareness may help to reduce unnecessary evacuations in the future

Reasons for evacuation

Despite the expert guidance, an unacceptably high proportion of chemical incidents worldwide result in evacuations. Possible reasons for these include an instinctive response on the behalf of emergency services to evacuate populations in danger, and the preference to “play it safe” by first responders.6 Initial decisions are often taken under very stressful conditions that do not allow time for reflection. Lack of experience has also been proposed as a possible reason since greater frequency of evacuations is reported from areas where chemical incidents are uncommon.17 Another common factor is the delay in getting appropriate public and environmental health advice.

Conclusion

Sheltering may have been a better protective action than evacuation in this chemical incident. Although our study has several limitations, it is based on a real event. These results are consistent with the expert view that favours sheltering as the mode of action in serious chemical air pollution incidents. Evacuations carry their own risks and resource implications. Increased awareness among emergency services may help to reduce unnecessary evacuations in the future.

Acknowledgments

We thank the participants in this study for taking the time to complete the questionnaires. We also appreciate the help provided by Geoff Chamings and Shaun Carter at Devon County Council, who converted the postcode references into distance between the factory and the residences.

Footnotes

  • Contributors SK, GL, RN, SH, and VM were involved in the conduct of the study. NH, RM, and MH produced the exposure data and maps. SK analysed the data and wrote the first draft of the paper. All authors contributed to the final manuscript. SK is the guarantor.

  • Competing interests None declared.

  • Funding None.

  • Ethical approval Not required at the time. The study was carried out in 1999, when ethics approval was not considered an issue for such studies conducted by health agencies as part of their responsibility.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
View Abstract