Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
J Bryan Sexton a University of Texas Human Factors Research
Project, 1609 Shoal Creek Boulevard, Austin, Texas 78701, USA, b Department of Medicine, Division of
General Internal Medicine and Section for Clinical Epidemiology,
Houston Medical School, University of Texas, 6431 Fannin, Houston,
Texas 77030, USA
Correspondence to: J B Sexton sexton{at}psy.utexas.edu
| |
Abstract |
|---|
|
|
|---|
Objectives::
To survey operating theatre and intensive care unit staff about attitudes concerning error, stress, and teamwork
and to compare these attitudes with those of airline cockpit crew.
Population based research suggests that in the United States
between 44 000 and 98 000 patients die each year from preventable errors, making medical error the eighth most common cause of
death.1-3 Research in safety critical industries tells us
that to overcome this problem we must understand the system used to
deliver care.
4 5
Adoption of a systems approach to improvement means acknowledging the
limitations of technological solutions. Other components of healthcare
delivery systems, such as professional and organisational cultural
factors (for example, denial of vulnerability to stress) and
interpersonal aspects of performance (for example, lack of teamwork
within and between disciplines), therefore also need to be studied to
increase the understanding of and prevent errors.6 One of
the better established (yet often overlooked) findings in stress
research is that as stress or arousal increases, an individual's
thought processes and breadth of attention narrow.
7 8
Poor teamwork and communication have been documented during trauma resuscitation,
9 10
surgical
procedures,
11 12
and treatment of patients in intensive
care units.13 One systems approach to medical error has
led to the development of simulators to study and improve teamwork for
surgical and trauma resuscitation teams.14-16 Further
research is needed to tailor such training to the specific needs of
individual organisations.
The airline industry has used surveys to collect data on pilot
attitudes about safety and interpersonal interactions to diagnose strengths and weaknesses and to aid in the development of
interventions. Individuals' attitudes (as opposed to personalities)
are relatively malleable to training interventions17 and
predict performance.18 A successful intervention called
crew resource management training has been developed to address
specific attitudes, change related behaviour, and improve performance
of the cockpit crew.19 Correspondingly, attitudes about
errors, teamwork, and the effect of stress and fatigue on performance
could be prime targets for measurement and improvement in medicine.
Surveys are an inexpensive method of data collection that points to
interventions and fit well with the systems approach since they elicit
(on a large scale) what caregivers actually think.
For the past 20 years, the University of Texas human factors research
project has been investigating teams at work in safety critical
environments such as aviation, space, maritime, and medicine. In this
paper, we present recent data comparing attitudes about error, stress,
and teamwork among healthcare workers and airline cockpit crew members.
We also present error related perceptions of intensive care doctors and
nurses. Aviation data are presented to serve as a point of reference
from another safety critical domain.
The survey items presented tap into attitudes toward stress, hierarchy,
teamwork, and error. Previous research has found that these items are
relevant to understanding error,20 predictive of
performance,18 and sensitive to training
interventions.
17 21 22
Attitudes regarding the
recognition of stressor effects indicate the degree to which
individuals will place themselves in error inducing conditions, and
items regarding hierarchy and teamwork indicate the abilities of team
members to manage both threats and errors in a team environment.
We used four questionnaires to survey participants. The cockpit
management attitudes questionnaire has been widely used in aviation and
was developed to measure attitudes toward stress, status hierarchies,
leadership, and interpersonal interaction issues.23 The
questionnaire is reliable, sensitive to change,22 and the
elicited attitudes have been shown to predict
performance.
18 24
A subsequent version, the flight
management attitudes questionnaire,25 was developed to
broaden the perspective of the instrument to include the effect of
organisational climate and national culture on safety.
Two medical surveys have also been developed as part of an extension of
human factors research into medical environments: the operating room
management attitudes questionnaire11 and the intensive
care unit management attitudes questionnaire, which is reported here
for the first time. All the questionnaires contained a core set of 23 items from the cockpit management attitudes questionnaire with minor
modification of wording to match the work environment All surveys were administered through hospital or airline internal mail
(with parallel covering letters). Respondents were given the option of
returning their questionnaires in an anonymous drop box or a stamped
envelope addressed to our laboratory in Austin, Texas. In each
administration, the survey content was essentially the same.
The core items have been administered to cockpit crew members (captains
and first and second officers) from 40 different airlines in 25 countries over 15 years (with the flight management attitudes questionnaire used in the past seven years). The operating room questionnaire was completed by theatre staff (surgical and anaesthetic consultants, nurses, and residents) from 12 urban teaching and non-teaching hospitals in Italy, Germany, Switzerland, Israel, and the
United States in the past three years. The intensive care data are from
staff in one large urban teaching hospital in the United States. The
respondents were intensive care physicians (adult and child pulmonary
physicians, cardiologists, and neonatologists) and nurses (registered
nurses, licensed vocational nurses).
Statistical analysis
The flight management questionnaire and cockpit management
questionnaire were returned by over 30 000 pilots, with response rates
ranging from 15% to over 90% (average 45%). The operating room
questionnaire was returned by 851 staff (response rate 40% to 100%)
and the intensive care questionnaire by 182 staff (response rate 59%).
In an effort to make the medical and aviation samples roughly
equivalent, pilot data from Latin America and Asia, which were not
sampled in medicine, were not included.
Perceptions of stress and fatigue
Design::
Cross sectional surveys.
Setting::
Urban teaching and non-teaching hospitals in
the United States, Israel, Germany, Switzerland, and Italy. Major
airlines around the world.
Participants::
1033 doctors, nurses, fellows, and
residents working in operating theatres and intensive care units and
over 30 000 cockpit crew members (captains, first officers, and second officers).
Main outcome measures::
Perceptions of error, stress,
and teamwork.
Results::
Pilots were least likely to deny the effects of fatigue on performance (26% v 70% of consultant
surgeons and 47% of consultant anaesthetists). Most pilots (97%) and
intensive care staff (94%) rejected steep hierarchies (in which senior
team members are not open to input from junior members), but only 55% of consultant surgeons rejected such hierarchies. High levels of
teamwork with consultant surgeons were reported by 73% of surgical residents, 64% of consultant surgeons, 39% of anaesthesia
consultants, 28% of surgical nurses, 25% of anaesthetic nurses, and
10% of anaesthetic residents. Only a third of staff reported that
errors are handled appropriately at their hospital. A third of
intensive care staff did not acknowledge that they make errors. Over
half of intensive care staff reported that they find it difficult to discuss mistakes.
Conclusions::
Medical staff reported that error is
important but difficult to discuss and not handled well in their
hospital. Barriers to discussing error are more important since medical staff seem to deny the effect of stress and fatigue on performance. Further problems include differing perceptions of teamwork among team
members and reluctance of senior theatre staff to accept input from
junior members.
![]()
Introduction
Top
Abstract
Introduction
Participants and methods
Results
Discussion
References
![]()
Participants and methods
Top
Abstract
Introduction
Participants and methods
Results
Discussion
References
for example,
"Junior cockpit crew members should not question the decisions made
by senior cockpit crew members" was changed to "Junior operating
room team members should not question the decisions made by senior team
members." These core items allow comparisons to be made over time,
across different organisations, across positions within an organisation
(such as nurses and doctors), and between disciplines. We report here
results of the core items as well as a set of error related items
specific to the intensive care questionnaire.
Data from each of the surveys were merged into a combined database
of operating theatre, intensive care, and flight crews. Data from each
of the staff positions were collapsed across all hospitals with
representative samples. We excluded two hospitals from the analyses
because they did not provide representative samples. We have presented
descriptive data, as the sample size is not large enough for multilevel modelling.
![]()
Results
Top
Abstract
Introduction
Participants and methods
Results
Discussion
References
In response to the item, "Even when fatigued, I perform
effectively during critical times," 60% of all medical respondents
agreed, ranging from 70% among consultant surgeons to 47% among
consultant anaesthetists (table). The rate of agreement was much higher
in medicine than in aviation (26% of pilots agreed). As there were no
differences between captains, first officers, and second officers the
data are not presented separately.
Attitudes to teamwork and hierarchy
Seventy per cent of respondents did not agree that junior team
members should not question the decisions made by senior team members,
but there were differences with position and discipline (table).
Consultant surgeons were least likely to advocate flat hierarchies
(55%). By contrast, 94% of cockpit and intensive care staff advocated
flat hierarchies.
Differing perspectives of teamwork in medicine
The different perspectives on teamwork among medical staff were
shown by the responses to the item "Rate the quality of teamwork and
communication or cooperation with consultant surgeons" (fig 1). In
particular, surgical consultants and residents rated the teamwork they
experienced with other consultant surgeons the highest (64% (29/45)
and 73% (40-55) reported high levels of teamwork; 7% (3/45) and 9%
(5/55) reported low levels), while anaesthesia residents, anaesthesia
nurses, and surgical nurses rated interactions with consultant surgeons
lowest (10% (8/77), 26% (36/141), and 28% (35/124) reported high
levels of teamwork; 39% (48/124), 43% (33/77), and 48% (67/141)
reported low levels). At the aggregate level, 62% (146/135) of
surgical staff rated teamwork with anaesthesia staff highly, and 41%
(106/250) of anaesthesia staff rated teamwork with surgical staff
highly. In other words, surgery generally reports good teamwork with
anaesthesia, but anaesthesia staff do not necessarily hold a reciprocal
perception.
|
Attitudes about error and safety
Over 94% of intensive care staff disagreed with the statement
"Errors committed during patient management are not important, as
long as the patient improves." A further 90% believed that "a
confidential reporting system that documents medical errors is
important for patient safety." Over 80% of intensive care staff
reported that the culture in their unit makes it easy to ask questions
when there is something they don't understand (this is undoubtedly
related to the high endorsement of flat hierarchies in the unit). One
out of three intensive care respondents did not acknowledge that they
make errors. Over half report that decision making should include more
team member input.
| |
Discussion |
|---|
|
|
|---|
Historically, medical and aviation workers have been expected to function without error. 6 26 27 In aviation, perceptions of fatigue, stress, and error continue to be topics of training and targets for improvement. Much progress has been made to create a culture in aviation that deals effectively with error, whereas in medicine substantial pressures still exist to cover up mistakes, thereby overlooking opportunities for improvement. We found that susceptibility to error is not universally acknowledged by medical staff, and many report that error is not handled appropriately in their hospital.
Medical staff also play down the effects of stress and fatigue. The
denial of stress and its effects on performance may help individuals
adapt to medical school and residency, but a healthy recognition of
stressor effects reduces the likelihood of error20 and
increases the use of threat and error management strategies. For
instance, tired pilots who acknowledge their own limitations manage
their fatigue by saying that they are tired, asking other crew members
to keep an eye on them, increasing caffeine intake, and reallocating
workload as necessary during the flight. Many tragedies, such
as flying accidents, military defeats, and recent incidents on the
space station MIR, are linked to the failure of individuals to perform
appropriate well rehearsed actions under stress.28
Research in aviation shows that individuals can be trained to recognise
stress as an error inducer
for example, by crew resource management
training21
and continue to improve with recurrent
training.29
Measuring teamwork attitudes and behaviour
Ratings of teamwork and communication differed substantially among
groups of respondents. The perception of poor teamwork by one team
member, whether actual or perceived, is enough to change the dynamics
within that team, causing that team member to withdraw. Preliminary
data from behavioural observations of teamwork by trained observers of
operating theatre teams suggest that these attitudes are representative
of behaviour (particularly with respect to teamwork between surgical
and anaesthetic staff; fig 2).
12 27 30
Future research
should investigate teamwork in medicine, and its relationship to error
rates and error severity. In addition to being an error-management
technique, effective teamwork and communication also has several
positive side effects, such as fewer and shorter delays, and increases
in morale, job satisfaction, and efficiency.
Behaviour was observed in 3204 commercial flights, from before
departure to landing, and in 96 randomly selected surgical procedures
from patient arrival to transfer to the recovery room. Examples of a
poor rating would be failed communication of skin incision or removal
of the aortic-cross clamp or implementation of Trendleburg position
without notifying the surgeon.
|
Limitations
The most important limitation of our study was the small sample of
hospitals, and these data should therefore be considered preliminary.
As more data are collected, the issues of hospital to hospital
variation and non-response biases can be addressed empirically. Our
research in aviation found no significant differences between cockpit
crew responders and non-responders on demographic variables such as
sex, years experience, background (military or civilian), and position
(captain, first officer, second officer).
Changing the professional culture in aviation
After the introduction of jet transport in the 1950s, accident
rates due to mechanical failure dropped steeply. As data on accidents
accumulated, it became obvious that most accidents were related to
breakdowns in crew coordination, communication, and decision making.
The resulting shift toward a more open culture that accommodated
questioning and recognised human limitations was a gradual but steady progression.
a combination of individual attitudes, organisational norms, and assessments of behaviour before
and after training interventions determined if change was actually
taking place without having to rely on retrospective data from accident
investigation. Data collection instruments such as the cockpit
management attitudes questionnaire were used to show changes in safety
related attitudes before and after training, and these changes mapped
on to actual behaviour in the cockpit.19
Selection and training processes were amended. Pilots began to be
selected not only for technical skills but also their ability to
coordinate activities, learn from error, and recognise that others can
contribute to problem solving. Airlines initiated a new approach to
training and assessing pilot skills by moving away from training the
individual pilot to training the entire crew
recognising that safety
and good performance was not just a function of the captain but of the
captain using all available resources. The aviation approach is to deal
with errors non-punitively and proactively, and this approach defines
behavioural strategies taught in crew resource management training
(currently in its fifth generation)32 as error
countermeasures that are used to avoid error whenever possible, to trap
errors when they do occur, and to mitigate the consequences of error
before they escalate into undesirable states.
Much research is needed to gain a full understanding of attitudes and
behaviours and their relationship with outcomes in medicine. Although
many approaches to team training used in aviation are likely to be
useful in medicine, their design and effect need to be fully validated
to avoid haphazard approaches of limited utility.
|
What is already known on this topic
Much attention has been given to medical error in recent years No formal studies have compared perceptions of error, stress, and teamwork in medicine and aviation What this study addsMedical staff are more likely than aviation staff to deny the effects of stress and fatigue Cockpit crews and intensive care staff advocate flat hierarchies but surgeons are less likely to do so Error is difficult to discuss in medicine and not all staff accept personal susceptibility to error |
| |
Acknowledgments |
|---|
This article is dedicated to the late Dr Hans-Gerhard Schaefer, whose personal quest to find and solve the human problems at the core of medical care made a lasting impression on us. We thank Lou Montgomery and Jennipher Mulhollen for help with administration and data management and Elisa Rhoda for help in collecting the medical data from Italy.
Competing interests: None declared.
| |
Footnotes |
|---|
Funding: Gottlieb-Daimler and Karl-Benz Foundation (RLH), the Memorial Hermann Centre for Healthcare Improvement and the Robert Wood Johnson Foundation generalist physician faculty scholar programme (EJT). RLH initiated this attitudinal research in the early 1980s under National Aeronautics and Space Administration and Federal Aviation Authority sponsorship.
| |
References |
|---|
|
|
|---|
| 1. | Thomas EJ, Studdert DM, Burstin HR, Orav EJ, Zeena T, Williams EJ, et al. Incidence and types of adverse events and negligent care in Utah and Colorado. Medical Care (in press). |
| 2. | Thomas EJ, Studdert DM, Newhouse JP, Zbar BIW, Howward KM, Williams EJ. Costs of medical injuries in Utah and Colorado. Inquiry 1999; 36: 255-264[Medline]. |
| 3. | Leape LL, Lawthers AG, Brennan TA, Johnson WG. Preventing medical injury. Quality Review Bulletin 1993; 19: 144-149. |
| 4. | Maurino DE, Reason J, Johnston N, Lee RB. Beyond aviation human factors: safety in high technology systems. Brookfield, VT: Ashgate Publishing, 1995. |
| 5. |
Leape LL.
Error in medicine.
JAMA
1994;
272:
1851-1857 |
| 6. |
Helmreich RL.
On error management: lessons from aviation.
BMJ
2000;
320:
781-785 |
| 7. | Combs A, Taylor C. The effect of the perception of mild degrees of threat on performance. J Abnormal Social Psychology 1952; 47: 420-424[CrossRef]. |
| 8. | Easterbrook JA. The effect of emotion on cue utilization and the organization of behavior. Psychological Rev 1959; 66: 183-201. |
| 9. | Michaelson M, Levi L. Videotaping in the admitting area: a most useful tool for quality improvement of the trauma care. Eur J Emerg Med 1997; 4: 94-96[Medline]. |
| 10. | Santora TA, Trooskin SZ, Blank CA, Clarke JR, Schinco MA. Video assessment of trauma response: adherence to ATLS protocols. Am J Emerg Med 1996; 14: 564-569[CrossRef][Medline]. |
| 11. | Helmreich RL, Schaefer H-G. Team performance in the operating room. In: Bogner M, ed. Human error in medicine. Hillsdale, NJ: Laurence Erlbaum, 1994. |
| 12. | Sexton JB, Marsch SC, Helmreich RL, Betzendoerfer D, Kocher TM, Scheidegger D. Jumpseating in the operating room. In: Henson L, Lee A, Basford A, eds. Simulators in anesthesiology education. New York: Plenum, 1998:107-108. |
| 13. | Donchin Y, Gopher D, Olin M, Bodihi Y, Sprung CL, Pizov R, et al. A look into the nature and causes of human errors in the intensive care unit. Crit Care Med 1995; 23: 294-300[CrossRef][Medline]. |
| 14. | Marsch SC. Team oriented medical simulation. In: Henson L, Lee A, Basford A, eds. Simulators in anesthesiology education. New York: Plenum, 1998:51-58. |
| 15. | Gaba DM, Howard SK, Flanagan B, Smith BE, Fish KJ, Botney K, et al. Assessment of clinical performance during simulated crises using both technical and behavioural ratings. Anesthesiology 1998; 89: 8-18[CrossRef][Medline]. |
| 16. | Small SD, Wuerz RC, Simon R, Shapiro N, Conn A, Setnik G, et al. Demonstration of high-fidelity simulation team training for emergency medicine. Acad Emerg Med 1999; 6: 312-323[Medline]. |
| 17. | Irwin C. The impact of initial and recurrent cockpit resource management training on attitudes. In: Proceedings of the sixth international symposium on aviation psychology. Columbus, OH: Ohio State University, 1991:344-349. |
| 18. | Helmreich RL, Foushee HC, Benson R, Russini W. Cockpit management attitudes: exploring the attitude-behaviour linkage. Aviation, Space, and Environmental Medicine 1986; 57: 1198-1200[Medline]. |
| 19. | Helmreich RL, Wilhelm JA, Gregorich SE, Chidster TR. Preliminary results from evaluation of cockpit resource management training: Performance ratings of flight crews. Aviation, Space, and Environmental Medicine 1990; 61: 576-579[Medline]. |
| 20. | Helmreich RL, Merritt AC. Culture at work in aviation and medicine: national, organizational, and professional influences. Aldershot: Ashgate, 1998. |
| 21. | Helmreich RL, Wilhelm JA. Outcomes of crew resource management training. Int J Aviation Psychology 1991; 1: 287-300. |
| 22. | Gregorich SE, Helmreich RL, Wilhelm JA. The structure of cockpit management attitudes. J Appl Psychology 1990; 75: 682-690[CrossRef][Medline]. |
| 23. | Helmreich RL. Cockpit management attitudes. Human Factors 1984; 26: 583-589[Medline]. |
| 24. | Foushee HC. Dyads and triads at 25 000 feet: factors affecting group process and aircrew performance. American Psychologist 1984; 39: 885-993[CrossRef]. |
| 25. | Helmreich RL, Merritt AC, Sherman PJ, Gergorich SE, Wiener EL. The flight management attitudes questionnaire (FMAQ). Austin, TX: University of Texas, 1993. (NASA/UT/FAA technical report 93-4.) |
| 26. | De Leval MR. Human factors and surgical outcomes: a cartesian dream. Lancet 1997; 349: 723-725[Medline]. |
| 27. | Wiener E, Kanki BG, Helmreich RL. Cockpit resource management. San Diego, CA: Academic Press, 1993. |
| 28. | Sandal GM. The effects of personality and interpersonal relations on crew performance during space simulation studies. Int J Life Support Biosphere Sci 1999; 5: 226-237. |
| 29. | Merritt AC, Helmreich RL. CRM: I hate it, what is it? (Error, stress, and culture). In: Proceedings of the Orient Airlines Association air safety seminar, 23-25 April 1997, Jakarta, Indonesia. Manila: Orient Airlines Association, 1997:123-134. |
| 30. | Sexton JB. Teamwork and taskforce: a two factor model of aircrew performance [masters thesis]. In: Austin TX: University of Texas, 1999. |
| 31. | Sexton JB. Content analyses of cockpit communication. A talk presented at the Daimler-Benz Diskurs: group interaction in high risk environments, Ladenburg, Germany, 27-29 October. Austin, TX: University of Texas, 1999. (Technical Report 99-8.) |
| 32. | Helmreich RL, Merritt AC, Wilhelm JA. The evolution of crew resource management training in commercial aviation. Int J Aviation Psychology 1999; 9: 19-32. |
(Accepted 18 February 2000)
Read all Rapid Responses