BMJ 1996;312:619-622 (9 March)

Education and debate

A primer on leading the improvement of systems

Donald M Berwick, president and chief executive officer a

a Institute for Healthcare Improvement, Boston, MA 02215, USA

The nurse called me urgently into the room. The child, she said, was in acute respiratory distress.

I had never met either Jimmy (the 6 year old boy) or his mother (an inner city single teenage parent) before. His asthma attack was severe, his peak expiratory flow rate only 35% of normal. Twenty years ago my next steps would have been to begin bronchodilator treatment, call an ambulance, and send the boy to hospital. That also would have been the story 10 years ago, or five, or two.

But today, when I entered the room, the mother handed me her up to date list of treatments, including nebuliser treatment with ß2 agonists, that she had administered with equipment that had been installed in her home. It continued with her graph of Jimmy's slowly improving peak flow levels, which she had measured and charted at home, having been trained by the asthma outreach nurse. She then gave me the nurse's cellular telephone number, along with a specific recommendation on the next medication to try for her son, one that had worked in the past but was not yet available for her to use at home.

My reply was interrupted by a knock on my door. It was the chief of the allergy department in my health maintenance organisation. He worked one floor above me in the health centre and, having been phoned by the outreach nurse, had decided to "pop down" to see if he could help. He also handed me a phial of the same new medication that the mother had just mentioned, suggesting that we try it.

Two hours later Jimmy was not in a hospital bed; he was at home breathing comfortably. Just to be safe the allergy nurse would be paying him a visit later that afternoon.

Improvement and change: a systems view

Any would-be leader of improvement must recognise the indissoluble bond between improvement and change. Not all change is improvement, but all improvement is change.

THE CENTRAL LAW OF IMPROVEMENT

The relation derives from what I will call the central law of improvement: every system is perfectly designed to achieve the results it achieves. This aphorism encodes an understanding of systems that lies at the root of current approaches to making systems function better. The central law reframes performance from a matter of effort to a matter of design.

The central law of improvement implies that better or worse "performance" cannot be obtained from a system of work merely on demand. (A system of work here means any set of activities with a common aim--a doctor's practice, a hospital, or a national health care system.) It implies that the results of health care, such as mortality rates or the speed with which we address a patient's anxiety, are themselves properties of our system of care, just as the length of my maximum long jump is inherent in the nature of my body (which is also a system). Mere effort can, of course, achieve some improvements. But such improvement is not fundamental; it does not often represent a new level of capability.


                   Learning points
-------------------------------------------------------
* Not all change is improvement, but all
improvement is change
* Real improvement comes from changing
systems, not changing within systems
* To make improvements we must be clear
about what we are trying to accomplish, how
we will know that a change has led to improvement,
and what change we can make that will
result in an improvement
* The more specific the aim, the more likely
the improvement; armies do not take all hills at
once
* Concentrate on meeting the needs of patients
rather than the needs of organisations
* Measurement is best used for learning rather
than for selection, reward, or punishment
* Measurement helps to know whether innovations
should be kept, changed, or rejected;
to understand causes; and to clarify aims
* Effective leaders challenge the status quo both
by insisting that the current system cannot
remain and by offering clear ideas about superior
alternatives
* Educating people and providing incentives
are familiar but not very effective ways of
achieving improvement
* Most work systems leave too little time for
reflection on work
* You win the Tour de France not by planning
for years for the perfect first bicycle ride but
by constantly making small improvements

Saying that performance is a system characteristic does not imply that performance never varies. Indeed, variation is inevitable. Waiting times go up and down; so do mortality rates. The central law does imply, however, a certain kind of stability--namely, that both average performance and the degree of variation about that average over time are characteristics of the system.

Now along comes a well intended government minister or manager or doctor who wants to improve on the historical performance level of health care. Each, from his or her own platform, tries to cause improvement: the minister publishes league tables; the manager initiates internal audit and links pay to performance; the doctor promises to try harder. According to the central law of improvement, the results everyone wants to change are properties inherent in the system. Only if the league tables cause the creation of new systems can we expect new results. If not, not.

Herein lies the link between improvement and change. If we do not like the current level of performance we must choose between change and frustra tion.1 You can see it clearly in the story of Jimmy. He ended up at home and not in hospital because the system of care--of home nebulisation, training for the mother, outreach nurses and home visits, and flexible schedules for consultants and cellular phones--had changed and was capable of sending him home safely and well.

CHANGE OF A SYSTEM, NOT CHANGE IN A SYSTEM

This change in Jimmy's care is change of a system, not change within a system.2 For Jimmy, change within the system would have meant my trying harder not to admit or waiting longer before doing so; using more of a familiar drug, not turning to a new one; getting the child more quickly to a nebuliser, not moving the nebuliser, the peak flow meter, and the skill to the home.

We must be clear about the distinction between stressing the current system (relying on more of the same) and introducing a truly new system. The former butts without much effect against the walls of historical performance; the latter leaps over them.

The new system of asthma care did not come from me. New systems do not bubble up from below. If we sketch a diagram of "the system of asthma care"--the network of cause and effect that sent Jimmy safely home that day--then the circles will contain the names of people, departments, rules, pieces of equipment, and the matrix of causes will stretch into the channels of nursing command, the purchasing systems, the rules of hiring, the design departments of equipment manufacturers, and the board of the health maintenance organisation where Jimmy and I met. The diagram will show that Jimmy and I are not causes much at all: we are mostly effects. The system could make us helpless; but instead it met our needs. Unified by a common aim, the system let this little boy go home.

To create great health we must create great systems of care for health. Improvement begins in our will, but to achieve improvement we need a method for systemic change, a model for improvement.

A model for improvement

Nolan and colleagues have devised a simple and elegant model for achieving changes that are improvements (fig 1).3 Nolan's model comprises three basic questions and a fourth element that describes a cycle for testing innovations.



View larger version (18K):
[in this window]
[in a new window]
 
Fig 1--A model for improvement from Langley, Nolan, and Nolan.3 This simple framework can guide specific improvement activities in personal work, teams, or natural work groups

What are we trying to accomplish? Improvement must be intended, and specific aims are crucial. If my daughter tries to learn to ride a bicycle she has a chance of success. If she sets off to "improve transportation" she might not.

How will I know if a change leads to an improvement? Measurement is only a handmaiden to improvement, but improvement cannot act without it. We speak here not of measurement for the purposes of judgment (for deciding whether or not to buy or to accept or reject) but for the purposes of learning (such as from experiment, from others, or from history).

What changes could we make that we think will result in improvement? This question addresses the central law of improvement en face. Since new aims require changes of systems, it is important to be able to identify promising changes and to avoid useless ones. Smart ideas for change can come from many places--from experts, from science, from theory, from experience.

The plan-do-study-act (PDSA) cycle4 describes, in essence, inductive learning--the growth of knowledge through making changes and then reflecting on the consequences of those changes. Such inductive learning is familiar to scientists, but such formal cycles of action and reflection are unusual in daily work. Nolan's model intends that the enterprise of testing change in informative cycles should be part of normal daily activity throughout an organisation. This is what George Box has called "the democratisation of science," and it amounts to little less than a new view of the nature of work itself.

Lessons from observing the model in action

The simplicity of Nolan's model for improvement belies its sophistication. As we at the Institute for Healthcare Improvement have worked with dozens of organisations trying to achieve specific breakthroughs in performance we have seen how difficult it may be for leaders who intend to induce productive change. These four simple steps--set aims, define measurements, find promising ideas for change, and test those ideas in real work settings--challenge the mettle of the best and push against many deeply held assumptions.

LESSONS ABOUT SETTING AIMS

Intending to improve is a necessary first step towards improvement. The more specific the aim the more likely the improvement. Leaders bear the obligation to clarify aims. So many possible agendas are plausible for an organisation that improvement efforts can easily become chaotic unless someone rallies effort around a few specific purposes. Armies do not take all hills at once; someone must say, "Take that hill."

People in health care organisations often rebel against the idea of pulling together around a small set of shared purposes. We are used to suboptimising our local profession or department.5 Nurses improve nursing; doctors improving doctoring. But part by part improvement will not in general achieve the improvement of systems as a whole. Indeed, collaboration may easily degenerate into the more familiar job of making one's own part better at the expense of the whole.6

Furthermore, without repeated clarification, aims drift. I have seen a team working on reducing costs in an inpatient unit suddenly realise in its tenth hour of meeting that at least half of the group had come to feel that costs ought not to be reduced. No further progress was possible until they had again forged a shared aim. Many teams have found it useful to "recite" aims at each meetings, just to ensure that all members are still on board.

Ambitious aims and external customers

Two specific properties of aims for improvement can be particularly helpful in building momentum for change. Firstly, aims should be ambitious. "Stretch goals" make it immediately obvious that the current system is inadequate and that a new one is required. In our work on reducing caesarean section rates the guidance group chose a reduction of 30% as the breakthrough goal. A less ambitious goal might have led simply to stressing the system to achieve marginal gains. By contrast, a safe reduction of 30% or more required fundamental changes in patient preparation, anaesthesia, labour management, and delivery technique.

Secondly, we have noted how difficult it is to maintain focus on aims that matter to society--that affect the external customers of our work, like patients, families, and communities. It is sometimes easier to focus on internal reorganisation and improve in ways that are unimportant to outsiders. But it is meeting external needs that ultimately determines the success or failure of organisations. Reminding people of this and asking relentlessly, "What external needs are we meeting?" is a mark of effective leadership.

LESSONS ABOUT MEASUREMENT

Health care is in the midst of a love affair with measurement. Report cards, league tables, and mandatory reporting about, all in a search for better accountability and an informed consumer. Belief in the wisdom of the market runs deep. But the second question in Nolan's model has little to do with selection, reward, and punishment. It refers to measurement for learning.

All learners need some form of measurement. Firstly, measuring helps one know if a particular innovation should be kept, changed, or rejected. My son, a middle distance runner, found his new shoes to be an improvement because his time in the half mile fell when he wore them. Secondly, measuring can help one understand causes. When the car stops the fuel gauge on "empty" tells us why. Thirdly, and more subtly, developing measurement helps to clarify aims; the answer to Nolan's second question helps refine the answer to the first.

Our institute is working with 12 organisations to improve asthma care. They set out initially to try to reduce severe attacks and chose "visits to emergency rooms" as a measure. This led to a discussion of how emergency room visits are used and refocused the group on effective use of initial emergency visits to institute definitive care. They changed their measurement to "repeat visits to emergency rooms," which better reflected their aims.

This friendliness between measurement and aims comes as a surprise to many health care groups using the Nolan model. They are so used to experiencing measurement as judgment that they have forgotten the role of measurement in improvement.

The best is the enemy of the good

When leaders manage to overcome this fear they often run into a second barrier: the search for perfect measurement. The rooting of health care in scientific research has generated some myopia about the preconditions for inference. When we try to improve a system we do not need perfect inference about a pre-existing hypothesis: we do not need randomisation, power calculations, and large samples. We need just enough information to take a next step in learning. Often a small series of patients or a few closely observed events contain more than enough information for a specific process change to be evaluated, refined, or discarded, just as my daughter, in learning to ride her bicycle, sometimes must fall down only once to learn not to try that manoeuvre again. In measurement for improvement the best is often the enemy of the good.

LESSONS ABOUT FINDING PROMISING CHANGE CONCEPTS

Health care is rich in sources of ideas worth testing in the search for improvement: medical journals, professional meetings, colleagues, consulting firms. In fact, good ideas are so abundant that one wonders why systems of medical care change so slowly.7 Patterns recur in the behaviour of leaders trying to introduce good ideas for change into the system of care. Mostly these are to do with overcoming resistance to change,8 the immense authority of the status quo in a complex human system.

Effective leaders challenge the status quo both by insisting that the current system cannot remain and by offering clear ideas about superior alternatives. We have noticed that leaders who have a clear-headed view of a promising new approach--what Nolan calls a "change concept"--and who can explain it with confidence are more likely to succeed than those who merely state the new aims and leave it to the workforce to come up with the new ways to achieve those aims.

Leaders cannot get by simply by "empowering" people to discover better ways to work. In practice the workforce rarely comes up with a new concept bolder than one that leaders have already put on the table as the alternative to the status quo.

Two examples of powerful change concepts may show why this is so. One is the concept of "work removal," the idea that work that helps no one should be stopped.9 Workers rarely do this of their own accord, even if they know the work is waste. The reasons are complicated, involving job security, incentives, and pride, all of which conspire to maintain the status quo. It takes a senior leader, fully confident in the general concept that systems normally contain major chunks of valueless work, to insist that such waste be found and removed. The empowerment comes in giving the workforce the time, authority, and safe harbour to find and remove the waste.

Another change concept, even more powerful but even less likely to be discovered by a workforce, is continuous flow. This is the alternative to batching: making stacks of things to be worked on in due time.10 We stack things everywhere in health care--patients in waiting rooms, forms and equipment in bins, laboratory specimens for processing, and phone calls on hold. Most industries try to replace batch processing with a more effective and less costly continuous process flow; but this idea challenges basic assumptions in most health care systems. It seems self evident (even though it is not true) that continuous flow systems must be more costly, not less. The concept of continuous flow is at first so foreign that only senior leaders can insist on its use.

In fact, health care leaders have tended to fall back on concepts for change that are familiar but not very powerful--such as educating people and providing different incentives. Both tend to rely on stressing the existing system, rather than building a new one. In particular, teaching people facts so as to change their behaviour is a long, slow road. We have known for years that to reduce the use of an overused laboratory test removing its name from a preprinted laboratory form (requiring a doctor who wants it to write it in) works far better than any number of educational sessions about the proper use of the test.11

On the other hand, leaders who do want to accelerate improvement by introducing highly leveraged concepts of change, such as continuous flow, need to give people time to assimilate and test those concepts. Most work systems leave too little time for reflection on work. It may be especially helpful to "walk through" actual work systems, especially when searching for waste that can be removed. A team of doctors, nurses, and others in a renal dialysis unit recently took the time, with some facilitation, to walk through their own unit to identify waste in supplies, time, equipment, motion, and other resources. Within an hour they had listed over 60 specific types of waste and could set about stopping many of them.

Groups that do begin to tackle system change sometimes fall victim to one specific and toxic phenomenon that I call "trumping." The telltale phrase that precedes a trump is one like: "Nothing matters unless. . . ." Or, "We can make no progress at all until. . . ." Though not strictly correct, they are true enough to divert group energy entirely, especially when the person throwing the trump has high status. Common trumps in American health care include, for example, malpractice litigation, payment schemes, physician training, and unrealistic patient demands. All are problems, but none need paralyse. Skilful leaders can address the trump and disable it. "That is important, of course," such a leader says, "but surely we are clever enough to find plenty of other routes to improvement, even while we tackle that barrier."

LESSONS ABOUT USING PDSA CYCLES FOR LEARNING

The plan-do-study-act cycle is a mnemonic for testing changes in real work settings. It defines activities not normally part of work but which if made part of work can convert a system from at best a merely stable one to one capable of continuous learning.

Effective leaders of improvement insist that the status quo should be challenged continuously through the active testing of promising changes on a small scale. Such testing is totally unfamiliar as part of normal work and most organisations resist the concept. The resistance comes in many disguises, such as the demand for perfect measurement, planning tests so large that they never occur, or extending the time frame ("We'll meet again next month") exactly when it should be shorter ("We'll meet again tomorrow").

In our institute's work we have adopted the question, "What test will you run next Tuesday?" as a way of emphasising that the tests implied in Nolan's model are not large, precisely designed trials that take months or years but small, clever, informative PDSA cycles that can often start within days or hours of their initial motivation. Large scale lessons come as we link small scale cycles cumulatively to each other. My 9 year old daughter may be aiming for the Tour de France, but her route to fame does not involve years of planning the perfect first bicycle ride. Instead, she takes small, informative steps one by one, using trials to gain knowledge. When such trials, motivated by sound change concepts, do finally occur, the most vulnerable step by far is study. The science in PDSA is in the act of reflection, learning from what one did. Those who want improvement to occur need to reserve specific times to ask, "What did we learn, and how can we build on it?" Reflection on action is so crucial that leaders themselves should probably model it in their personal behaviour.12

Conclusion

s

If we spoke a language different from English perhaps we would have a single word to link together the three facets of our quest: improvement, change, and learning. From the viewpoint of systems they are deeply united. The effective leader must understand that the road to improvement passes through change and that one efficient way to change is to learn from the actions we ourselves take. In trying to escape from the fetters of historical performance the leader of improvement places both popularity and certainty at risk. But this is what it took to send Jimmy home safely in his mothers arms; this is what it will take in the future to improve the lot of those who place themselves in our care.

  1. Batalden PB, Stoltz PK. A framework for the continual improvement of health care. Joint Commission Journal of Quality Improvement 1993;19:424-47.
  2. Watzlawick P, Weakland I, Fisch R. Change: principles of problem formulation and problem resolution. New York: W W Norton, 1974.
  3. Langley GJ, Nolan KM, Nolan TW. The foundation of improvement. Silver Spring, MD: API Publishing, 1992.
  4. Shewhart WA. Economic control of quality of manufactured product. New York: Van Nostrand, 1931. (Reprinted Milwaukee, WI: American Society for Quality Control, 1980.)
  5. Senge PM. The fifth discipline: the art and practice of the learning organisation. New York: Doubleday/Currency, 1980.
  6. Axelrod R. The evolution of cooperation. New York: Basic Books, 1974.
  7. Berwick DM. Eleven worthy aims for clinical leadership of health system reform. JAMA 1994;272:797-802. [Abstract]
  8. Argyris C. Overcoming organizational defenses: facilitating organizational learning. Boston, MA: Allyn and Bacon, 1990.
  9. Roberts HV, Zangwill WI. Quality improvement through waste reduction. Chicago, IL: University of Chicago Graduate School of Business, 1993.
  10. Ohno T. Toyota production system: beyond large-scale production. Cambridge, MA: Productivity Press, 1988.
  11. Eisenberg JM. Doctors' decisions and the cost of medical care. Ann Arbor, MI: Health Administration Press, 1986.
  12. Roberts HV, Sergesketter BF. Quality is personal: a foundation for total quality management. New York: The Free Press, 1993.

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Articles

Correlations among measures of quality in HIV care in the United States: cross sectional study
Ira B Wilson, Bruce E Landon, Peter V Marsden, Lisa R Hirschhorn, Keith McInnes, Lin Ding, and Paul D Cleary
BMJ 2007 335: 1085. [Abstract] [Full Text] [PDF]

How computers help make efficient use of consultations
Frank Sullivan and Jeremy C Wyatt
BMJ 2005 331: 1010-1012. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

  • Parnaby, J., Towill, D. R (2008). Enabling innovation in health-care delivery. Health Serv Manage Res 21: 141-154 [Abstract] [Full text]  
  • Tsasis, P., Bruce-Barrett, C. (2008). Organizational change through Lean Thinking. Health Serv Manage Res 21: 192-198 [Abstract] [Full text]  
  • Slora, E. J., Steffes, J. M., Harris, D., Clegg, H. W., Norton, D., Darden, P. M., Sullivan, S. A., Wasserman, R. C. (2008). Improving Pediatric Practice Immunization Rates Through Distance-Based Quality Improvement: A Feasibility Trial from PROS. CLIN PEDIATR 47: 25-36 [Abstract]  
  • Funnell, M. M., Brown, T. L., Childs, B. P., Haas, L. B., Hosey, G. M., Jensen, B., Maryniuk, M., Peyrot, M., Piette, J. D., Reader, D., Siminerio, L. M., Weinger, K., Weiss, M. A. (2008). National Standards for Diabetes Self-Management Education. Diabetes Care 31: S97-S104 [Full text]  
  • Wilson, I. B, Landon, B. E, Marsden, P. V, Hirschhorn, L. R, McInnes, K., Ding, L., Cleary, P. D (2007). Correlations among measures of quality in HIV care in the United States: cross sectional study. BMJ 335: 1085-1085 [Abstract] [Full text]  
  • Matheny, M. E., Gandhi, T. K., Orav, E. J., Ladak-Merchant, Z., Bates, D. W., Kuperman, G. J., Poon, E. G. (2007). Impact of an Automated Test Results Management System on Patients' Satisfaction About Test Result Communication. Arch Intern Med 167: 2233-2239 [Abstract] [Full text]  
  • Coory, M., Scott, I. (2007). Analysing low-risk patient populations allows better discrimination between high-performing and low-performing hospitals: a case study using inhospital mortality from acute myocardial infarction. Qual Saf Health Care 16: 324-328 [Abstract] [Full text]  
  • Thor, J., Lundberg, J., Ask, J., Olsson, J., Carli, C., Harenstam, K. P., Brommels, M. (2007). Application of statistical process control in healthcare improvement: systematic review. Qual Saf Health Care 16: 387-399 [Abstract] [Full text]  
  • Ellershaw, J. (2007). Care of the dying: what a difference an LCP makes!. Palliat Med 21: 365-368  
  • Funnell, M. M., Brown, T. L., Childs, B. P., Haas, L. B., Hosey, G. M., Jensen, B., Maryniuk, M., Peyrot, M., Piette, J. D., Reader, D., Siminerio, L. M., Weinger, K., Weiss, M. A. (2007). National Standards for Diabetes Self-Management Education. The Diabetes Educator 33: 599-614 [Full text]  
  • Funnell, M. M., Brown, T. L., Childs, B. P., Haas, L. B., Hosey, G. M., Jensen, B., Maryniuk, M., Peyrot, M., Piette, J. D., Reader, D., Siminerio, L. M., Weinger, K., Weiss, M. A. (2007). National Standards for Diabetes Self-Management Education. Diabetes Care 30: 1630-1637 [Full text]  
  • Marcin, J. P., Pollack, M. M. (2007). Review of the Acuity Scoring Systems for the Pediatric Intensive Care Unit and Their Use in Quality Improvement. J Intensive Care Med 22: 131-140 [Abstract]  
  • Black, D. (2007). Faecal incontinence. Age Ageing 36: 239-240 [Full text]  
  • Gunderman, R. B., Burdick, E. J. (2007). Error and Opportunity. Am. J. Roentgenol. 188: 901-903 [Full text]  
  • Scott, I. (2007). The evolving science of translating research evidence into clinical practice. Evid. Based Med. 12: 4-7 [Full text]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, G., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2007). National Standards for Diabetes Self-Management Education. Diabetes Care 30: S96-S103 [Full text]  
  • Asadoorian, J., Locker, D. (2006). The impact of quality assurance programming: a comparison of two canadian dental hygienist programs.. J Dent Educ 70: 965-971 [Abstract] [Full text]  
  • Baker, G R (2006). Strengthening the contribution of quality improvement research to evidence based health care.. Qual Saf Health Care 15: 150-151 [Full text]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, G., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2006). National Standards for Diabetes Self-Management Education. Diabetes Care 29: S78-S85 [Full text]  
  • Woolf, S. H., Johnson, R. E. (2005). The Break-Even Point: When Medical Advances Are Less Important Than Improving the Fidelity With Which They Are Delivered. Ann Fam Med 3: 545-552 [Abstract] [Full text]  
  • Sullivan, F., Wyatt, J. C (2005). How computers help make efficient use of consultations. BMJ 331: 1010-1012 [Full text]  
  • Brown, C. J, Gottschalk, M., Van Ness, P. H, Fortinsky, R. H, Tinetti, M. E (2005). Changes in Physical Therapy Providers' Use of Fall Prevention Strategies Following a Multicomponent Behavioral Change Intervention. ptjournal 85: 394-403 [Abstract] [Full text]  
  • Pruitt, S. D, Epping-Jordan, J. E (2005). Preparing the 21st century global healthcare workforce. BMJ 330: 637-639 [Full text]  
  • Schiff, G. D., Kim, S., Krosnjar, N., Wisniewski, M. F., Bult, J., Fogelfeld, L., McNutt, R. A. (2005). Missed Hypothyroidism Diagnosis Uncovered by Linking Laboratory and Pharmacy Data. Arch Intern Med 165: 574-577 [Abstract] [Full text]  
  • Stevens, D P (2005). Three questions for QSHC. Qual Saf Health Care 14: 2-3 [Full text]  
  • Dailey, M. (2005). Skin Care Resource Teams: Successful Strategies to Implement Evidence-Based Practice. Home Health Care Management Practice 17: 78-87 [Abstract]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, G., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2005). National Standards for Diabetes Self-Management Education. Diabetes Care 28: S72-S79 [Full text]  
  • Poon, E. G., Gandhi, T. K., Sequist, T. D., Murff, H. J., Karson, A. S., Bates, D. W. (2004). "I Wish I Had Seen This Test Result Earlier!": Dissatisfaction With Test Result Management Systems in Primary Care. Arch Intern Med 164: 2223-2228 [Abstract] [Full text]  
  • Macfarlane, F, Greenhalgh, T, Schofield, T, Desombre, T (2004). RCGP Quality Team Development programme: an illuminative evaluation. Qual Saf Health Care 13: 356-362 [Abstract] [Full text]  
  • Conrad, D. A., Christianson, J. B. (2004). Penetrating the "Black Box": Financial Incentives for Enhancing the Quality of Physician Services. Med Care Res Rev 61: 37S-68S [Abstract]  
  • Monteleoni, C., Clark, E. (2004). Using rapid-cycle quality improvement methodology to reduce feeding tubes in patients with advanced dementia: before and after study. BMJ 329: 491-494 [Abstract] [Full text]  
  • Elwyn, G, Rhydderch, M, Edwards, A, Hutchings, H, Marshall, M, Myres, P, Grol, R (2004). Assessing organisational development in primary medical care using a group based assessment: the Maturity MatrixTM. Qual Saf Health Care 13: 287-294 [Abstract] [Full text]  
  • Campbell, S M, Robison, J, Steiner, A, Webb, D, Roland, M O (2004). Improving the quality of mental health services in Personal Medical Services pilots: a longitudinal qualitative study. Qual Saf Health Care 13: 115-120 [Abstract] [Full text]  
  • Bradley, E H, Holmboe, E S, Mattera, J A, Roumanis, S A, Radford, M J, Krumholz, H M (2004). Data feedback efforts in quality improvement: lessons learned from US hospitals. Qual Saf Health Care 13: 26-31 [Abstract] [Full text]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, G., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2004). National Standards for Diabetes Self-Management Education. Diabetes Care 27: s143-143 [Full text]  
  • Berwick, D M (2003). Improvement, trust, and the healthcare workforce. Qual Saf Health Care 12: 448-452 [Abstract] [Full text]  
  • Berwick, D M (2003). Improvement, trust, and the healthcare workforce. Qual Saf Health Care 12: i2-6 [Abstract] [Full text]  
  • Nieva, V F, Sorra, J (2003). Safety culture assessment: a tool for improving patient safety in healthcare organizations. Qual Saf Health Care 12: ii17-23 [Abstract] [Full text]  
  • HOWLEY, P. P., GIBBERD, R. (2003). Using hierarchical models to analyse clinical indicators: a comparison of the gamma-Poisson and beta-binomial models. Int J Qual Health Care 15: 319-329 [Abstract] [Full text]  
  • Runciman, W. B., Merry, A. F., Tito, F. (2003). Error, Blame, and the Law in Health Care--An Antipodean Perspective. ANN INTERN MED 138: 974-979 [Abstract] [Full text]  
  • Jacobson, L., Elwyn, G., Robling, M., Jones, R. T. (2003). Error and safety in primary care: no clear boundaries. Fam Pract 20: 237-241 [Abstract] [Full text]  
  • Smith, R. (2003). What doctors and managers can learn from each other. BMJ 326: 610-611 [Full text]  
  • Walshe, K (2003). International comparisons of the quality of health care: what do they tell us?. Qual Saf Health Care 12: 4-5 [Full text]  
  • FRANCOIS, P., PEYRIN, J.-C., TOUBOUL, M., LABARERE, J., REVERDY, T., VINCK, D. (2003). Evaluating implementation of quality management systems in a teaching hospital's clinical departments. Int J Qual Health Care 15: 47-55 [Abstract] [Full text]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, G., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2003). National Standards for Diabetes Self-Management Education. Diabetes Care 26: s149-156 [Full text]  
  • Ortiz, E., Meyer, G., Burstin, H. (2002). Clinical Informatics and Patient Safety at the Agency for Healthcare Research and Quality. J. Am. Med. Inform. Assoc. 9: S2-7 [Abstract] [Full text]  
  • Campbell, S M, Sheaff, R, Sibbald, B, Marshall, M N, Pickard, S, Gask, L, Halliwell, S, Rogers, A, Roland, M O (2002). Implementing clinical governance in English primary care groups/trusts: reconciling quality improvement and quality assurance. Qual Saf Health Care 11: 9-14 [Abstract] [Full text]  
  • Kerr, D., Bevan, H., Gowland, B., Penny, J., Berwick, D. (2002). Redesigning cancer care. BMJ 324: 164-166 [Full text]  
  • Shahian, D. M., Normand, S.-L., Torchiana, D. F., Lewis, S. M., Pastore, J. O., Kuntz, R. E., Dreyer, P. I. (2001). Cardiac surgery report cards: comprehensive review and statistical critique. Ann. Thorac. Surg. 72: 2155-2168 [Abstract] [Full text]  
  • Spencer, J, Jordan, R (2001). Educational outcomes and leadership to meet the needs of modern health care. Qual Saf Health Care 10: ii38-45 [Abstract] [Full text]  
  • Grol, R. (2001). Improving the Quality of Medical Care: Building Bridges Among Professional Pride, Payer Profit, and Patient Satisfaction. JAMA 286: 2578-2585 [Abstract] [Full text]  
  • Peel, R. K, Bhandari, S., Manning, E., Fernando, B., Mendis, K. (2001). Accessing emergency test results on ward computers. BMJ 323: 516-516 [Full text]  
  • Eagle, K. A. (2001). Safety Alerts Involving Device Therapy for Arrhythmias. JAMA 286: 843-844 [Full text]  
  • Cranney, M., Warren, E., Barton, S., Gardner, K., Walley, T. (2001). Why do GPs not implement evidence-based guidelines? A descriptive study. Fam Pract 18: 359-363 [Abstract] [Full text]  
  • Mensing, C., Boucher, J., Cypress, M., Weinger, K., Mulcahy, K., Barta, P., Hosey, O., Kopher, W., Lasichak, A., Lamb, B., Mangan, M., Norman, J., Tanja, J., Yauk, L., Wisdom, K., Adams, C. (2000). National Standards for Diabetes Self-Management Education. The Diabetes Educator 26: 611-626  
  • Rogers, S., Humphrey, C., Nazareth, I., Lister, S., Tomlin, Z., Haines, A. (2000). Designing trials of interventions to change professional practice in primary care: lessons from an exploratory study of two change strategies. BMJ 320: 1580-1583 [Full text]  
  • Espinosa, J. A, Nolan, T. W (2000). Reducing errors made by emergency physicians in interpreting radiographs: longitudinal study. BMJ 320: 737-740 [Abstract] [Full text]  
  • Moss, F. (1999). Junior doctors: waving or drowning?. BMJ 318: 1639-1640 [Full text]  
  • Vincent, C., Taylor-Adams, S., Stanhope, N. (1998). Framework for analysing risk and safety in clinical medicine. BMJ 316: 1154-1157 [Full text]  
  • Headrick, L. A., Richardson, A., Priebe;, G. P., Bergman, D. (1998). Continuous Improvement Learning for Residents. Pediatrics 101: 768-774 [Abstract] [Full text]  
  • Grol, R. (1997). Personal paper: Beliefs and evidence in changing clinical practice. BMJ 315: 418-421 [Full text]  
  • Elson, R. B., Faughnan, J. G., Connelly, D. P. (1997). An Industrial Process View of Information Delivery to Support Clinical Decision Making: Implications for Systems Design and Process Measures. J. Am. Med. Inform. Assoc. 4: 266-278 [Abstract] [Full text]  
  • Vincent, C. (1997). Risk, safety, and the dark side of quality. BMJ 314: 1775-1775 [Full text]  
  • Kemple, T. (1996). BMJ's audit should show actions planned to improve quality. BMJ 313: 1557b-1557 [Full text]  



Student BMJ

Asylum seekers' care

UK medical students have published unreleased government plans to restrict failed asylum seekers' access to medical care

www.student.bmj.com

Listen to the latest BMJ Interview