Beta
Learning In Practice

Learning in practiceCompetency based medical training: reviewCommentary: The baby is thrown out with the bathwater

BMJ 2002; 325 doi: http://dx.doi.org/10.1136/bmj.325.7366.693 (Published 28 September 2002) Cite this as: BMJ 2002;325:693

Competency based medical training: review

  1. Wai-Ching Leung (wai_chingleung{at}hotmail.com), honorary lecturer in public health medicine.
  1. Medicine, Health Policy and Practice, University of East Anglia, Norwich NR4 7TJ
  2. The Education Centre, Birmingham Children's Hospital, Birmingham B4 6NH
  • Accepted 23 May 2002

The competency approach has become prominent at most stages of undergraduate and postgraduate medical training in many countries. In the United Kingdom, for example, it forms part of the performance procedures of the General Medical Council (GMC),1 underpins objectively structured clinical examinations (OSCEs) and records of in-training assessment (RITA), and has been advocated for the selection of registrars in general practice and interviews. 2 3 It has become central to the professional lives of all doctors and is treated as if it were a panacea—but there is little consensus among trainees, trainers, and committees on what this approach entails.

I aim to explore the origins and development of the competency approach, evaluate its current role in medical training, and discuss its strengths and limitations.

Summary points

  • The competency based approach consists of functional analysis of occupational roles, translation of these roles into outcomes, and assessment of trainees' progress on the basis of their demonstrated performance of these outcomes

  • It has become dominant at most stages of medical training

  • Potential advantages include individualised flexible training, transparent standards, and increased public accountability

  • If applied inappropriately, it can result in demotivation, a focus on minimum acceptable standards, increased administrative burden and a reduction in the educational content

  • We should be cautious of applying the competency based approach universally unless robustly defined higher order competencies are available

The birth of the competency movement

The competency approach did not result directly from recent scandals of incompetent doctors. It originated from parallel developments in vocational training in many countries, such as the national qualifications framework in New Zealand, the national training board in Australia, the national skills standards initiative in the United States, and the national vocational qualifications (NVQs) in the United Kingdom.4 This movement was driven largely by the political perceived need to make the national workforce more competitive in the global economy. For example, in Britain, the national vocational qualifications were developed as a set of standards each broken down into elements by which performance in the workplace can be assessed. This approach has since been adopted for training across other areas, particularly the technical and vocational fields.

How does competency based training work? The basic essential elements consist of functional analysis of the occupational roles, translation of these roles (“competencies”) into outcomes, and assessment of trainees' progress in these outcomes on the basis of demonstrated performance. Progress is defined solely by the competencies achieved and not the underlying processes or time served in formal educational settings.5 Assessments are based on a set of clearly defined outcomes so that all parties concerned, including assessors and trainees, can make reasonably objective judgments about whether or not each trainee has achieved them.6 Potential benefits of this approach include individualised flexible training and transparent standards.

This approach has attracted several criticisms. Firstly, functional analysis of occupational roles is problematic. It is difficult to identify a range of competencies that truly cover work roles in their broadest sense and to represent adequately the types of knowledge relevant to the competency identified. 7 8 Secondly, the assessment of competencies is by no means value free, and people who use it shape its meaning. Thirdly, the competency approach is based primarily on the behaviourist framework, which attempts to break down work roles into small discrete tasks. It ignores the connections between individual tasks and the meaning underlying each task. It therefore cannot represent the complex nature of situations in the real world. The danger is that these narrowly defined competencies will dominate the curriculum, which would not be suitable for learning in higher education.9 The approach using checklists and passing or failing candidates is superficial and often proves demotivating, as it encourages trainees to do the right thing to pass rather than to think critically and excel. The parties concerned—trainees, employers, professional bodies, and the government—may have different views about which aspect of the occupation is regarded as the most important.10 The process of developing competencies is at least partly political because it allows the government to influence what are included as important competencies and to allocate resources based on outcomes of performance. 11 12 A recent review of published evaluative studies of competency based training found an increase in administrative burden but no convincing beneficial effects on motivating students, work performance, or relevance to the needs of industry.11

The rise of “holistic” varieties

As this behaviourist approach to learning would be even less appropriate for professions requiring complex skills, a range of broader competency approaches flourished. In 1991, the general national vocational qualifications, which include core skills such as numeracy, communication, and problem solving, were developed to supplement the NVQ framework, although doubts exist about whether such generic skills transferable to all context actually exist.9 An integrated approach acknowledges competency as a complex combination of knowledge, attitudes, skills, and personal values.13 A holistic approach takes into account the cultural and social context in assessing competence and focuses on how personal attributes are used to achieve outcomes in real life scenarios.14 A competency of a higher order—meta-competency—has been used to describe the general ability to learn and apply competencies effectively in many different aspects of a person's activities.15 These approaches attempt to make the competency based model less reductionist in nature.

Current scene in medical training

Traditionally, the framework of medical training was time based, and students were assessed periodically to determine their grades. Equal weight was given to both process and outcome of learning. Emphasis was given to the understanding of basic concepts and principles, and skills were evaluated globally. Recently, competency based approaches have gradually taken over. Although the behaviourist approach may occasionally be used for training in areas where rigid protocols exist, such as the advanced life support course, holistic varieties of the competency based approach are used more widely. In Australia, criterion referenced procedures to set standards have been used to define and measure competency for the graduate entry medical programme.16 In the United Kingdom, the Royal College of General Practitioners distinguishes between clinical competence (what doctors can do) and clinical performance (what doctors do do) and defines competencies as a combination of knowledge, skills, and attitudes which, when applied to a particular situation, lead to a given outcome. Competency based medical training is usually developed in four steps: determine what the appropriate competencies are, devise training programmes, devise appropriate assessment methods, and set minimum pass standards.

Appropriate competencies can be determined in several ways, such as the GMC's Good Medical Practice for its performance procedures, postal questionnaire surveys of examiners and the committee of trainee members for the part 2 of the examination for membership of the Faculty of Public Health Medicine.17 Competencies for general practitioners have been defined by using triangulation of results from focus groups with general practitioners, behavioural coding of general practitioners' consultations with patients, and interviews with patients.18 There is little evidence, however, that addressing each of these competencies separately is a more effective form of training and assessments than the traditional global approach.



Embedded Image

Competency based medical training is prominent in undergraduate medical education

(Credit: GEOFF TOMPKINSON/SPL)

Based on the competency approach, the objective structured clinical examination using checklists and standardised patients was initially thought to be more reliable and objective and gradually replaced the traditional long case. A recent review has found, however, that, for equal testing time, it is slightly less reliable than the long case.19 Several possible reasons for this surprising finding were given: standardisation of what happens within a case does not eliminate the variability of performance across clinical problems, and the use of ratings in long cases may achieve higher reliability than checklists. Perhaps another reason is that checklists including attributes such as attitudes and personal values may achieve lower reliability than behavioural outcomes. If this were the case, the exclusive focus on outputs that is often perceived to be the key advantage of the competency based approach does not necessarily result in objective and reliable assessments. In their summary assessments, general practice registrars need to submit a video of seven consultations to demonstrate each prescribed competency at least four times. Some candidates find such an exercise exceedingly time consuming and think that it might hinder other educational opportunities and enjoyment of general practice.20

Leading royal colleges set criterion referenced minimum pass standards by a panel agreeing on the probable scores of borderline candidates for both the written examinations and the objective structured clinical examination. 21 22 Although these procedures can be used to set standards for excellence, they currently tend to focus on the minimum acceptable standards. In other examinations and assessments, the pass standards may be more arbitrary.

Other issues are important. Firstly, a key advantage of the competency approach is its focus on competencies achieved rather than time served, so that trainees can progress at their own pace. But the training period for undergraduate and postgraduate medical training is currently fixed. Secondly, the competency approach ignores the learning process, although the process is important for lifelong learning. Thirdly, with the focus of the competency approach on skills and attitudes rather than a solid understanding of the basic concepts and principles, the risk is that “medical education” may give way to “medical training.”

An evaluation

Compared with the traditional approach, the competency based approach potentially leads to individualised flexible training, transparent standards, and increased public accountability. If applied inappropriately, it can also result in demotivation, focus on minimum acceptable standards, increased administrative burden, and a reduction in the educational content. Higher order competencies need to be defined and developed more robustly. We should be cautious of adopting the competency based approach universally across stages of medical training for which well defined and validated competencies are unavailable. After all, it is just one of many potentially useful approaches that may have a role at various stages of the educational progress.

Acknowledgments

Contributors: WCL is the sole author and guarantor of the paper.

Footnotes

  • Conflict of interest None declared.

References

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.

Commentary: The baby is thrown out with the bathwater

  1. Vin Diwakar (vinod.diwakar{at}bhamchildrens.wmids.nhs.uk), consultant in general paediatrics and medical education.
  1. Medicine, Health Policy and Practice, University of East Anglia, Norwich NR4 7TJ
  2. The Education Centre, Birmingham Children's Hospital, Birmingham B4 6NH

    Controversy over the competency based approach to professional education centres on a lack of consensus over what the term means.1

    Leung casts doubt on the value of the competency based approach. He takes a narrow view, dismissing work which develops the concept to reflect the complexity of professional practice. Leung ignores evidence and consensus that knowledge driven traditional models of professional training fail to meet the demands of daily practice. 2 3

    “Competency” describes what a doctor should be capable of doing, and Leung is correct that education focused entirely on narrow definitions of competencies has limitations for professionals. Reflective practice is ignored by reducing professional practice to an exhaustive list of competencies.4

    Both traditional medical teaching and the reductionist approach to competence assume that medical education is only about teaching doctors to solve predictable problems. Professional practice requires an education which recognises that patients are treated as individuals. Clinical problems are personal and unique. To solve them, we make informed, but ultimately value based, judgments that are founded on intelligent reflection on previous experience (expertise).

    Analysis of the ability of professionals to choose, develop, and adapt abilities for different situations bridges the gap between traditional or reductionist approaches and the realities of practice. Leung dismisses a significant body of work on assessment of these “higher order competencies” or “meta-competencies.”

    Miller described a four stage hierarchy of competencies, starting with “knowledge,” progressing through “know how” and “show how” (competence), and culminating in “does” (performance).5 Performance depends on the context in which a doctor works as well as his or her abilities.

    Unlike Leung, I think that most professional bodies recognise this hierarchy of professional competence. Methods of assessment change as doctors progress. Certification of medical students and junior trainees is like a driving licence. The minimum that a doctor must be able to do before he or she can move on to the next stage of professional practice and training is specified. Knowledge and competencies are emphasised, but flexibility in thought and action is required.2Certification of senior trainees and reaccreditation of established practitioners focuses on performance. Attempts to define competencies and meta-competencies across the scope of professional practice are likely to be impossible. Thus, assessment makes use of portfolios, peer and self assessment, and clinical outcomes.6

    Leung's misgivings about competency based education represent one end of a spectrum of views about the extent to which the term includes concepts of competency, meta-competency, and performance. Some argue that the constructivist nature of meta-competency cannot be reconciled to the reductionist industrial origins of the term “competency.”1 Others argue that competency based approaches include elements of all these concepts. It is not surprising that evidence for benefits of the “competency based approach” is hard to find, and disagreement exists over what the terms actually mean. Even so, a recent systematic review found studies showing improved performance by doctors and safety of patients from residents who had attended courses based on competencies. 7 8

    In practice, terms are less important than what we do with the concepts that they represent. Several issues are clear. Traditional models of medical education have been found wanting. A sophisticated model of professional education is required that recognises both basic standards and continuing professional development. The best methods of teaching and assessing these components of daily clinical practice need to be established. A fruitless debate about the meaning of “competency based education” is likely to detract from these, the real challenges of the next decade.

    Footnotes

    • Competing interests Competing interests: VD holds grants from the Royal College of Paediatrics and Child Health and West Midlands Postgraduate Deanery to develop a competency based curriculum for senior house officers in paediatrics.

    References

    1. 1.
    2. 2.
    3. 3.
    4. 4.
    5. 5.
    6. 6.
    7. 7.
    8. 8.