Intended for healthcare professionals

CCBYNC Open access
Analysis Universal Health Coverage

Rethinking assumptions about delivery of healthcare: implications for universal health coverage

BMJ 2018; 361 doi: https://doi.org/10.1136/bmj.k1716 (Published 21 May 2018) Cite this as: BMJ 2018;361:k1716
  1. Jishnu Das, lead economist1,
  2. Liana Woskie, assistant director2,
  3. Ruma Rajbhandari, instructor3,
  4. Kamran Abbasi, executive editor4,
  5. Ashish Jha, K T Ki professor of international health5
  1. 1World Bank, Washington, DC, USA
  2. 2Harvard Initiative on Global Health Quality, Cambridge, MA 02138, USA
  3. 3Harvard Medical School, Boston, MA, USA
  4. 4The BMJ, London, UK
  5. 5Department of Health Policy and Management, Harvard T H Chan School of Public Health, Harvard Global Health Institute, Boston
  1. Correspondence to: A K Jha ajha{at}hsph.harvard.edu

Simply providing more resources for universal coverage is not enough to improve health, argue Jishnu Das and colleagues. We also need to ensure good quality of care

We are at an inflection point in global health. People are living longer, healthier lives than ever before, and we are rightly celebrating disease focused programmes that have greatly reduced or eradicated diseases such as smallpox and river blindness. Better diagnosis and treatment of HIV/AIDS, malaria, and other diseases have saved countless lives.12 Yet, as populations age and the burden of morbidity grows more complex, the limitations of programmes focused on single diseases have become increasingly evident.

Policy makers have shifted towards a broader “systems” view of universal health coverage (UHC)—one that seeks to provide all people with access to essential health services without financial hardship—as the defining approach to improve the health of the world’s poorest people. As one of the key focuses of the sustainable development goals, UHC has become a rallying principle for all countries. Indeed, the new director general of the World Health Organization has made UHC his top priority for the agency.

UHC can achieve its primary objective of creating better health, but to do so, patients must have access to services that are high quality. This idea of “effective UHC” is not new. It has long been recognised that translating healthcare into health outcomes requires that services meet some basic standard of quality.3 However, without systematic data on quality, the working assumption has been that adequately trained doctors and nurses with access to infrastructure (such as well equipped facilities and medicines) will be sufficient to guarantee adequate quality. Emerging data suggest that this understanding may be incorrect. For example, even when resources are in place in countries as far afield as Bangladesh and Uganda, health systems are unable to ensure that doctors show up to work, with absence rates ranging from 40% to 60%.45 And when they do, the services they provide are far below any acceptable standard.

We focus on one aspect of quality—effectiveness, or the degree to which patients receive timely and accurate diagnoses and evidence based treatments for their conditions.6 Other domains of quality, such as patient safety and patient centredness (table 1),8 are equally important. However, the effective provision of necessary services is foundational to the performance of health systems; a system that cannot accurately diagnose or manage patients will not deliver the improved health outcomes implicit in the UHC agenda.

Table 1

Essential elements of quality healthcare (adapted from Scott and Jha7)

View this table:

Assessing the evidence and identifying the problems

Our synthesis relies on recent studies of the quality of clinical practice and its determinants in low and middle income countries (LMICs). In the absence of administrative data sources or information from patient charts (which are rare or of doubtful quality in many of these countries), these studies have used surveys of healthcare providers (medical vignettes and standardised patients) to measure two related but separate things: what providers know about managing common medical conditions and how they actually practise in clinical settings (see appendix on bmj.com). Three key issues emerge from this evidence and are discussed below.

Without quality, access may be irrelevant

Health policy efforts often invest substantially in programmes that have the primary objective of increasing the use of healthcare services, such as the number of treatment episodes or health visits per patient. But emerging data suggest that this focus on getting people in the door may not lead to improved health.

We often begin with the assumption that a key feature of many health systems in LMICs is the lack of access to healthcare services. We measure access by counting the number and proximity of formal healthcare providers who work in official clinics. In reality, in many countries, people may have access to multiple healthcare providers with varying qualifications and connections to the formal healthcare sector. The average village in rural Madhya Pradesh—one of the poorest states in India—has 11 healthcare providers within 3 km of the village,9 most of whom have no formal training.10 However, informal providers are often not counted when assessing key measures of access such as the ratio of clinicians to patients.

In other countries, non-physician clinicians are an integral and sizeable part of the state machinery but are often excluded when assessing in human resources.1112 Studies that count all providers show that access to healthcare is often better than historically imagined in low resource settings. Official statistics that focus only on formal physicians per population miss this important point.

Given that access, more leniently defined, is less of a problem, where do the challenges lie? Primarily, it is the quality of care that patients receive when they access healthcare providers. Table 2 summarises the results of studies that use standardised patients—people recruited from local communities and extensively trained to present the same set of standard symptoms to multiple providers—to assess quality. The standardised patients presented with simple clinical conditions to ensure no disagreement on the correct diagnosis or treatment. This method facilitates a “blind audit” since the same clinical cases can be presented to providers with a wide range of training and qualifications.1314

Table 2

Key findings of studies using standardised patients1314151617

View this table:

In India, China, and Kenya most cases were incorrectly diagnosed, and, even using a very lenient definition, simple medical conditions were correctly managed a minority of the time. Although standardised patients in Kenya generally received higher quality care than those in India and China, 90% of angina presentations in Nairobi were still misdiagnosed as pneumonia.14 Across the board, studies find frequent misdiagnosis, overuse of antibiotics and other drugs, and underuse of inexpensive but potentially lifesaving diagnostics and therapies in both public and private sector clinics; all have serious repercussions for health outcomes and expenditure.

Poor quality is not unique to primary care. Another stark example is institutional childbirth. Incentive schemes to encourage women to deliver in public facilities increased the number of institutional deliveries in countries such as Malawi,18 India,1920 and Rwanda21 but did not improve child or maternal outcomes. Why not? It is not for the lack of availability of infrastructure and medicines. According to WHO surveys, lifesaving treatments for women giving birth are widely available and used in most health facilities across countries. However, the availability of these essential treatments is not associated with better maternal outcomes.22 Poor implementation, delays in diagnosis and treatment, and silos of care have been hypothesised to at least partly explain excessive mortality and morbidity.

Finally, the hypothesis that poor quality may be due to overwhelmed primary care providers who see too many patients and do not have the time to carefully evaluate or manage them may be incorrect. Clinical observation studies show that most primary care providers see too few patients, rather than too many (fig 1). The average healthcare provider working in a public clinic in rural India, who provides services that are free at the point of use, sees 5.7 patients a day, spending only three minutes with each. In Tanzania, Senegal, and rural Madhya Pradesh (India), doctors in public primary health clinics spend a mere 30 to 40 minutes a day seeing patients.

Fig 1
Fig 1

Total time spent by healthcare providers with patients over a day. The sample from Madhya Pradesh, includes 199 private providers (mostly untrained) and 119 providers in public clinics. The sample from Birbhum, is 256 providers in rural locations, most of whom are not formally trained. The survey from Vietnam is based on a representative sample of 214 commune health facilities (similar to primary health centres) and 171 district hospitals 231524

Qualifications do not equal clinical knowledge

Poor quality is often assumed to be due to the large number of informal (ie, untrained) providers. However, even fully trained providers with adequate access to infrastructure often fail to deliver high quality care. This weak link between qualifications and quality reflects two related but conceptually separate issues. Firstly, the quality of medical training varies considerably in many countries. Tests of medical knowledge among physicians and non-physician clinicians in India,25 Vietnam,23 Nigeria,26 Eastern Europe,27 and several countries in sub-Saharan Africa consistently show large variations in within country knowledge, with sizeable numbers of untrained, non-physician clinicians who are more knowledgeable than their fully trained counterparts.

Figure 2 documents adherence to a medically necessary checklist of questions about medical history and examinations for multiple conditions presented to doctors through medical vignettes in five sub-Saharan African countries. Although fully trained doctors are more likely than nurses to know what questions to ask and examinations to perform, there is considerable overlap between the distributions (fig 2). Within every country, the top 20-50% of nurses are more knowledgeable than the poorest performing 25% of doctors. Even between formally trained versus informally trained doctors, doctors with more formal education may only modestly outperform their informally educated peers (fig 3).

Fig 2
Fig 2

Variations in medical knowledge of medical officers (fully trained doctors) and nurses assessed by World Bank’s Service Delivery Indicators Survey. The boxes show 25th percentile, median, and 75th percentile adherence to condition specific checklist items for the common illnesses, with the whiskers giving the 10th and 90th percentiles

Fig 3
Fig 3

Relation between medical qualification and knowledge among doctors in Vietnam, as assessed by medical vignettes. The circles show the number of providers in each bin of 0.1 standard deviation across the entire distribution. The corresponding density plots (relative scale) are calculated from the underlying unbinned distributions23

The translation of qualifications to knowledge varies across countries. The mean Kenyan nurse is more knowledgeable than 21% of doctors in Kenya, 78% of doctors in Madagascar, 32% in Nigeria, 25% in Tanzania, and 63% in Uganda (fig 2). There are also wide differences across states in India: informal providers in high performing states like Tamil Nadu are more knowledgeable than fully trained doctors in low performing states like Bihar. The link between qualifications (training) and medical knowledge is surprisingly weak. It is therefore wrong to assume that populations with access to a fully trained doctor in Madagascar enjoy better care than populations with access to a fully trained nurse in Kenya.

Clinical knowledge often fails to translate into clinical practice

Medical knowledge is only loosely tied to actual clinical practice. Providing high quality clinical care requires both knowledge and effort, and when the average clinical interaction lasts 90 seconds, as it does in Delhi’s public sector or Vietnam’s district hospitals, medical knowledge often does not translate into high quality clinical interactions.28 A recent systematic review of consultation time, our best measure of effort, across 68 countries and 28 million consultations found that the average consultation “varied from 48 seconds in Bangladesh to 22.5 minutes in Sweden.” In most countries, consultation times averaged less than 10 minutes, and in 15 countries less than 5 minutes.29 Short consultation times were more prevalent in low income countries, even in contexts where doctors were seeing just a few patients a day.23

Short consultation times imply that even when doctors know what to do, they often fail to do it. There is a persistent, often sizeable, gap between what providers say they will do when faced with a hypothetical patient and what they actually do when they see such a patient (fig 4). Emerging evidence finds large “know-do” gaps in countries as diverse as Rwanda,31 Tanzania,32 India,28 China,30 and Vietnam.23 This know-do gap can be so large that the providers without any formal medical training can provide higher quality care than fully trained doctors.28

Fig 4
Fig 4

Differences between how providers said they would manage diarrhoea and turberculosis in clinical vignettes and what they actually did with standardised patients presenting with the symptoms in the vignettes (ORS=oral replacement solution, AFB=acid fast bacilli test, CXR=chest radiography) 131730

The idea that the medical profession “has special knowledge … and will self-regulate”33 has already been questioned.3435 We are learning that doctors are humans who operate within complex systems. Because they respond to incentives, the same doctors seem to provide more effort (and deliver higher quality care) in private clinics than in public ones, even when structural resources are held equal. In a Beijing hospital, when standardised patients presenting with viral pharyngitis told doctors they would purchase medicines from an external pharmacist (rather than the hospital pharmacy from which the prescriber receives a salary bonus), antibiotic prescriptions fell from 77% to 11%.36 This 66 percentage point difference suggests doctors knew that prescribing antibiotics was unhelpful but were swayed by financial incentives.

Potential solutions

We have focused on just one component of quality: effectiveness. Understanding whether similar patterns arise for safety and patient centred care is critical, although there is little reason to believe it would not. The data come from only around a dozen countries, but they include India and China, where a large proportion of the world’s poorest people live. Although standardised patients cannot fully capture all clinical scenarios (for practical and ethical reasons), the data that have emerged in recent years suggest the same patterns: big quality problems, a weak link between qualifications and knowledge, and a large gap between knowledge and practice. The evidence suggests that countries need to incorporate quality into their UHC plans at an early stage.

Whether efforts to achieve UHC will translate into better health outcomes depends on how we execute these efforts, and this in turn will determine whether we are able to move from a simple access oriented definition of UHC to truly effective UHC. Emerging data challenge models of care that assume that qualified providers in well resourced clinics guarantee quality. New approaches are needed to ensure that broader investments in healthcare actually lead to better health outcomes, especially for poorer people.

New approaches need to tackle systems that produce medical professionals who are poorly trained, undermotivated, and often assigned to clinics with no peers or mentors and insufficient patient volume to hone skills. These providers consequently leave many patients, particularly those with few resources, receiving care that is unhelpful and often harmful.

This will not be an easy process. But clear examples are emerging where these efforts are bearing fruit: mid-level providers who provide high quality care, whether they are anaesthesia assistants in rural Nepalese hospitals or nurses managing HIV care in large parts of Africa.373839 Initiatives to tackle the availability of doctors in rural areas can focus on non-physician providers and training them to be as good, if not better, at providing certain types of care.4041

Similarly, countries are realising that placing doctors in rural areas may mean that they see only few patients a day. An alternative is to bring patients from rural areas to urban centres with better facilities, as has been tried with considerable success using ambulance systems in India and medical buses in Brazil.4243

Unfortunately, there are other systematic design problems where our knowledge base remains low. For instance, evidence shows that when diagnosis and treatment are “bundled” so that healthcare providers can earn higher incomes by ordering tests or prescribing drugs, their tendency to do so increases.36 Breaking the link between diagnoses, drug sales, and laboratory tests can reduce unnecessary tests and drug usage. How to do so in an efficient manner, however, remains an open question.

Conclusion

Task shifting and new approaches to delivery are just two examples of the kind of innovation needed to achieve effective UHC. Reaching the goals of UHC requires not just more money, but better money. We need additional research and policy work that questions baseline assumptions and normative, or prescriptive, frameworks. We must understand the world as it is, not as we wish it to be. Healthcare providers may make errors, but they often make the same errors again and again, and therefore make “predictable” mistakes; these mistakes are indicative of a broken system. If this predictability is recognised and modelled in policies and strategies to improve global health, we can make important advances. Such recognition has the potential to transform how healthcare is delivered in low income contexts, ultimately improving the lives of billions.

Key messages

• Availability of health advisers is not the main problem in most countries

•Simply providing access to trained medical staff and facilities does not guarantee universal access to quality care

• A weak link between medical qualifications and medical knowledge implies that providers without any formal medical training can provide higher quality care than fully trained doctors

•In many countries large gaps exist between what doctors know and what they actually do

• New approaches are needed to tackle systems that produce medical professionals who are poorly trained, undermotivated, and underused

Footnotes

  • Contributors and sources: All authors contributed to the design of the manuscript as well as interpretation of the data. JD provided data for figures used throughout the piece. JD, LW, and RR drafted the manuscript. All authors then reviewed and provided comment. JD, LW and AJ received comments and updated the manuscript, after which all authors reviewed and provided feedback and, finally, approval. Mary Dixon Woods also provided substantive feedback throughout the development of the piece. The findings, interpretations, and conclusions expressed here are those of the authors and do not necessarily represent the views of the World Bank, its executive directors, or the governments they represent. Rifat Atun, Niek Klazinga, Fiona Godlee, Ed Kelley, Sheila Leatherman, and Sujatha Rao were part of the working group for the series.

  • Competing interests: We have read and understood BMJ policy on declaration of interests and have no relevant interests to declare.

  • Provenance and peer review: Commissioned; externally peer reviewed.

  • This article is part of a series commissioned by The BMJ based on an idea fromtheHarvard Global Health Institute.The BMJretained full editorial control over external peer review, editing, and publication. Harvard Global Health Institute paid the open access fees.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References

View Abstract