Cost effectiveness analysis of strategies for child health in developing countriesBMJ 2005; 331 doi: https://doi.org/10.1136/bmj.38652.550278.7C (Published 17 November 2005) Cite this as: BMJ 2005;331:1177
- Tessa Tan-Torres Edejer (), coordinator1,
- Moses Aikins, consultant2,
- Robert Black, professor3,
- Lara Wolfson, scientist4,
- Raymond Hutubessy, health economist4,
- David B Evans, director5
- 1Costs, Effectiveness, Expenditure and Priority Setting, Health Systems Financing, World Health Organization, Geneva, Switzerland
- 2JSA Consultants, Accra, Ghana
- 3Department of International Health, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD, USA
- 4 nitiative for Vaccine Research, World Health Organization
- 5Health Systems Financing, Evidence and Information for Policy, World Health Organization
- Correspondence to: T Tan-Torres Edejer
- Accepted 12 October 2005
Objective To determine the costs and effectiveness of selected child health interventions—namely, case management of pneumonia, oral rehydration therapy, supplementation or fortification of staple foods with vitamin A or zinc, provision of supplementary food with counselling on nutrition, and immunisation against measles.
Design Cost effectiveness analysis.
Data sources Efficacy data came from published systematic reviews and before and after evaluations of programmes. For resource inputs, quantities came from literature and expert opinion, and prices from the World Health Organization Choosing Interventions that are Cost Effective (WHO-CHOICE) database
Results Cost effectiveness ratios clustered in three groups, with fortification with zinc or vitamin A as the most cost effective intervention, and provision of supplementary food and counselling on nutrition as the least cost effective. Between these were oral rehydration therapy, case management of pneumonia, vitamin A or zinc supplementation, and measles immunisation.
Conclusions On the grounds of cost effectiveness, micronutrients and measles immunisation should be provided routinely to all children, in addition to oral rehydration therapy and case management of pneumonia for those who are sick. The challenge of malnutrition is not well addressed by existing interventions.
After the 1990 United Nations children's summit, 167 countries pledged to further intensify their efforts in child health and nutrition to meet a child related set of human development goals for the year 2000 (www.un.org/geninfo/bp/child.html). But by 2000, 10.6 million children were still dying yearly, most due to pneumonia, diarrhoea, and neonatal causes and, in sub-Saharan Africa, malaria as well.1 2 Malnutrition has been identified as an underlying cause in over 50% of cases,1 with zinc and vitamin A deficiencies contributing.1 3
In September 2000, 189 countries endorsed the UN millennium declaration, which set goals for human development by 2015 (www.who.int/mdg/en/). Millennium development goal 4 was specific to child health, aiming to have reduced mortality in children aged less than 5 by two thirds between 1990 and 2015. Other millennium development goals aimed at reducing poverty and malnutrition and improving access to safe water, sanitation, and air quality would also contribute to improving child health.4
Five years on, there is some, although uneven, progress, and if practice continues as usual until 2015, then many countries, particularly in sub-Saharan Africa and south Asia, will miss this goal.5 It is now incumbent on countries and the international community to reconsider if the resources currently used to improve child health are being used as effectively as possible, and what strategies would ensure that any new resources achieve the maximum benefit.
Some evidence already exists on the cost effectiveness of selected interventions aimed at improving child health in the developing world,6–8 but results have generally been based on interventions undertaken in isolation, without accounting for costs that can be shared across interventions or the impact of changing coverage on unit costs (for example, costs per child treated). In these new cost effectiveness analyses, the WHO Choosing Interventions that are Cost Effective (CHOICE) Millennium Development Goals Team standardised framework, methods, and tools9–11 are used for selected interventions for major causes of childhood morbidity and mortality. They allow combinations of interventions to be analysed at the same time and the impact of increasing coverage to be incorporated explicitly. Full details of the methods are published in the paper by Evans et al of this series.9–11
We evaluated nine single interventions, each at three levels of coverage (50%, 80%, and 95%), and various combinations thereof. The single interventions evaluated are oral rehydration therapy; case management of pneumonia; supplementation and fortification with vitamin A or zinc; provision of supplementary food during weaning, with counselling on nutrition (with and without growth monitoring and targeting); and measles immunisation. See annex A on bmj.comfor a detailed description of the individual interventions.
We analysed the prevented cases and deaths due to pneumonia, diarrhoea, and measles in the under 5s age group. These are converted to the number of disability adjusted life years (DALYs) averted. We obtained data on epidemiological rates by region and health state valuations primarily from the year 2000 update on burden of disease, supplemented by other published literature.12 13 Children with nutritional comorbidities have a higher risk of diarrhoea and pneumonia and dying from these diseases than do other children. We obtained relative risks from systematic reviews14–16 and we applied these to the relevant epidemiological rates for the specific subpopulations (table 1).
For case management of pneumonia17 and supplementation with vitamin A or zinc,15–19 we obtained data on efficacy from systematic reviews with meta-analysis of numerous large community based trials in several developing countries. The estimate of effectiveness for oral rehydration therapy came from before and after evaluations of national diarrhoea control programmes in two countries. These reports were selected as being of high quality because quantitative and qualitative analyses were undertaken to isolate the impact of oral rehydration therapy from other interventions occurring at the same time.20 21 The estimate of effectiveness for provision of supplementary feeding and nutrition counselling came from a systematic review of several efficacy trials and evaluations of larger scale programmes.22 Although growth monitoring and promotion has not been shown to be effective by itself,23 we used it in this analysis for identifying children to be targeted for provision of supplementary food.
Data for vitamin A fortification came from a report on several programmes in Central America.24 In the absence of experience with national programmes on zinc fortification, we modelled its effectiveness relative to zinc supplementation at about the same level of vitamin A supplementation relative to fortification. For measles immunisation, we used an 85% seroconversion or vaccine efficacy rate.25 26 To model more realistically the attainable effectiveness outside research settings, we multiplied estimates of efficacy by an estimate of patient adherence to the therapy or, in the case of fortification, access to processed food (table 2).
We adopted the standardised WHO ingredients approach, with separate specification of units of utilisation and costs.10 Utilisation rates and unit costs were derived from the literature, unpublished data, and expert opinion (see paper by Evans et al in this series for a description of the methods; table 3).7 27–29 All costs are summarised in international dollars ($Int), with 2000 as the base year and future costs discounted at 3%. The cost effectiveness ratios in this analysis are relatively higher than those in the literature because of the use of international dollars. International dollars are derived by dividing local currency units by an estimate of their purchasing power parity compared with a US dollar. Purchasing power parities are the rates of currency conversion that equalise the purchasing power of different currencies by eliminating the differences in price levels between countries.
Cost effectiveness analysis
For our analysis we assumed that interventions run for 10 years, after which time managers re-evaluate their strategies. This means that costs are incurred for only 10 years. However, any improvements in health that accrue because of the activities in those 10 years are included, regardless of when they occur.
To be able to assess the cost effectiveness of the current mix of interventions, we first compared interventions with a scenario of doing nothing to improve child health from today.11 If more resources are available, the decision whether to add a new intervention or to expand the first intervention is made on the basis of the incremental cost effectiveness ratio compared with the first intervention, and this sequential comparison is continued until there are no more additional health gains. This maps out the expansion path.
We carried out a sensitivity analysis to enable reporting of results with or without 3% discounting for DALYs and with or without age weighting.
Results for the full set of interventions by region are available at www.who.int/choice. Consistent with all papers in this series, we present the results for two regions, both consisting of countries with high rates of child mortality.11 Sear-D is in South East Asia and Afr-E in sub-Saharan Africa.
The highest costs at the population level are those for the provision of supplementary food and nutrition counselling, but targeting food supplementation through growth monitoring and promotion cuts costs by 40% in Sear-D and about 52% in Afr-E. Fortification programmes are the least costly, and fortification with zinc or vitamin A costs between 5% and 30% of the costs of supplementation. The total population costs for case management of pneumonia are lower than that for oral rehydration therapy because there are fewer episodes of pneumonia than there are of diarrhoea.
The proportion of patient level costs for interventions aimed at the individual range from about 80% to 99% of the total costs because most of the interventions are directed to the individual and not to the population. The bulk comes from commodities (drugs, supplementary food), outpatient visits, and hospital days. These costs increase almost linearly with increasing coverage. Because of the relatively small proportion of programme to total costs for almost all interventions except for fortification, there is limited potential to spread them across a larger number of recipients, so the unit cost of interventions is not observed to fall with increases in coverage.
In general, higher population health gains are obtained from case management of pneumonia, oral rehydration therapy, and measles immunisation, followed by the nutritional interventions. Supplementation averts more DALYs than does fortification, primarily because of the limited access in some areas to processed food. Combinations of interventions produce additive or near additive gains, with the highest health gains achieved with a bundle of interventions that includes oral rehydration therapy, case management of pneumonia and diarrhoea, measles immunisation, vitamin A and zinc supplementation, the provision of supplementary feeding, and nutrition counselling.
Tables 4 and 5 report the costs and effects of the most cost effective set of interventions in Afr-E and Sear-D, respectively. Figures 1 and 2 summarise these results. The expansion path—the bold line joining the points at the lower right of the figures—shows the interventions that would be chosen on purely cost effectiveness grounds for any level of resource availability.
For both Sear-D and Afr-E, the expansion path starts with some form of micronutrient fortification—that is, using vitamin A or zinc, followed by measles immunisation in Afr-E and then by case management of pneumonia and oral rehydration therapy. In Sear-D, oral rehydration therapy and measles immunisation follows closely after the case management of pneumonia. A shift occurs from fortification to supplementation at higher resource levels because, even if supplementation is more costly than fortification, a greater potential exists for health gain. The cost effectiveness of the interventions included in this set is either one or two orders of magnitude lower than those of the provision of supplementary food and nutrition counselling.
Removal of age weighting and discounting for DALYs increases the health gains and makes the interventions more cost effective. It does not change the ordering in either region.
Cost effectiveness ratios vary across regions depending on the local epidemiology and existing cost structures. Despite this, there are enough similarities in the expansion paths in Sear-D and Afr-E (consisting of countries in South East Asia and sub-Saharan Africa with high rates of child mortality) to allow for some generalisations. At one extreme, fortification with vitamin A or zinc is very cost effective; provision of supplementary feeding with nutrition counselling is at the high end; and vitamin A or zinc supplementation, oral rehydration therapy, case management of pneumonia, and measles immunisation are in between.
Many countries have already made available oral rehydration therapy for diarrhoea, case management of pneumonia, and measles immunisation. These interventions achieve the largest health gains by an individual intervention, and the question is whether these should be scaled up further or if there are more cost effective choices. Purely on cost effectiveness grounds, countries should first consider fortification with micronutrients or supplementation with vitamin A or zinc.
Fortification seems to be a particularly cost effective option because it allows the possibility of fortifying a food staple with multiple micronutrients, not just those under discussion in this paper. In this analysis, the cost of fortification was based on adding the micronutrient to different food staples that would reach the entire population. In the analysis, however, we included only the benefits obtained in the under 5s age group. Furthermore, for both supplementation and fortification, we included only the impact on childhood pneumonia and diarrhoea even though provision of these micronutrients may also have a beneficial effect on malaria in children in sub-Saharan Africa and other causes of mortality in the under 5s age group.15 16 On the one hand this suggests that our estimates of the cost effectiveness of micronutrient interventions are conservative. On the other hand it might not be feasible to find suitable processed food that young children will eat or there may be constrained access to processed food by people living in remote areas or by the poor, which would bias the results in the opposite direction.
In terms of costing, all interventions except micronutrient supplementation were assumed to be delivered in health facilities. When some types of treatment for diarrhoea and pneumonia and the provision of micronutrient supplements could be provided in the community by trained non-health professionals, costs would be lower as would the cost effectiveness ratios, making our estimates conservative. Alternatively, measles immunisation can be delivered in national outreach activities or campaigns, but these delivery strategies are in general more costly than facility based interventions and will decrease the cost effectiveness of this intervention, unless other types of health interventions such as distribution of insecticide treated nets are piggy backed on immunisation campaigns.30
Because of different types of uncertainty, the results should be considered in bands of cost effectiveness. In both regions, fortification and supplementation with vitamin A or zinc and case management of pneumonia, oral rehydration therapy, and measles immunisation cost about $Int100 per DALY averted. Along similar lines, the cost effectiveness ratio for food supplements with nutrition counselling is several orders of magnitude more than these interventions. Accordingly, the outlines for policy recommendations at the beginning of this section still hold despite the uncertainty—on purely efficiency grounds, fortification or supplementation with vitamin A or zinc, treatment of pneumonia and diarrhoea, and measles immunisation should be pushed to their highest possible levels before supplementation of food along with nutrition counselling is provided.
It is envisioned that analysts in countries will contextualise these results to their own settings and that policy makers can consider changing their investment decisions if so indicated.31 In figure 3, two districts in Tanzania have shown that, after considering the existing burden of disease, changing the allocation of health resources, and effectively implementing cost effective interventions (mostly aimed at the under 5s age group), they can achieve considerable health gains, including a 40% drop in child mortality in five years.32
Our analysis presents cost effectiveness information on an initial set of interventions tackling pneumonia and diarrhoea, the two major causes of death in children aged under 5. Measles has also been included because it is specified as a target for millennium development goal 4. The absence of other interventions does not imply that these are not cost effective. Some interventions, such as treatment of malaria, use of insecticide treated nets, and promotion of breast feeding have been analysed in other papers in this series. Further reports will be completed in the future—such as for pneumococcal, haemophilus influenzae, and rotavirus immunisations—when more data on efficacy and region specific information on causes are available.
Progress in the other millennium development goals, such as the reduction of poverty and improvements in safe water, sanitation, and indoor air quality, will also impact on child health. People interested in public health could also engage in intersectoral action to encourage these developments. This is particularly true in the area of malnutrition, where it is striking that the health sector intervention we analysed is relatively cost ineffective, primarily because of the limited effectiveness of behaviour change interventions and the cost of providing ready to eat food supplements. Interventions to reduce poverty may, however, provide a more sustainable solution to malnutrition, although progress in reducing poverty might prove to be a more intractable goal than reducing child mortality.33 With malnutrition being an underlying cause of almost half of the deaths in children aged under 5, there is an urgent health research agenda to find more effective and less costly ways of ensuring availability of food to young infants and children. This is potentially the weakest point in the child survival strategy.
The availability and scaling up of technological solutions such as antibiotics, oral rehydration therapy, vaccines, and, in particular, micronutrient supplements have a great potential in reducing child mortality. Major challenges in the achievement of the millennium development goal 4 will be to find a sustainable intersectoral solution to reducing malnutrition in children and tackling the root causes of poverty, lack of education, and sex inequality.
What is already known on this topic
Many countries are not on track to meet the millennium development goal for child health of reducing child mortality by two thirds
Malnutrition remains an underlying cause in half of the deaths in children
Interventions of proved effectiveness exist
What this study adds
Child health interventions to reduce mortality are not only effective but cost effective
More resources could be allocated to interventions tackling underlying causes; specifically to scale up micronutrient provision and to find intersectoral solutions for malnutrition
Failure to tackle malnutrition in a sustainable way is a potential weakness in the child survival strategy
Additional tables and descriptions of the interventions are on bmj.com
Contributors TT-TE wrote the paper and carried out the effectiveness analysis. MA did the costing for all interventions except for measles immunisation. LW and RH calculated the incidence rates and costs of measles immunisation, respectively, at different levels of coverage. DBE and TT-TE helped to develop the methods and apply them to this problem. DBE and RB provided references, critiqued the work, and helped revise the manuscript. Ben Johns, Taghreed Adam, and Rob Baltussen helped produce the cost estimates for WHO-CHOICE. Jeremy Lauer, Dan Chisholm, and Yunpeng Huang assisted with the PopMod runs. Chika Hayashi provided the first template on effectiveness. Taghreed Adam, Dan Chisholm, and Stephen Lim assisted in finalising figures and tables and in checking versions of the manuscript. Margaret Squadrani and Marilyn Vogel assisted in referencing. Data and feedback were given by the Child Health and Development Unit in WHO. Chris Murray provided general guidance and critiqued earlier versions of the paper. TT-TE is guarantor. The opinions in this paper are those of the authors and not necessarily those of the institutions they represent.
Competing interests None declared.
Ethical approval Not required.