Cost effectiveness of strategies to combat vision and hearing loss in sub-Saharan Africa and South East Asia: mathematical modelling studyBMJ 2012; 344 doi: http://dx.doi.org/10.1136/bmj.e615 (Published 02 March 2012) Cite this as: BMJ 2012;344:e615
- 1Department of Primary and Community Care, Radboud University Nijmegen Medical Center, PO Box 9101 6500HB Nijmegen, The Netherlands
- 2Centre for Disability and Development, London School of Hygiene and Tropical Medicine, London, UK
- Correspondence to: R Baltussen
- Accepted 12 October 2011
Objective To determine the relative costs, effects, and cost effectiveness of selected interventions to control cataract, trachoma, refractive error, hearing loss, meningitis and chronic otitis media.
Design Cost effectiveness analysis of or combined strategies for controlling vision and hearing loss by means of a lifetime population model.
Setting Two World Health Organization sub-regions of the world where vision and hearing loss are major burdens: sub-Saharan Africa and South East Asia.
Data sources Biological and behavioural parameters from clinical and observational studies and population based surveys. Intervention effects and resource inputs based on published reports, expert opinion, and the WHO-CHOICE database.
Main outcome measures Cost per disability adjusted life year (DALY) averted, expressed in international dollars ($Int) for the year 2005.
Results Treatment of chronic otitis media, extracapsular cataract surgery, trichiasis surgery, treatment for meningitis, and annual screening of schoolchildren for refractive error are among the most cost effective interventions to control hearing and vision impairment, with the cost per DALY averted <$Int285 in both regions. Screening of both schoolchildren (annually) and adults (every five years) for hearing loss costs around $Int1000 per DALY averted. These interventions can be considered highly cost effective. Mass treatment with azithromycin to control trachoma can be considered cost effective in the African but not the South East Asian sub-region.
Conclusions Vision and hearing impairment control interventions are generally cost effective. To decide whether substantial investments in these interventions is warranted, this finding should be considered in relation to the economic attractiveness of other, existing or new, interventions in health.
Throughout the world, loss of vision and hearing are a major burden. More than 284 million people are visually impaired, of whom 245 million have low vision and 39 million are blind.1 Some 278 million people worldwide have moderate or greater hearing impairment.2 3 4 5 The number of people worldwide with sensory deficits is rising mainly due to a growing global population and longer life expectancies. More than 90% of the world’s visually impaired people and 80% of hearing impaired people live in low and middle income countries.1 6
Cataract is the leading cause of visual impairment globally, followed by glaucoma. The most common type of hearing impairment is sensorineural hearing loss (with common causes advanced age and noise exposure), followed by conductive hearing impairment (with leading cause chronic otitis media). Globally, up to 75% of all vision loss and 50% of hearing loss is avoidable.1 6
For this reason, global initiatives have set targets and indicators related to the reduction of vision and hearing impairment, with special reference to low and middle income countries. VISION 2020, the global initiative for the elimination of avoidable blindness, aims to eliminate avoidable blindness by the year 2020 and prevent the projected doubling of avoidable visual impairment between 1990 and 2020.7 WWHearing (World-Wide Hearing Care for Developing Countries) aims to eliminate much of avoidable hearing loss by 2020 through a new initiative called Audio 2020.8
For many countries, it is not evident that these targets will be achieved at current rates of progress, despite a wide range of effective interventions to prevent, detect, and manage visual and hearing impairment. A key question, therefore, is whether the correct mix of interventions is currently being used, and what strategies should be scaled up if additional funds would become available. Cost and cost effectiveness analyses can provide valuable inputs to these decisions by identifying the most efficient ways of delivering prevention, diagnosis, and treatment services at different levels of resource availability.
Several studies have reported on the global and regional cost effectiveness of interventions targeting cataract,9 trachoma,10 refractive error,11 and different causes of hearing impairment.12 However, studies have been carried out in isolation, which prevents the cost effectiveness of the different interventions being directly compared. In addition, the studies used demographics and price levels for the year 2000.
Now, a decade past 2000, and in the realm of the global initiatives, an up to date assessment of the cost effectiveness of vision and hearing impairment control strategies is needed. In this paper we address the question of what are the costs and effects of prevention, early detection, management, and rehabilitation of visual and hearing impairment, both singly and in combination. Our analysis is based on a consistent methodological approach and a generic measure of effectiveness and covers two geographical settings, in Asia and Africa.
Cost effectiveness analysis can be undertaken in many ways, and there have been several attempts to develop methodological guidelines to make results more comparable. In its WHO-CHOICE project, the World Health Organization has developed a standardised set of methods and tools that can be used to analyse the societal costs and effectiveness of current and possible new interventions simultaneously.13 14 The project is designed to provide regularly updated databases on the costs and the effects of a full range of promotive, preventive, curative, and rehabilitative health interventions.
Most countries do not have the capacity to evaluate all potential interventions for improving given health indicators at the national and the sub-national level, and global estimates are too general and of little use to any specific country. However, countries may benefit from regional evaluations of data, where data of neighbouring countries with similar settings are pooled. The present analysis drew on a comprehensive examination of 14 world sub-regions defined by geographical proximity and epidemiology according to WHO classification. In common with other papers in this series, we evaluated interventions for two major global regions using a standardised analytical approach. The two regions are referred to as sub-Saharan Africa, including those African countries with very high adult and high child mortality (referred to as AfrE in the WHO classification), and South East Asia, including those countries in Asia with high adult and high child mortality (referred to as SearD).15 The prevalence of vision and hearing impairment globally and for these two regions is summarised in table 1⇓ (based on Resnikoff et al16 17 and Mathers18).
Table 2⇓ shows the set of 87 analysed interventions (and combinations of interventions) to control cataract, trachoma, refractive error, hearing loss, meningitis, or chronic otitis media. We carefully selected the interventions on their relevance for disease control but were also limited by the lack of data on burden of disease or intervention effectiveness. Some interventions that have relatively recently been developed were not subjected to analyses. The resulting set of interventions is therefore somewhat arbitrary and not meant to cover all potentially available interventions to reduce hearing and vision loss in sub-Saharan Africa and South East Asia. For example, in trachoma control we evaluated antibiotic treatment and surgery but not promotion of face washing. Likewise, in cataract control, we evaluated extracapsular cataract extraction but not small incision cataract surgery or phacoemulsification. In control of hearing impairment, we did not evaluate education, rehabilitation, and noise conservation programmes, nor neonatal screening, surgical interventions, or cochlear implants. Interventions on glaucoma were also not evaluated. All interventions are defined in appendix A on bmj.com.
All interventions were analysed at WHO-CHOICE standardised geographic coverage levels of 50%, 80%, and 95%, referring to the percentage of eligible cases receiving treatment. These levels may not always be feasible, but are nevertheless reported here to show the presence of important (dis)economies of scale when varying the number of people covered.
Estimating health effects
The starting point of our analysis of health effects was the identification of best available evidence on the (clinical or population) effectiveness of interventions. Ideally, we retrieved this evidence from Cochrane reviews (such as on the effectiveness of cataract surgery), but in other instances we used evidence from individual studies (such as on the effectiveness of azithromycin in trachoma control). Where no evidence was available, we based our estimate of effectiveness on expert opinion (such as on levels of compliance in wearing hearing aids or glasses). We used evidence on intervention effectiveness pertaining to the regions under study or extrapolated this from Western settings where meaningful (as for antibiotic treatment for meningitis). All sources of data of intervention effectiveness for screening interventions for uncorrected refractive error are listed in table 3⇓, and those for the other disease areas are listed in the appendices on bmj.com.
All analyses used population model PopMod19 to translate this intervention effectiveness into a generic measure of health effects. More specifically, it combines incidence, prevalence, and mortality data for the relevant causes of vision and hearing impairment with the standard health state valuations20 to estimate the population impact of the different scenarios in terms of healthy years lived.14 Following standardised WHO-CHOICE cost effectiveness analysis, we evaluated all interventions for a period of 10 years, and ran model for the length of time necessary for all people affected by the interventions to have died (that is, some 100 years in both regions, following the use of regional mortality rates18). The difference between the healthy years lived in each intervention scenario and the no intervention scenario is the health gain of the intervention, or the number of disability adjusted life years (DALYs) averted. A general description of the population model is provided in the general appendix on bmj.com, and details of the different disease models are available in appendix A on bmj.com.
The analysis follows standardised WHO-CHOICE guidelines on costing analysis, and estimates patient level costs and programme level costs from the societal perspective. Patient level costs are all costs incurred at the level of contact between the provider and the individual patient. The quantities of resources required in terms of diagnostic tests, drug use, and health centre visits for supervision and monitoring and hospitalisation for each of the interventions were based on WHO treatment protocols and expert opinion of actual practice. Drug costs were based on international drug prices21 with a mark up for international and local transportation costs.22 23 Unit costs of health centre visits and hospital inpatient days were based on econometric analysis by Adam et al,24 while those for laboratory tests and x rays were based on the best available international cost information included in WHO-CHOICE’s costing database. Unit costs were combined with resource use patterns to estimate the cost per patient treated. Total patient costs were then calculated as the cost per patient treated multiplied by the number of patients treated (calculated as the annual incidence of disease from the model multiplied by the relevant coverage level and then by the percentage of cases diagnosed and treated in covered areas). The costs of screening interventions to detect hearing and vision impairment not only include the costs of the screening activities but also costs of hearing aids and glasses for those who need them.
Programme level costs relate to the resource inputs used in the production of an intervention at a level above that of the patient or providing facility, such as central planning and administration functions, supervision, and training. Estimated quantities of resources required for central planning and administration at national, provincial and district levels were based on a series of evaluations made by WHO-CHOICE costing experts in the different sub-regions and validated against the literature (categories of resource input included personnel, training, materials and supplies, media, transport, maintenance, utilities and capital.22 Details of all cost calculations are found in appendix A on bmj.comand previously published papers.9 10 11 12 An example of all variable inputs including its sources is provided in table 3⇑, for the cost effectiveness analysis of screening strategies for uncorrected refractive error among schoolchildren in sub-Saharan Africa.
Following the WHO-CHOICE standardised approach, we assumed that interventions were performed optimally (that is, no undertreatment or overtreatment at the highest efficiency level).14 All costs were reported in international dollars ($Int) for the year 2005 to facilitate more meaningful comparisons across regions ($Int1 buys the same quantity of healthcare resources in the sub-Saharan African and South East Asian regions as it does in the United States). For example, cost estimates in sub-Saharan Africa in $Int should be divided by a factor 2.3 to obtain US$ cost estimates for Kenya (in South East Asia cost estimates should be divided by a factor 3.1 to obtain US$ cost estimates for India).15 All costs and effects are discounted at 3%, following standardised WHO-CHOICE analysis.14
Estimating cost effectiveness
We rank ordered interventions on the basis of their cost effectiveness in a number of standardised steps.14 Firstly, within each disease area, we calculated the average cost effectiveness ratios for every intervention by dividing its total number of DALYs averted by its total costs. Secondly, again within each disease area, we considered only those interventions that were both more effective and less costly than other interventions. We then calculated the incremental cost effectiveness ratio for those resulting interventions by dividing the incremental costs by the incremental health effects. The economic attractiveness of an intervention within its disease area is reflected by this incremental cost effectiveness ratio: the lower the incremental cost per DALY averted, the more economically attractive an intervention is. Thirdly, we compared resulting interventions across disease areas on the basis of their incremental cost effectiveness ratios and ranked them accordingly. The interventions with the lowest incremental cost effectiveness ratio are ranked highest and are economically most attractive.
WHO-CHOICE defines interventions that have an incremental cost effectiveness ratio of less than the gross domestic product (GDP) per capita as very cost effective, and those with a ratio less than three times the GDP per capita as cost effective. The regions studied here have a GDP of around $Int2000 per capita,30 which means that interventions costing <$Int2000 per DALY averted can be considered very cost effective and those costing between $Int2000 and $Int6000 can be considered cost effective. Other interventions are considered not cost effective.
All interventions are imbued with a certain degree of uncertainty. To handle this aspect of reporting for such a wide range of interventions, we classified interventions according to their degree of cost effectiveness (not cost effective, cost effective, or very cost effective) in order to ascertain order of magnitude differences in cost effectiveness. In addition, we undertook a probabilistic uncertainty analysis using MCLeague software31 to assess the impact of alternative assumptions on costs and effects (which were each varied with plus and minus 25% of their baseline values) on the classification of interventions.
A few modifications were made to previously published analyses.9 10 11 12 Firstly, interventions were considered during the 10 year period 2005to 2015 rather than the period 2000–10, and costs were reported at price levels for year 2005 instead of 2000. Secondly, because of variations in the reporting of coverage levels in previous studies, interventions were evaluated at standardised geographic coverage levels of 50%, 80%, and 95%. Thirdly, assumptions on screening, patient, training, and intervention programme costs were revisited to make results consistent across the analysis. For example, recent price reductions of azithromycin after patent expiry were included in the analysis on trachoma control.
Following the stepwise approach to the rank ordering of interventions on the basis of their cost effectiveness, we first report the average cost effectiveness ratios of all interventions within each disease area (appendix table B1 on bmj.com).
Second, we report the incremental cost effectiveness ratios for those interventions that both cost less and provide more health effects than other interventions, and these indicate the economic attractiveness of interventions within each disease area (same table).
In trachoma control, trichiasis surgery is the most cost effective intervention, followed by mass treatment with azithromycin in both regions. Both mass treatment with tetracycline ointment and targeted treatment with azithromycin are not cost effective. In cataract control, extracapsular cataract surgery dominates intracapsular surgery in both regions. In both regions, passive screening of children and adults for hearing disorders (in combination with provision of hearing aids) is most cost effective, followed by screening of adults every five years and annual screening of primary and secondary school children. Screening of adults every 10 years is not cost effective. For treatment of chronic otitis media, treatment with topical antibiotics is the most cost effective intervention in both regions. For screening for refractive error (including the provision of spectacles), screening of all primary and secondary school children is most cost effective in sub-Saharan Africa. In South East Asia, screening of secondary school children is most cost effective, followed by screening of both primary and secondary school children.
In a third step, we rank interventions according to their incremental cost effectiveness ratio across all disease areas (tables 4⇓ and 5⇓ for sub-Saharan Africa and South East Asia). This is illustrated in the figure⇓ for sub-Saharan Africa. Implementation of all cost effective interventions would cost around $Int19 per capita in sub-Saharan Africa.
In both regions treatment of chronic otitis media with topical antibiotics is the most cost effective intervention, with an average cost per DALY averted of <$Int63 at all levels. In sub-Saharan Africa the next most cost effective interventions are trichiasis surgery, extracapsular cataract surgery, annual screening of all primary and secondary school children for refractive error, and treatment for meningitis with ceftriaxione. In South East Asia the next most cost effective interventions are treatment of meningitis with ceftriaxione, extracapsular cataract surgery, screening of all primary and secondary school children for refractive error, and trichiasis surgery. In both regions these interventions all cost <$Int285 per DALY averted (incremental cost effectiveness ratio, with the exact order of interventions dependent on coverage level). In both regions introducing screening for hearing impairment in combination with the delivery of hearing aids, at 80% coverage level costs around $Int1000 per DALY averted. According to WHO-CHOICE benchmark on cost effectiveness, these interventions can all be considered very cost effective. Mass treatment with azithromycin is the least cost effective intervention in both regions but can, depending on the coverage level, still be considered cost effective in the sub-Saharan African region. In the absence of any budgetary constraint implementation of all interventions would lead to a total health gain of up to 32 million DALYs in sub-Saharan Africa and 84 million DALYs in South East Asia.
The probabilistic uncertainty analysis depicted in appendix C on bmj.com shows the impact of plausible variations in total costs and total effects and shows that the average cost effectiveness ratios of most interventions would retain their classification of highly cost effective or cost effective after taking into account such uncertainty. A similar logic would apply to the incremental cost effectiveness ratio.
Treatment of chronic otitis media, extracapsular cataract surgery, trichiasis surgery, treatment for meningitis, and annual screening of school children for refractive error are among the most cost effective interventions available to control hearing and vision impairment, with the cost per DALY averted <$Int285 in both regions. Screening of both schoolchildren (annually) and adults (every five years) for hearing loss costs around $Int1000 per DALY averted. These interventions can be considered highly cost effective. Mass treatment with azithromycin to control trachoma can be considered cost effective in the sub-Saharan African but not the South East Asian region.
Strengths and limitations
The analysis has several limitations. Firstly, we performed our analysis at the regional level, but important differences in costs or effectiveness of interventions may exist between countries in the same region. Since decision making is made at the country (as opposed to regional) level, more refined estimates of costs, effects, and cost effectiveness should be made at the country level, based on country-specific data. A good example is the contextualisation of WHO-CHOICE regional results to the country level in Mexico, as reported in this series.32
Secondly, assumptions on intervention effectiveness are based on a variety of sources and may reflect contexts other than the regions analysed—the same level of effectiveness may not always be realised in reality, and results should be interpreted with caution. Yet, our probabilistic uncertainty analysis indicates that our study results are robust to alternative assumptions. These issues are discussed in detail in previously published papers.9 10 11 12
Thirdly, we did not evaluate all possible interventions that could reduce vision or hearing loss, and our choice of interventions is somewhat arbitrary. Policymakers should be aware of this, and should not limit their choice of interventions to those included in this analysis.
Fourthly, and more specifically, we evaluated screening for hearing disorders as carried out by trained primary health workers (incurring healthcare costs), and screening for refractive error as carried out by trained school teachers (who incur no healthcare costs). However, alternative assumptions have only limited impact on study results.
Fifthly, in the absence of reliable data, we did not include time costs of people seeking and undergoing care, nor did we include changes in productivity losses as a result of the interventions. The perspective of analysis is therefore not truly societal. Inclusion of productivity gains after reductions in vision and hearing loss would render the interventions more cost effective.
Sixthly, we assumed that all interventions were implemented at a relatively high efficiency level—which allows an equal comparison between the cost effectiveness of interventions and avoids the complications from interventions that were not implemented well would be disadvantaged in comparison with those that were well implemented.
Lastly, the analysis evaluates interventions at 50%, 80%, and 95% geographic coverage levels, following standardised WHO-CHOICE methodology. The higher coverage levels may not always be achievable but are included to indicate the economies of scale that may take place when more people are reached with an intervention.23
The above limitations should be considered in the overall aim of WHO-CHOICE analysis to provide broad indications on the cost effectiveness of a range of interventions to inform general policy discussions, rather than to deliver precise estimates on a specific intervention.15
Study strengths include the use of disease models that have already been published and applied, consideration of combinations of interventions, use of a generic measure of effectiveness, and testing of important assumptions through sensitivity analyses.
Comparison with other studies
This study includes a number of modifications in comparison to the previously published analysis. The higher 2005 price levels have generally resulted in higher cost effectiveness ratios, but these and other modifications have generally not changed study conclusions. The exception is mass or targeted treatment with azithromycin in trachoma control, where price reductions of azithromycin have offset general price increases in the period from 2000 to 2005 and have thus rendered the interventions more cost effective.
Our results have four major policy implications. Firstly, they reinforce the fact that cataract surgery and treatment of chronic otitis media are among the key interventions for combating vision and hearing impairment.
Secondly, they show that there is a strong economic case to consider screening for refractive error among schoolchildren. This supports current efforts within the VISION 2020 initiative to give greater prominence to screening programmes. Screening schoolchildren and adults for hearing disorders is somewhat less cost effective but is still economically attractive according to commonly used benchmarks.
Thirdly, inclusion of mass treatment with azithromycin in programmes to eliminate trachoma needs careful analysis: although the intervention was cost effective in sub-Saharan Africa according to commonly used benchmarks, it was not in South East Asia. However, many programmes around the world use donated azithromycin, which makes the intervention economically more attractive than we have reported here. In our analysis, trichiasis surgery is more cost effective and thus provides better value for money.
Fourth, our results show that substantial health gains can be achieved—up to 32 and 84 million DALYs averted in sub-Saharan Africa and South East Asia respectively, when available effective interventions are scaled up. This will require major resource mobilisation efforts at domestic and international level. Yet, whether such substantial investments are warranted can only be judged when the findings our present study—that vision and hearing impairment control interventions are generally cost effective—are considered in relation to the economic attractiveness of other, existing or new, interventions in health. For this broader analysis, we refer to Evans et al15 and Chisholm et al,33 who compare the economic attractiveness of a wide range of interventions to control, respectively, communicable and non-communicable diseases.
What is already known on this topic
Several studies have reported on the global and regional cost effectiveness of interventions targeting cataract, trachoma, refractive error and different causes of hearing impairment.
However, studies have been carried out in isolation, which prevents the cost effectiveness of the different interventions in visual and hearing impairment control being directly compared.
In addition, these studies have been analysed using year 2000 demographics and price levels
What this study adds
This study directly compares cost and effects of interventions targeting cataract, trachoma, refractive error and different causes of hearing impairment, using more recent price levels in Sub-Saharan Africa and South East Asia
This allows the identification of most efficient strategies to reduce vision and hearing loss
Cite this as: BMJ 2012;344:e615
Contributors: Both authors contributed to the conception, design and interpretation of data, and drafting of the manuscript. RB performed the technical analysis. Both authors approved the submitted version of the manuscript. RB is the guarantor of the manuscript.
Competing interests: All authors have completed the Unified Competing Interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Ethical approval was not required for this study.
Data sharing: No additional data available
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.