Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Published 2 July 2009, doi:10.1136/bmj.b2434
Cite this as: BMJ 2009;339:b2434
Kara Hanson, reader 1, Tanya Marchant, lecturer1, Rose Nathan, senior scientist2, Hadji Mponda, scientist2, Caroline Jones, senior lecturer1, Jane Bruce, research fellow1, Hassan Mshinda, former director, director general 2,3, Joanna Armstrong Schellenberg, reader1
1 London School of Hygiene and Tropical Medicine, London WC1E 7HT, 2 Ifakara Health Institute, Mikocheni, Dar es Salaam, Tanzania , 3 Tanzania Commission for Science and Technology, Dar es Salaam, Tanzania
Correspondence to: K Hanson kara.hanson{at}lshtm.ac.uk
Design Plausibility study using three nationally representative cross sectional household and health facility surveys, timed to take place early, mid-way, and at the end of the roll out of the national programme.
Setting The Tanzania National Voucher Scheme was implemented in antenatal services, and phased in on a district by district basis from October 2004 covering all of mainland Tanzania in May 2006.
Participants 6115, 6260, and 6198 households (in 2005, 2006, and 2007, respectively) in a representative sample of 21 districts (out of a total of 113).
Interventions A voucher worth $2.45 (£1.47,
1.74) to be used as part payment for the purchase of a net from a local shop was given to every pregnant woman attending antenatal services.
Main outcome measures Insecticide treated net coverage was measured as household ownership of at least one net and use of a net the night before the survey. Socioeconomic distribution of nets was examined using an asset based index.
Results Steady increases in net coverage indicators were observed over the three year study period. Between 2005 and 2007, household ownership of at least one net (untreated or insecticide treated) increased from 44% (2686/6115) to 65% (4006/6198; P<0.001), and ownership of at least one insecticide treated net doubled from 18% (1062/5961) to 36% (2229/6198) in the same period (P<0.001). Among infants under 1 year of age, use of any net increased from 33% (388/1180) to 56% (707/1272; P<0.001) and use of an insecticide treated net increased from 16% (188/1180) to 34% (436/1272; P<0.001). After adjusting for potential confounders, household ownership was positively associated with time since programme launch, although this association did not reach statistical significance (P=0.09). Each extra year of programme operation was associated with a 9 percentage point increase in household insecticide treated net ownership (95% confidence interval –1.6 to 20). In 2005, only 7% (78/1115) of nets in households with a child under 1 year of age had been purchased with a voucher; this value increased to 50% (608/1211) in 2007 (P<0.001). In 2007, infants under 1 year in the least poor quintile were more than three times more likely to have used an insecticide treated net than infants in the poorest quintile (54% v 16%; P<0.001).
Conclusions The Tanzania National Voucher Scheme was associated with impressive increases in the coverage of insecticide treated nets over a two year period. Gaps in coverage remain, however, especially in the poorest groups. A voucher system that facilitates routine delivery of insecticide treated nets is a feasible option to "keep up" coverage.
Strategies for delivering insecticide treated nets have been controversial, with debates over whether nets should be provided through routine health services or through stand alone campaigns, whether they should be distributed through public or private channels, and whether they should be free, partially subsidised, or sold at commercial prices.5 6 7 8 Concerns have been expressed about whether campaign based distribution strategies (so called "catch up" schemes) that aim to accelerate coverage) will ensure "temporal equity"—that is, maintain coverage between campaigns—and sustain coverage over time.9 10 On the other hand, routine distribution strategies that use either the health system or commercial distribution networks might be better placed than campaign strategies to sustain ("keep up") coverage over time. When used alone, however, routine distribution approaches might be associated with a slower increase in coverage and more socioeconomically inequitable distribution. A recent analysis by Noor and colleagues suggested that between 2000 and 2007, coverage of insecticide treated nets increased more in settings with free distribution than in settings that used full cost recovery or highly subsidised distribution through routine delivery channels.3 Rapid increases in ownership of insecticide treated nets have been achieved through catch up campaigns in settings where ownership was previously extremely low, such as Niger and Togo,11 12 and Kenya achieved high and equitable levels of coverage by the combination of routine distribution and a mass campaign.13 Nevertheless, there has been little evaluation of systems that deliver nets through routine channels.
The United Republic of Tanzania has been a pioneer in developing delivery systems for insecticide treated nets. In the 1990s, a number of small scale projects demonstrated the feasibility of distributing nets through community based channels and through maternal and child health services.14 15 More recently, a strategy that uses social marketing combined with a voucher scheme targeting mothers of young children has been shown to be both effective and cost effective16 17 18 In addition, early reports on this approach indicate that the health effects of insecticide treated nets shown in clinical trials can also be achieved under "real life" conditions. The challenge of ensuring regular treatment of nets with insecticide contributed to the development in Tanzania of the first "dip it yourself" insecticide product.19
Tanzania is unusual in having a successful net manufacturing sector, with four firms producing 2 668 152 polyester nets bundled with longer lasting insecticide re-treatment kits and 298 996 polyethylene Olyset nets (Sumitomo Chemical Co Ltd, Tokyo) for the domestic Tanzanian market in 2007 (J Miller, personal communication, 2008). The retail distribution network comprises approximately 20 000 urban and rural net retailers. In addition, use of antenatal services in Tanzania is high, with 94% of women receiving antenatal care from a health care professional at least once during pregnancy.20
Together, these circumstances influenced the development of the National Insecticide Treated Net Strategy, which provides subsidised nets targeted at vulnerable groups alongside support to the commercial distribution system.21 Stakeholders involved in the strategy are shown in table 1
. From 2002 until 2007, the strategic social marketing for expanding the commercial market for ITNs [insecticide treated nets] in Tanzania (SMARTNET) project contributed to the development of the commercial market through nationwide generic promotion of insecticide treated nets and insecticide re-treatment. The project also worked with the four net manufacturers to promote and distribute their products and provided subsidised insecticide to them for bundling with untreated polyester nets.
|
1.62, $2.28) from October 2004 to December 2006 and was raised to TSh 3250 in January 2007. A woman can purchase any size of net upon production of the voucher and her antenatal care card. Given that the retail price for a net varies according to where the net is purchased and the size and shape of the net, the remaining amount paid by the voucher holder (the "top up") is variable. In 2006, the mean top up payment was TSh 1149, which implies that on average the voucher provided a subsidy of approximately two thirds the price of a standard 4x6 ft net.
In addition to vouchers, health facilities also distribute free insecticide re-treatment kits to infants when they attend for measles vaccination. In early 2007 a new voucher, funded by the United States Presidents Malaria Initiative, was introduced for infants attending a measles vaccination clinic.
The Tanzania National Voucher Scheme was initially launched in a small number of districts in October 2004 and reached a national scale in May 2006. By June 2008, 2.47 million pregnant woman vouchers and 369 000 infant vouchers had been redeemed. The Global Fund Round 1 grant came to an end in October 2007 and was followed by a Rolling Continuation Channel grant, which is a new mechanism set up by the Global Fund to Fight AIDS, Tuberculosis and Malaria that is available to provide continued funding for well performing grants.22 The cost and cost effectiveness of the voucher scheme are presented elsewhere.23
In addition to the national level activities of the voucher scheme and SMARTNET, a free net distribution scheme targeted at children under 5 years and linked with the measles vaccination campaign took place in the Lindi and Mtwara regions in August and December 2005, respectively, with funding from UNICEF.24 Two of the districts sampled in our surveys were located in these regions. Free nets were also distributed at the same time in Rufiji district, with support from the American Red Cross. In addition, there have always been small scale distributions of free nets by non-governmental organisations and various research projects.
The objectives of this study are to assess the changes in the level and socioeconomic distribution of insecticide treated net coverage over the period 2005-2007, during which the voucher scheme was initiated and taken to national scale, and to examine the link between programme duration and change in household net ownership as a measure of programme impact.
The programme was rolled out gradually across Tanzania between October 2004 and May 2006, starting in districts near to Dar es Salaam and ending with some of the most remote districts in the west of the country. This phased roll out was necessary because of the size of the country and allowed us to compare areas with and without the voucher scheme at three points in time. Mainland Tanzania covers 881 000 km2 and the estimated population in 2007 was 39.5 million.27 The roll out was determined by programme managers on pragmatic grounds, and it was not feasible or acceptable to randomise districts by roll out phase.
Firstly, we examined aggregate changes in net coverage over time. Secondly, we assessed within district changes in net ownership, rather than changes in absolute levels. These within district changes were compared with the length of time that the programme had been operating in each district to examine whether duration of programme was associated with a larger increase in net coverage. Multivariate analysis was used to control for the presence of other net distribution systems such as the free net distribution campaign that had taken place in three of our study districts. We also controlled for other potential confounders such as the starting level of net ownership and the level of mosquito nuisance in the district. Thirdly, as suggested by Webster et al (Plausibility study designs for evaluation of delivery systems at scale, unpublished paper), we used reported source of net to attribute nets to the voucher system and to assess the degree of penetration of voucher nets over time.
We also collected information about intermediate steps in the programme pathway to provide supporting evidence for the argument that the intervention was being implemented at a reasonable level. A number of steps were necessary in order for the voucher scheme processes to translate into effective coverage: vouchers needed to be in stock; women needed to attend antenatal services; women had to receive and redeem their voucher; and women needed to sleep under the voucher net (fig 1
). We used evidence from our surveys about intermediate steps in the programme pathway to inform judgments about programme effect.
|
|
Analysis was undertaken using Stata v9.0 software (StataCorp LP, College Station, TX); the "svy" commands were used to adjust standard errors for clustering. National level estimates were weighted according to district population in the 2002 Tanzania Population and Housing Census. Weighting made little difference to the final results, however, so unweighted figures are reported here. An index of socioeconomic status was constructed using a principal components analysis on data about housing conditions and household ownership of a selection of assets.28 A separate index was constructed for each survey. Households were divided into five equal sized groups (quintiles) according to their score from the principal components analysis. Clusters were classified as rural, semi-urban, or urban by using the same classification employed in the national 2002 census.
The coverage analysis distinguishes between "any net" and "insecticide treated net". In 2005 and 2006, an insecticide treated net was defined as one that had been treated with insecticide within 12 months of the date of the survey. In 2007, a longer lasting insecticide product, K-O Tab 1-2-3 (deltamethrin plus a binder conferring wash resistance; Bayer Environmental Science, Isando, South Africa) was introduced in Tanzania, and there were small numbers of long lasting insecticidal nets in the market and being distributed by small scale projects. For 2007, therefore, the definition of an insecticide treated net included: (1) a conventional net treated with conventional insecticide within the previous 12 months; (2) a conventional net that had ever been treated with longer lasting insecticide; or (3) a long lasting insecticidal net. The treatment status of nets was reported by household heads (for the household ownership indicators), net users (for currently pregnant woman), and mothers or caretakers (for children under 5 years).
In this report we focus on changes in household ownership of nets and use of nets by pregnant women and infants aged 0-11 months (that is, under 1 year of age), although indicators for children under 5 years are also reported. We assessed use of insecticide treated nets by infants under 1 year, rather than by all under 5 years, to trace the impact of the voucher system because this group would be expected to benefit most from a delivery system targeting pregnant women. Also, only a share of children under 5 years old had been exposed to the programme by the end of 3 years. In addition, infants under 1 year of age are at the highest risk of mortality from malaria in high transmission settings.29 30 Net use was as reported by the relevant respondent (pregnant women reporting for themselves, and carers reporting for their children), and interviewers asked to see all nets that were reported by the household head.
Multivariate regression was used to explore the impact of the voucher scheme on household ownership of insecticide treated nets. The length of time the programme was implemented in each district was measured as the number of days between the launch date and the date of the 2007 survey. This variable was regressed on the change in household ownership of insecticide treated nets at district level between 2005 and 2007. Differences were compared using methods based on the Students t test, as appropriate for clustered data with a small number of clusters.31 32 We controlled for any factors that were constant over time by using the within district change in coverage as the dependent variable. We included covariates to control for three potential confounders that, a priori, were expected to influence the effectiveness of the voucher scheme. These were: (1) the level of net ownership in the district in 2005, which was a proxy for socioeconomic status and allowed a test of whether districts with high starting levels of coverage would see lower programme achievements; (2) whether a district was classified by the National Malaria Control Programme as "epidemic prone," which we would expect to be associated with low mosquito nuisance and, therefore, a lower demand for nets33 34; and (3) whether the district had been the beneficiary of a free net campaign in 2005. Final model specifications were tested for heteroskedasticity and residual plots were examined.
|
|
|
Penetration of voucher nets
There was strong evidence of increased ownership of nets purchased with vouchers in households with target group members compared with households that had no target group members (table 5
). In 2005, households with a child under 1 year of age reported that only 7% of their nets had been purchased with a voucher; this value increased to 50% in 2007 (P<0.001). Voucher penetration in households without target group members remained low over time. The presence of voucher nets in these households could be due to misreporting, leakage of vouchers, pregnancies that did not end with a live birth, or infant deaths.
|
|
A number of findings support the conclusion that at least part of the gradual increase in net coverage can be attributed to the voucher scheme. Firstly, the largest improvement in net use was among infants under 1 year of age, who would be expected to benefit most from a voucher scheme targeted at pregnant women. Secondly, districts with longer exposure to the programme tended to have larger increases in household ownership of nets, with a 9 percentage point increase for every year of programme operation. Thirdly, the share of voucher nets in households with target group members (currently pregnant women and infants under 1 year, and indirectly, children under 5 years) increased steadily over the period 2005 to 2007, whereas in households without a target group member the share of nets reported to have been acquired using a voucher remained low.
In addition, there is evidence that the intervention was implemented fairly well in health facilities throughout the country and reached the majority of pregnant women (data not shown). Findings from the household and facility surveys about the intermediate processes involved in programme delivery (described in fig 1) indicate that more than 95% of women attended antenatal care at least once, the proportion of facilities with vouchers in stock was high (around 80% in 2007), the majority of pregnant women attending antenatal care received a voucher (60% in 2007), and voucher redemption was high throughout the entire period. A 3-4 month interruption in programme funding between May and August 2007 led to interruptions in contracts with implementing agencies and might have been responsible for some variation in programme activity in 2007.
Finally, we have found no evidence to support alternative explanations for this increase in coverage: there was no dramatic improvement in incomes during the study period; the SMARTNET project operated in all districts and, therefore, could not explain the within district differences in coverage improvement; and although nets were delivered through other systems at various points during the study period, the voucher scheme was the only subsidy system operating nationwide and functioning throughout the entire study timeframe.
Strengths and limitations of the study
We used two different approaches to analyse the changes in coverage over time and to assess whether the changes could be attributed to the voucher scheme. Firstly, we measured at the national level changes in coverage between 2005 and 2007 among different target groups. Statistical tests on these thousands of individual data points provide strong evidence of improved insecticide treated net coverage over time. Moreover, the largest coverage changes occurred among infants, who would be expected to benefit most from the pregnancy voucher scheme. Secondly, we examined the 21 district by district changes in coverage and used regression analysis to relate these changes to programme duration and potential confounders at district level. This approach is much more conservative than the individual level analysis because it reduces the sample size to only 21 data points, one for each district, but has the advantage of focusing on the direct effects of the voucher scheme. The true role of chance in our analysis of the effect of the voucher scheme probably lies between these two extremes.
The analysis of programme impact has a number of limitations. Firstly, the Tanzania National Voucher Scheme is not the only system delivering nets in Tanzania; a number of other delivery mechanisms will have contributed to the increases in coverage observed and it is not possible with this study design to isolate the contributions of each programme. Although the multivariate analysis takes into account the effects of other distribution systems, we cannot rule out potential confounding by other factors that changed during the time the programme roll out occurred. Secondly, for some districts there is no true baseline measure of coverage: the first round of evaluation surveys took place in July-August 2005, but the project began activities in October 2004. At the time of the first survey, the distribution programme had launched in 10 of the 21 districts, with a mean time of operation of 4.9 months. The effect of the late baseline measurement is to underestimate the effect of the voucher scheme. Despite these limitations, this evaluation approach does provide significant improvements over the strategies used to evaluate other national programmes, such as the ability to track changes in coverage over a period of a number of years to examine whether coverage increases have been sustained.
Comparison with other studies
The results reported here come from a strong national level monitoring and evaluation system, developed in collaboration with the National Malaria Control Programme. This strategy contrasts with other more geographically limited monitoring mechanisms, such as that in Kenya, which covered only four districts.13 The 2005 estimates of insecticide treated net coverage from our survey are similar to those reported in the 2004/5 Tanzania Demographic and Health Survey, which estimated household ownership of any net to be 46% and of insecticide treated nets to be 22.6%.20 A number of other studies have documented changes in the coverage of any net and treated nets, but few have monitored coverage over an extended time period. One exception is the study by Grabowsky et al, which looked at the combined impact over time of both campaign and routine delivery systems in Ghana.35
Conclusions and policy implications
Despite the significant increases in the coverage of insecticide treated nets recorded in this study, the levels achieved fall far short of the Roll Back Malaria target of 80% coverage of at risk groups by 2010.2 A number of implications for the Tanzanian programme thus emerge.
Firstly, as observed elsewhere,36 37 38 the consistent gap between use of any net and use of a treated net suggests an urgent need to improve insecticide treatment of nets. The treatment gap has persisted despite considerable investment by the SMARTNET project in communications activities promoting net treatment and re-treatment as well as efforts to work with manufacturers to ensure bundling of all nets with insecticide treatment kits. The Tanzania National Voucher Scheme also delivered free re-treatment kits to infants at the time of measles vaccination, and maternal and child health clinic workers provided health education messages about appropriate use of insecticide treated nets. The difficulty in securing a national consensus on the use of the longer lasting insecticide treatment, which has only received interim (phase 2) approval from the World Health Organization Pesticide Evaluation Scheme, also contributed to the treatment gap. An immediate shift to nets treated with long lasting insecticide would clearly be the best way forward, and this process is actively underway. Meanwhile, a mass free campaign for re-treatment of all existing polyester nets that are more than one year old started in May 2009 and should be completed by early 2010.
Secondly, although the combination of SMARTNET and the Tanzania National Voucher Scheme has created a functioning system for net distribution, it is clear that a "catch up" campaign is urgently required to raise coverage levels in all socioeconomic groups. This issue has been recognised by the Ministry of Health and Social Welfare in its 2008-2012 proposal to the Global Fund Rolling Continuation Channel, which includes provision for mass distribution of free nets treated with long lasting insecticide to all children under 5 years. This process began in 2008 and will continue through to early 2010. Combined with the mass re-treatment campaign, coverage levels are expected to be over 80% among children under 5 years and 50-60% for the population as a whole by the end of the first quarter of 2010.
The planned catch up campaign should also help to address the third major challenge of the voucher scheme, which is the strong socioeconomic and geographic difference in coverage and use. The barriers to uptake of the voucher scheme among poorer women are likely to be multiple; for example, such women are probably less likely to use antenatal care, are more likely to access antenatal care through outreach services where voucher distribution is less consistent, will have greater difficulty amassing the cash necessary for the top up amount, and might be located further away from shops where vouchers are accepted. Free net distribution will be an important opportunity to increase coverage among the poorest quintile. Significant increases in net use have been observed in the second and third quintiles, however. These households are also poor by any measure, and it seems that the Tanzania National Voucher Scheme has contributed to increased use of insecticide treated nets in these groups.
Future research questions
The diversity of epidemiological settings in Tanzania, together with the suggestion that coverage levels have remained low in districts that are "epidemic prone," indicate that there could be merit in linking coverage targets to malaria transmission level, especially in settings where transmission is not homogeneously high. Rapid diagnostic tests were used to check for parasitaemia in the 2008 household survey and will also be used to explore the feasibility of using immunological markers of malaria transmission levels to examine the association between transmission and net use.39 Another important issue will be the effect of the 2009 catch up campaign on the routine delivery system. There is a continued need to complement the voucher scheme monitoring and evaluation system with epidemiological evidence about the impact of increased net use on health outcomes. Finally, the financial and institutional sustainability of this approach to routine distribution of nets needs to be monitored and assessed.
|
Cite this as: BMJ 2009;339:b2434
Contributors: KH and RN are principal investigators. KH, TM, RN, HMp, CJ, HMs, and JAS designed the study. HMp and TM oversaw data collection. Analysis was undertaken by JB, TM, and KH. All authors contributed to the interpretation of the data and the drafting of the paper, and all have approved the final version. KH is the guarantor for the study.
Funding: Funds for the 2005 and 2006 surveys were provided by the Ministry of Health through its Global Fund Round 1 grant and the Gates Malaria Partnership. The UK Department for International Development and the Royal Netherlands Embassy provided funds through their grants to Population Services International. The 2007 surveys were funded by the United States Presidents Malaria Initiative. Although the study was conceived in collaboration with the National Malaria Control Programme, the programme managers had no role in the collection, analysis or interpretation of the data, in the writing of the report, or in the decision to submit the paper for publication.
Competing interests: None declared.
Ethical approval: The study received ethical clearance from the Medical Research Coordinating Committee of the Tanzanian National Institute of Medical Research and the ethics committees of the Ifakara Health Institute and the London School of Hygiene and Tropical Medicine.
© Hanson et al 2009
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati
Twitter What's this?
Read all Rapid Responses