Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
BMJ 2008;336:202-205 (26 January), doi:10.1136/bmj.39395.696065.47 (published 16 January 2008)
Yoel Lubell, health economist1, Hugh Reyburn, clinical senior lecturer2, Hilda Mbakilwa, clinical officer3, Rose Mwangi, social scientist3, Semkini Chonya, data manager3, Christopher J M Whitty, professor of international health2, Anne Mills, professor of health economics1
1 Health Economics and Financing Programme, Department of Public Health and Policy, London School of Hygiene and Tropical Medicine, London WC1E 7HT, 2 Department of Infectious and Tropical Diseases, London School of Hygiene and Tropical Medicine, 3 Joint Malaria Programme, Kilimanjaro Christian Medical Centre, PO Box 2228, Moshi, Tanzania
Correspondence to: Y Lubell yoel.lubell{at}lshtm.ac.uk
Design Cost-benefit analysis using a decision tree model and clinical data on the effectiveness of diagnostic tests for malaria, their costs, and clinicians response to test results.
Setting Tanzania.
Methods Data were obtained from a clinical trial of 2425 patients carried out in three settings of varying transmission.
Results At moderate and low levels of malaria transmission, rapid diagnostic tests were more cost beneficial than microscopy, and both more so than presumptive treatment, but only where response was consistent with test results. At the levels of prescription of antimalarial drugs to patients with negative tests that have been found in observational studies and trials, neither test methodis likely to be cost beneficial, incurring costs 10-250% higher, depending on transmission rate, than would have been the case with fully consistent responses to all test results. Microscopy becomes more cost beneficial than rapid diagnostic tests when its sensitivity under operational conditions approaches that of rapid diagnostic tests.
Conclusions Improving diagnostic methods, including rapid diagnostic tests, can reduce costs and enhance the benefits of effective antimalarial drugs, but only if the consistency of response to test results is also improved. Investing in methods to improve rational response to tests is essential. Economic evaluations of diagnostic tests should take into account whether clinicians response is consistent with test results.
Improved targeting of antimalarial drugs in Africa is a priority as new artemisinin combination therapies, which cost much more than previous and now generally ineffective antimalarials, come into use. The widespread practice of treating any non-specific febrile illness as malaria threatens the sustainability of artemisinin combination therapy; in many settings most antimalarial drugs are prescribed for patients who have no malaria parasites.123 Other potentially serious causes of illness are ignored because of the assumption that the cause of fever is malaria. Overprescription of antimalarials has a great impact on the cost effectiveness of artemisinin combination therapies.4 If artemisinin combination therapies are to be afforded by the poorest people, they will need to be subsidised, and subsidies are also threatened by overprescription on the current scale.
Reflecting these concerns, malaria treatment guidelines now recommend that treatment for non-severe malaria should, at least for older children and non-pregnant adults, be restricted to people with positive results on a parasitological test for malaria. In many settings this is difficult to achieve with blood slide testing, which is of variable accuracy and available only in larger health facilities, where a minority of patients seek care. Recent improvements in rapid immunochromatographic diagnostic tests for malaria potentially solvemany of these problems; also, the testscost less than most courses of artemisinin combination treatment.5 6 Studies that have explored the economic consequences of using rapid diagnostic tests alongside artemisinin combination therapies have shown these tests are cost effective, but these studies assume that prescribers respond to negative test results by not prescribing an artemisinin combination therapy.5 789
The assumption in these models—that prescribers will respond in a way that is fully consistent with test results—is unsafe. In Zambia, where rapid diagnostic tests are used routinely in settings where microscopy is not available, antimalarials continued to be prescribed to over a third of patients who had negative test results.2 In Tanzania, a recent randomised trial of rapid diagnostic tests compared with blood slide testing found that in low transmission areas, over 90% of all antimalarials prescribed were given to patients with a negative test result, irrespective of the test method used.3 These levels of overprescribing extend also to patients with severe illness.10
Using data from a trial of clinicians behaviour, this paper examines the relation between the level of response consistent with results of parasitological tests and the total costs resulting from the use of rapid diagnostic tests and microscopy. Both diagnostic methods are evaluated, as microscopy is likely to continue to have an important role in the management of febrile patients. We consider the costs of diagnosis and treatment and the cost of life years lost through incorrect diagnosis and inappropriate treatment.
Prevalence is defined as the proportion of febrile patients presenting with parasitaemia, and varies with the rates of transmission of malaria.11 Prevalence of under 10% is classified as likely when transmission is low, 10-50% when moderate, and above 50% in high transmission settings. Consistent response rate is defined as the percentage of negative test results for which clinicians do not prescribe antimalarials: at a consistent response rate of 100%, no patient with a negative test receives an antimalarial; at consistent response rate of 0%, all patients with a negative test receive an antimalarial. We did not examine inconsistent response to positive test results as this was a rare occurrence (<1%). Prescribing antibiotics to patients with negative test results was set at just over 50%, independently of provision of an antimalarial, as documented in the trial. (Whether or not patients with negative test results received an antimalarial, just over half had received an antibiotic in the trial.3) We derived the estimates for the accuracy of the rapid diagnostic tests and microscopy by combining data from all three sites in the trial.
We calculated the costs for the management of a simulated population of 1000 patients, including costs of microscopy or rapid diagnostic tests, antimalarials, antibiotics, care for patients with severe illness, and a cost representing the value of life years lost owing to incorrect diagnosis. The analysis primarily compares the varying costs of microscopy and rapid diagnostic tests with respect to action consistent with their results, and also the cost of presumptively treating the population, to indicate the circumstances in which use of a test becomes inefficient.
The analysis uses a cost-benefit framework, taking a societal perspective accounting for both provider costs and the monetary value of years of life lost owing to incorrect diagnosis and inappropriate treatment. This framework allows for a more coherent analysis in directly observing the impact of inconsistent response with test results on total costs, without the need for cost effectiveness ratios.
We chose a decision tree as the best model to synthesise the data, represent alternative options, and indicate the most efficient outcomes (fig 1)
. A number of variables were made to interact—for instance, the probability of developing severe malaria responded to prevalence and age, as did treatment costs for artemisinin combination therapies. In addition to the influence of age on probability of transmission and case fatality rates, the responsiveness of the model to patients age was important for policy considerations, since in some settings presumptive treatment is recommended for younger patients.
|
|
|
We tested the results for sensitivity to variation in all measures and produced a tornado graph to identify the measure with highest influence. The sensitivity analysis also presents results when the value for microscopy sensitivity is set at 95%, WHOs minimum requirement for a malaria diagnostic test. This was included as the documented sensitivity for microscopy in the trial was very low—under 75%.
In a low transmission setting (prevalence of malaria 10% in those with febrile illness) and for a 15 year old, using either test incurred higher costs than presumptive treatment when consistent response rate was below 20%, and testing became increasingly attractive as response consistency improved (fig 2)
. For instance, at a consistent response rate of 50%, either test was less costly than presumptive treatment (as both tests were below the presumptive treatment threshold), about $5200 (£2500;
3500) for 1000 patients. Above this level of consistent response rate, rapid diagnostic tests became marginally more attractive, but despite their higher sensitivity they did not have a great advantage over microscopy in low transmission settings.
|
Figure 3
compares each of the tests directly with presumptive treatment across all levels of prevalence and consistent response rate, showing the proportional change in cost of rapid diagnostic tests and microscopy relative to presumptive treatment. The upper left corners in both charts indicate that in low prevalence settings, use of either test with consistent response to results led to cost savings of between 50% and 100% as compared with presumptive treatment. As prevalence increases to the medium-high range, however, consistent response rate must increase more than proportionately if use of the tests is to remain attractive. At very high levels of prevalence, both tests appeared more costly, irrespective of response by clinicians, primarily because of imperfect test sensitivities, and presumptive treatment remained the more efficient option.
|
Figure 4
explores the most attractive strategy at all prevalences and levels of consistent response rate, using profiles for patients aged 3, 7, and 25 years. They indicate that using either parasitological test for younger patients was unattractivein settings of high transmission, even if response to tests was fully consistent.
|
Figure 5
shows the circumstances under which each of the strategies is most attractive, stratified by cost per year of life lost averted. At a value of $25 (the value where WHO considers interventions to be "very attractive"), rapid diagnostic tests gained some advantage in the mid-range of prevalence as long as response was consistent with results, and microscopy remained the preferred option for low prevalence areas even at low levels of consistent response rate. Using $150 per year of life lost, rapid diagnostic tests became the preferred option up to a prevalence of about 70%, when presumptive treatment became the more efficient option. At a value of $680—twice the Tanzanian gross national income per capita for the year 2005,17 an alternative rule of thumb18—rapid diagnostic tests dominated across all but the lowest levels of consistent response rate and highest levels of prevalence.
|
|
Previous economic analyses of malaria diagnostic tests for febrile patients have ranged from those based on simple formulas (comparing the cost of treatment to the cost of the test plus the cost of treatment across differing levels of prevalence) to more advanced analyses seeking to incorporate test accuracy and the cost of false results.8 19202122 A recent study evaluating the effectiveness of introducing new diagnostic tests for malaria included several novel elements, such as the infrastructure required for the tests and subsequent accessibility, and an estimate of "harm of treatment" associated with antimalarials.8 The cost implications of inconsistent response to test results have, however, largely been ignored, despite the overwhelming evidence that this is a problem throughout Africa. This study shows the importance of allowing for compromised consistency in response to test results, both in terms of implications for expenditure on diagnostic tests and treatment and for potential health outcomes. These implications are likely to hold for economic assessments of diagnostic tests other than those for malaria.
Limitations
The study assumed that only febrile patients were tested, although in reality almost 20% of antimalarials prescribed were given to patients who did not have a history of fever, of whom only 1.7% were parasitaemic. This runs counter to guidelines such as those of WHO and the Tanzanian Ministry of Health and will increase the waste of resources.23 24 In addition, the study evaluated the impact of testing on prescribing antimalarials only, although tests may influence clinicians behaviour in prescribing additional drugs, especially antibiotics.
Three further potential limitations of the methods should be highlighted. Some of the data within the model had to be estimated from indirect sources because locally relevant data are not available. These points are highlighted as "expert opinion" in the tables. Secondly, the model does not differentiate between patients with mild symptoms but varying levels of parasitaemia, largely because the evidence that level of parasitaemiainfluences outcome is mixed. Thirdly, the methods of estimating rate of transmission from hospital data are inevitably not precise. Characterising transmission is prone to numerous difficulties. In this study we used prevalence of parasitaemia among febrile patients, although this method is subject to several limitations. An alternative method would be the use of serological markers as evidence of longer term exposure,25 although the impact of this method on results obtained in our model would be small. Data for case fatality rates for untreated malaria, for instance, cannot be measured precisely, and the interaction between case fatality ratesand rates of transmission and age adds an additional level of uncertainty. Future models could allow users to enter their own estimates to observe the impact of their variation on final results.
Policy implications
This study has confirmed findings that show the potential cost savings from use of a diagnostic test before prescribing antimalarial treatment, if test results are used to guide the prescribing of antimalarials. It also shows, however, that in some circumstances diagnostic tests rapidly become less attractive when prescribers even only partially ignore negative results. The primary implication is therefore that response to test results must be taken into account in designing public health programmes, as investing in rapid diagnostic tests without changing prescribing behaviour is unlikely to be cost beneficial.
Currently there are only preliminary data as to how this behaviour change can be achieved, and change is unlikely to be easy. Both the current levels of response to treatment guidelines and the methods to improve these are under-researched.26 Influencing prescribers behaviour might require changing the whole approach to treating febrile illnesses, and the reasons for current (irrational) practice need to be understood. If prescribers behaviour is driven by a perception that patients expect to be treated for malaria, then either patients expectations or prescribers perceptions will need to be changed. Unfortunately there is little evidence on how best to do this in Africa; the relevance of lessons learnt in developed countries (for example, reducing overprescription of antibiotics) is uncertain. Effective methods to support behaviour change need to be identified and pursued to ensure that the use of rapid diagnostic tests and artemisinin combination therapies is cost beneficial.
Investment in improving the quality of field microscopy is also a priority. In this analysis, because of the low levels of sensitivity of microscopy seen in practice, its use currently results in high total costs in most circumstances, and with high prevalence of malaria the total costs increased further as response to test results improved. Where microscopy is used for routine diagnosis, measures to ensure higher accuracy as well as response consistent with test results are necessary to maximise cost effectiveness. Changing prescribers behaviour will have costs, but these can be offset by the savings gained with better response to test results.
|
Contributors: HR, CJMW, HM and RM facilitated the trial and data collection; Raimos Olomi contributed to the study design; SC was responsible for data management and primary analysis; YL and AM conducted the economic analysis; YL, HR, CJMW and AM wrote the initial draft; all authors contributed to the writing of the final manuscript. YL and AM are guarantors.
Competing interests: None declared.
Ethical approval: Ethics committees of the National Institute for Medical Research, Tanzania, and the London School of Hygiene and Tropical Medicine.
Provenance and peer review: Not commissioned; externally peer reviewed.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
Technorati What's this?