Effects of routine individual feedback over nine years on general practitioners' requests for tests
BMJ 1996; 312 doi: https://doi.org/10.1136/bmj.312.7029.490 (Published 24 February 1996) Cite this as: BMJ 1996;312:490
- Ron A G Winkens, general practitionera,
- Peter Pop, professor of transmural health carea,
- Richard P T M Grol, professor of quality assurance in general practiceb,
- Annemiek M A Bugter-Maessen, research fellowa,
- Arnold D M Kester, statisticianc,
- George H M I Beusmans, general practitionerc,
- J Andre Knottnerus, professor of general practicec
- a Diagnostic Coordinating Centre Maastricht, PO Box 5800, 6202 AZ Maastricht, Netherlands
- b Centre for Research on Quality in General Practice, Nijmegen and Maastricht, PO Box 616, 6200 MD Maastricht, Netherlands
- c Departments of Methodology and Statistics and of General Practice, University of Limburg, Maastricht, PO Box 616, 6200 MD Maastricht, Netherlands
- Correspondence to: Dr Winkens.
- Accepted 8 November 1995
Feedback to general practitioners about the diagnostic tests they request reduces the number of requests.1 This effect disappears, however, soon after feedback is stopped.2 Most studies have been short, so data on the long term effects of feedback are lacking.3
The Diagnostic Coordinating Centre Maastricht has provided feedback continuously since 1985, resulting in a more rational use of tests and fewer requests.4 5 We report the effects of nine years of feedback. We also investigated its effects on requests for tests that were not advised but had a recommended alternative. We expected the effects to be greatest for such requests. We thought that if general practitioners had a choice of alternative tests they might be more willing to follow recommendations.
Methods and results
The diagnostic coordinating centre coordinates all requests from the 85 general practitioners in the Maastricht region. Written feedback is given twice a year, with comments on inappropriate requests and suggestions for more rational testing. Rationality can be assessed because forms contain clinical data on patients.
We analysed annual data for each test and each doctor from 1983 to 1993. We assessed the effects of feedback by comparing trends in the number of requests for 44 common tests in our region and a control region. For these common tests in our region we also compared the trend for tests that were advised against but had a recommended alternative (measurement of urea, thyroxine, free thyroxine, and triiodothyronine concentrations; Rose-Waaler and latex fixation tests) with that for tests that were advised against but had no recommended alternative (haemoglobin concentration, packed cell volume, differential count, erythrocyte sedimentation rate, leucocyte count, erythrocyte count, lactate dehydrogenase, aspartate aminotransferase, alanine aminotransferase).
From 1984 to 1993 the mean annual decrease in the number of requests in the Maastricht region was 3.5%, leading to a total decrease of 29% from 1984 values in 1993. A transient increase occurred in 1989 (table 1). Requests for individual tests decreased by up to 98%. The number of requests for the 44 common tests decreased by 45% between 1984 and 1993 (mean annual decrease 6%) in the Maastricht region, but it increased continuously in the control region (mean annual increase 3.2%) (P<0.001, Mann-Whitney U test). If the trend in the Maastricht region had been the same as that in the control region the number of requests in 1993 would have been about double.
Numbers of requests for tests from 1983 to 1993 in Maastricht region unless stated otherwise
The number of requests for tests with a recommended alternative in the feedback information decreased dramatically (table). Such requests were reduced by 85% after nine years of feedback. For tests without a recommended alternative the decrease was 46% (P<0.001, Wilcoxon signed ranks test).
Comment
Feedback given twice a year over nine years led to a persistent reduction in the number of requests, especially when an alternative was recommended. The results suggest that the maximal effect had not been reached in 1993. It seems that the strongest effects are achieved when feedback is repeated, emphasising that feedback needs to be routine. Our feedback was continuous during the nine years from 1985 to 1993.
Requests for tests increased each year in the Netherlands, but in our region they decreased after 1985. Requests for all tests were affected, probably because of a general learning effect arising from the feedback.
Although we could not determine patient outcome, we would not expect it to be adversely affected. In the feedback information we recommend the use of tests for specific indications or appropriate tests with high validity. The general practitioners changed their practices accordingly, so negative effects on patient outcome seem unlikely.
Obviously, the smaller number of requests reduced the costs of diagnostic testing in the Maastricht region. Given that the national trend in expenditure on diagnostic testing increased each year by 7-8%, pounds sterling1.8m would have been spent on testing in the region in 1993 if no feedback had been given. Instead pounds sterling0.9m was spent. Once feedback is started the savings increase each year. Given that the annual costs of providing feedback are pounds sterling60000 at most, pounds sterling3.8m was saved over the nine years from 1985 to 1993.
Footnotes
-
Funding Dutch Ministry of Public Health.
-
Conflict of interest None.