Effect of using an interactive booklet about childhood respiratory tract infections in primary care consultations on reconsulting and antibiotic prescribing: a cluster randomised controlled trial
BMJ 2009; 339 doi: https://doi.org/10.1136/bmj.b2885 (Published 29 July 2009) Cite this as: BMJ 2009;339:b2885- Nick A Francis, medical research council health services fellow12,
- Christopher C Butler, professor of primary care medicine, head of department of primary care and public health1,
- Kerenza Hood, reader in statistics, director of south east Wales trials unit12,
- Sharon Simpson, senior research fellow12,
- Fiona Wood, lecturer1,
- Jacqueline Nuttall, senior trial manager12
- 1Department of Primary Care and Public Health, School of Medicine, Cardiff University, Neuadd Meirionnydd, Heath Park, Cardiff CF14 4XN
- 2South East Wales Trials Unit, School of Medicine, Cardiff University
- Correspondence to: N Francis francisna{at}cf.ac.uk
- Accepted 4 March 2009
Abstract
Objective To establish whether an interactive booklet on respiratory tract infections in children reduces reconsultation for the same illness episode, reduces antibiotic use, and affects future consulting intentions, while maintaining parental satisfaction with care.
Design Pragmatic cluster randomised controlled trial.
Setting 61 general practices in Wales and England.
Participants 558 children (6 months to 14 years) presenting to primary care with an acute respiratory tract infection (7 days or less). Children with suspected pneumonia, asthma or a serious concomitant illness, or needing immediate hospital admission were excluded. Three withdrew and 27 were lost to follow-up, leaving 528 (94.6%) with main outcome data.
Interventions Clinicians in the intervention group were trained in the use of an interactive booklet on respiratory tract infections and asked to use the booklet during consultations with recruited patients (and provide it as a take home resource). Clinicians in the control group conducted their consultations as usual.
Main outcome measures The proportion of children who attended a face-to-face consultation about the same illness during the two week follow-up period. Secondary outcomes included antibiotic prescribing, antibiotic consumption, future consulting intentions, and parental satisfaction, reassurance, and enablement.
Results Reconsultation occurred in 12.9% of children in the intervention group and 16.2% in the control group (absolute risk reduction 3.3%, 95% confidence interval −2.7% to 9.3%, P=0.29). Using multilevel modelling (at the practice and individual level) to account for clustering, no significant difference in reconsulting was noted (odds ratio 0.75; 0.41 to 1.38). Antibiotics were prescribed at the index consultation to 19.5% of children in the intervention group and 40.8% of children in the control group (absolute risk reduction 21.3%, 95% confidence interval 13.7 to 28.9), P<0.001). A significant difference was still present after adjusting for clustering (odds ratio 0.29; 0.14 to 0.60). There was also a significant difference in the proportion of parents who said they would consult in the future if their child developed a similar illness (odds ratio 0.34; 0.20 to 0.57). Satisfaction, reassurance, and parental enablement scores were not significantly different between the two groups.
Conclusions Use of a booklet on respiratory tract infections in children within primary care consultations led to important reductions in antibiotic prescribing and reduced intention to consult without reducing satisfaction with care.
Trial registration Current Controlled Trials ISRCTN46104365
Introduction
Respiratory tract infections are the most common reason for patients to consult in primary care, with children consulting more than any other age group.1 One in five children who consult for a respiratory tract infection returns during the same illness episode, and many of these visits are unnecessary.2 3 Unnecessary re-consulting represents an opportunity cost and can increase the pressure on clinicians to prescribe antibiotics. Acute cough in children alone is estimated to cost the NHS at least £31.5m (€36.8m;$51.4m), with most of this cost arising from consultations with general practitioners.4
Complications of respiratory tract infections are rare, and there is little or no benefit from treatment with antibiotics.5 6 7 8 9 Guidelines of the National Institute for Health and Clinical Excellence (NICE) recommend against the immediate use of antibiotics for most children who have respiratory tract infections, and promote effective communication and information provision including an indication of the likely duration of illness.10 Nevertheless, antibiotics continue to be overprescribed for these illnesses,11 12 with children receiving more antibiotics than any other age group.13 Prescribing for non-specific upper respiratory tract infections, which declined in the late 1990s, is once again increasing.14 Unnecessary antibiotic use wastes healthcare resources, encourages further consulting in the future for similar illnesses,15 contributes to the problem of antibiotic resistance, and unnecessarily exposes patients to risk of adverse effects.16
Parental beliefs, fears, and expectations play an important part in both consulting behaviour and determining whether an antibiotic is prescribed.17 Parents fear serious illness, and worry that they will not be able to recognise the symptoms.18 Few are aware of the likely risks and benefits from antibiotic treatment and the normal duration of illness.19 Providing information on recognising the signs of serious illness and the likely duration of illness can reduce anxiety, increase confidence, and empower parents to manage their child’s illness without needing to consult a healthcare professional. A nurse administered educational intervention aimed at helping parents cope with ear pain in the United States resulted in a reduction in consultations for ear pain over the following year.20 Patient information leaflets for adults with lower respiratory tract infections that describe expected duration of illness and suggest simple self-help measures reduce reconsultations21 and antibiotic prescribing.22
Communication within the consultation is central to addressing parental concerns and expectations, and helps parents to manage their child’s illness effectively and safely. Clinicians seldom explicitly ask parents about their expectations about antibiotic treatment,23 and overestimate the expectation for antibiotics.24 When clinicians believe that patients (and parents) expect antibiotics, they are more likely to prescribe them.17 Clinicians often tell parents that their child should recover in a few days, although children usually have symptoms for substantially longer than this.25 Setting realistic expectations about the likely duration of illness could reduce parental anxiety and rates of visits. Furthermore, parents value a thorough examination, explanation, reassurance, and advice or guidance more than a prescription for antibiotics.24 26
We therefore set out to establish whether training clinicians in the use of an interactive booklet, designed to enhance communication within the consultation, and act as a take home resource for parents, would have an effect on rates of reconsultation and antibiotic prescribing. A cluster design was needed, since the intervention was partly directed at the clinicians in the practice. Clinicians who had received training in use of the booklet, and through its use had learnt from its content, would therefore have been unable to not use this knowledge in each consultation where a patient was recruited.
Methods
The methods for this cluster randomised controlled trial have been described in detail elsewhere,27 and are summarised below.
Half of all general practices from nine local health boards in Wales (n=147) were randomly selected to be sent information about the study (our research group was conducting another randomised controlled trial assessing a related intervention and the other practices were sent information about that study). This procedure was followed by attempts to contact a general practitioner or practice manager in each practice. Telephone contact with a general practitioner or practice manager was successful for 81 practices. Sixty two practices in Wales agreed to take part, although only 49 of these returned a practice agreement and were subsequently randomised. Of the 49 randomised practices, 36 recruited study participants. In England, four primary care research networks agreed to help recruit practices. The total number of practices approached in these networks is not available. However, 38 practices in England verbally agreed to take part, 34 of these returned a practice agreement and were randomised, and 25 of the randomised practices recruited participants. Practices were randomised by a statistician using block randomisation with random block sizes and stratification by practice list size, antibiotic prescribing rate for 2005, and country.
Participating clinicians were asked to recruit sequential eligible children (6 months to 14 years) consulting with a respiratory tract infection (cough, cold, sore throat, earache for seven days or less) and their parents. Exclusions included children with asthma and those with serious ongoing medical conditions such as malignancy or cystic fibrosis.
Sample size calculation
We calculated that we would need 524 participants recruited from 60 clusters (practices) in order to show a reduction in the proportion of children who reconsult from 20% to 10%, with 80% power, at a 5% significance level, and with an intracluster coefficient of 0.04. Our aim was to ask 60 practices to recruit ten children each (total of 600 participants) which would allow for loss to follow-up and missing data.
The intervention
The intervention consisted of an eight page booklet on respiratory tract infections in children, designed to be used within the consultation and then provided to parents as a take home resource (see www.equipstudy.com). Online training on the use of the booklet was also provided for clinicians. The study booklet was developed through a multistage process which has been described elsewhere.28 The online training described the content and aims of the booklet, and encouraged its use within the consultation to facilitate the use of certain communication skills, mainly exploring the parent’s main concerns, asking about their expectations, and discussing prognosis, treatment options, and any reasons that should prompt reconsultation. Clinicians in practices randomised to the control group were asked to conduct the consultation in their usual manner.
Measures
Baseline data, including age, duration of illness, and symptoms, were collected by participating clinicians at the time of recruitment. We asked clinicians to collect non-identifiable data for all potentially eligible patients (including those who were not approached, those who were approached but were ineligible, and those who declined participation) to assess for possible selection bias. Follow-up was via a telephone administered questionnaire with the child’s parent or guardian, 14 days after recruitment. Where a participant’s parent could not be contacted on day 14, further attempts were made for at least three days. If still unsuccessful, the telephone number was checked with the relevant general practice and with directory inquiries, and if this approach was unsuccessful then a self completion questionnaire was sent to the parents. Follow-up measurements included reported consultations in primary and secondary care in the two weeks after recruitment, prescriptions for and use of antibiotics, intention to consult with a similar illness in the future, parental enablement (using a modification of the patient enablement instrument29), satisfaction with the index consultation, reassurance, and value of any information given to them during the index consultation. Telephone interviewers were blinded to treatment group and were asked to record any subsequent unblinding of allocation (such as a parent talking about receiving a booklet).
Primary outcome was a reconsultation during the two weeks after the index consultation. Antibiotic prescribing, antibiotic consumption, future consulting intentions, parental satisfaction, perception of the usefulness of information received, reassurance, and enablement were secondary outcomes.
Analysis
Data were analysed using Stata version 9 and MLwiN version 2.10. After checks for missing data and ranges, and double entry of a 10% sample of the case report forms, Stata was used to obtain summary statistics and undertake univariate analyses. “Satisfaction” and “usefulness of information received” were measured using five point items, but their response distributions were highly skewed. For this reason, these items were transformed into binary outcomes, split into “very satisfied” or “satisfied” versus ‘‘neutral”, ‘‘dissatisfied” or “very dissatisfied” and “very useful” or “useful” versus “neutral”, “unhelpful” or “very unhelpful”. Similarly, the outcome “reassured” was transformed from a three response item into a binary outcome, split into “very reassured” versus “a little reassured” or “not reassured”. The enablement score was calculated in the standard way, but since one item had been excluded, possible scores ranged from 0 to 10. Enablement scores had a skewed distribution and were therefore converted into a binary outcome using a mid-range cutpoint of 5.
The primary analysis was intention to treat, conducted by fitting two level (practice and patient) random intercept logistic regression models using MLwiN. Similar models were fitted for the secondary outcomes.
After the initial analyses, sensitivity analyses were done by adding the stratifying variables (practice size, practice prescribing status, and country), age, duration of illness, and any symptoms found to be significantly associated in univariate analyses at the 10% level into each model as covariates. Exploratory analyses were conducted by including factors likely to affect reconsulting and antibiotic prescribing into these two models. The interaction factors were then examined to look for subgroup effects.
Results
Eighty-three practices were randomised, and 61 of these recruited a total of 558 eligible patients between October 2006 and April 2008 (fig 1)⇓.
Intervention and control practices, and randomised practices that did and did not recruit participants, were similar in terms of list size, antibiotic prescribing history, and location (Wales or England) (table 1)⇓. Patients recruited by intervention and control practices were similar in terms of age, sex, duration of illness, and symptoms (table 1). Patients were recruited by intervention and control practices at a similar rate (fig 2)⇓. We achieved a follow-up rate of 94.6% (93.4% intervention, 95.8% control) for the primary outcome data. Telephone interviewers reported becoming aware of the participant’s treatment group in 34 of 509 interviews (6.7%).
The number and proportion of patients experiencing each outcome, and odds ratios (with 95% confidence intervals) for the primary and secondary outcomes are shown in table 2⇓. There was no significant difference between the intervention and control groups in the odds of reconsulting in primary care during the two weeks after registration. Children in the intervention group were significantly less likely to receive a prescription for antibiotics at the index consultation, less likely to take antibiotics during the first two weeks, and their parents were less likely to report that they would consult in the future if their child had a similar illness. There were no significant differences in terms of satisfaction, level of reassurance, parental enablement, or the parent’s rating of the “usefulness of any information received in the consultation.” Similar results were found at the univariate level, with a non-significant difference in reconsulting (absolute risk reduction 3.3%, 95% confidence interval −2.7% to 9.3%, P=0.29), and significant differences in antibiotic prescribing (absolute risk reduction 21.3%, number needed to treat 4.7, P<0.001), antibiotic consumption (absolute risk reduction 20.6%, 95% confidence interval 12.7% to 28.5%, number needed to treat 4.9, P<0.001), and future consulting intentions (21.1%, 13.1% to 29.2%, 4.7, P<0.001).
There was no significant intervention effect when telephone consultations were counted as reconsultations along with face to face primary care consultations (odds ratio 0.81; 0.47 to 1.42), or when consultations at accident and emergency departments were included along with primary care consultations (0.85; 0.48 to 1.51). The intervention had a similar effect size on the antibiotic outcomes of receiving a prescription for antibiotics for immediate use at the index consultation (excluding prescriptions for delayed use; 0.26; 0.11 to 0.62) and receiving an antibiotic prescription at any point in the two week follow -up (0.31; 0.16 to 0.62).
The sensitivity analyses for the main reconsultation outcome and the antibiotic prescribing outcome did not result in any meaningful changes to the results (that is, there were no significant intervention effects in the sensitivity analyses for the reconsultation outcome and similar significant effects for all analyses with the antibiotic prescribing outcome).
Subgroup analyses
No significant interaction effects were seen in the reconsultation models. In the antibiotic prescribing model, the intervention was more effective in above-average prescribing practices (table 3⇓). There were no other significant interaction effects.
Adverse events
Seven patients (three in the intervention group and four in the control group) were subsequently admitted to hospital or observed in a paediatric assessment unit. One patient in the control group had a longstanding diagnosis of asthma, and as such was excluded (after discussion in the trial steering committee). The longest hospital admission (two nights) was a patient in the intervention group who had febrile convulsions. The remaining admissions were one night or less.
Comparing recruited and non-recruited patients
Ninety three patients were not recruited into the study (50 were ineligible, 27 declined participation, and 16 were not recruited because of a lack of time in the consultation or for other unspecified reasons. There were no significant differences between recruited and non-recruited patients in terms of age or presenting symptoms; however, cough was more common in non-recruited patients (71.9% v 61.0%). Of the non-recruited patients, there was no significant difference in cough between the intervention and control groups. Previous duration of illness was higher in non-recruited patients than in recruited patients, although this finding was not surprising, since a duration of illness of more than seven days was a common reason for exclusion from the study.
Discussion
Clinicians’ use of an interactive booklet on respiratory tract infections in children within primary care consultations resulted in a significant reduction in antibiotic prescribing and consumption and high levels of parental satisfaction. Use of the intervention did not result in a significant reduction in the proportion of children who reconsulted in the two weeks after the index consultation. However, fewer parents in the intervention group said that they would consult in the future should their child develop a similar illness. No significant differences were seen in terms of parental satisfaction, reassurance, enablement, or perception of the usefulness of any information received about their child’s illness.
Strengths and limitations of the study
This was an adequately powered randomised controlled trial. Practices were recruited from throughout Wales and England and were broadly representative of UK general practice. The results of this study are therefore likely to be highly generalisable to UK general practice. The stratified randomisation procedure helped ensure practices in both groups were similar in terms of size, location, and historical antibiotic prescribing rate. We achieved the target sample for both clusters (general practices) and patients, with a high follow-up rate.
Cluster randomised designs can increase risk of selection bias. Our intervention was aimed not only at individual patients, but also at the primary care clinicians (through the online training). For this reason, an individually randomised trial was not possible: once trained in new consulting skills, clinicians cannot switch back to their untrained state. Selection bias can occur at the level of the cluster (that is, through differential dropout) or the individual. There were 11 practices in each arm of the trial that did not recruit any participants. Of these 22 practices, there were no significant differences in terms of list size, historical prescribing rate, or proportion located in Wales or England. We asked all participating clinicians to identify sequential eligible patients, and to record non-identifiable data for all those who were not recruited, in order to look for evidence of selection bias at the individual level. We found no important differences in the patients who were and were not recruited or between the patients who were not recruited by clinicians in the intervention and control groups. Similar recruitment rates in the two groups also suggest minimal selection bias.
The non-significant difference in scores of parental enablement and usefulness of information received are surprising and seem inconsistent with the significant reduction in the proportion of parents stating that they would consult with a future similar illness. The patient enablement instrument was designed for first person use in routine general practice consultations and might not have been sensitive enough for measuring changes in parental enablement two weeks after the consultation.
Clinicians in the control group might have altered their behaviour (towards providing more information than usual) as a result of their participation in the study, which could have attenuated any effect that changes in the behaviour of doctors in intervention practices might have had on parental satisfaction, enablement, and usefulness of information received. We are exploring the effects of the intervention on parental knowledge and beliefs in a qualitative process evaluation.
Neither clinicians nor participants were blinded as to study group. As our intervention was directed partly at clinicians, a change in their behaviour was both expected and desirable. However, we need to distinguish between changes related to use of the intervention and changes associated with an awareness of being observed (Hawthorne effect). All participating clinicians were provided with information about the aims of the study. However, antibiotic use was listed fourth in a long list of outcome measures and is therefore unlikely to have resulted in meaningful changes in prescribing behaviour. The effect of the intervention on antibiotic prescribing was not modified by practice location, which, given that many practices in Wales would be aware of the research group’s interest in antibiotic prescribing, suggests that the Hawthorne effect was unlikely to be playing a significant part. Clinicians did not have any involvement in measuring outcomes, and are therefore unlikely to have contributed to ascertainment bias. Children (and their parents) were not blinded to treatment group. However, practices were instructed not to inform participants of the group to which they had been assigned before obtaining consent. Telephone interviewers were blinded to trial group in 93% of all interviews.
Although we recognise that interventions are not always delivered as planned in pragmatic trials, we did not measure treatment fidelity because we wanted the assessors to remain blinded to study group where possible. However, suboptimum fidelity of intervention delivery is likely to dilute the treatment effect and therefore could have led to a type II error regarding reconsultations, but is unlikely to have led to a type I error regarding the positive findings.
There were unequal numbers of nurses in the study groups (and thus patients recruited by nurses). We believe that this discrepancy was due to chance. We found no association between clinician’s profession (doctor or nurse) and either reconsultations or antibiotic prescribing, either at a univariate level or using multilevel modelling, and therefore believe that this did not have an important effect on our results.
Comparison with other published work
Our findings are consistent with those of Macfarlane and colleagues who found that the use of a leaflet on lower respiratory tract infection in adults resulted in a reduction in antibiotic use by nearly 25%.22 However, Macfarlane and colleagues have also shown a reduction in reconsultations from use of a leaflet,21 whereas our results did not show a significant reduction. This finding might be because the underlying reconsultation rate in our study was lower than that found by Macfarlane and lower than that used in our sample size calculation. This lower rate could indicate societal changes in knowledge or beliefs over time and might be much closer to a desirable level of reconsulting, and therefore more difficult to reduce. Certainly the 3.3% absolute difference found in our study was substantially smaller than the 10% reduction we had considered to be clinically important. Although we did not identify any studies that used a booklet designed specifically for use in consultations on respiratory tract infections in children, studies that have evaluated sending information booklets on minor illnesses to patients’ homes have generally found little effect on consultation rates.30 31 32 33 34 A recent study in the United States found that a sustained, multifaceted intervention, conducted over three years and aimed at reducing antibiotic prescribing in young children, resulted in minimal reduction in antibiotic use beyond underlying trends.35 The intervention in this study included several printed and web-based educational materials but did not encourage interactive use of the material within the consultation. Use of a leaflet for patients with lower respiratory tract infections resulted in an increase in reconsultations in the first month, and no significant difference in use of antibiotics or satisfaction.36 However, the leaflet in this study was brief, was not designed for interactive use in the consultation, and was provided in addition to verbal information about the natural history. A further United States study found that providing patients with a pack containing a pamphlet, a sticker, and a thermometer was associated with reduced consultation rates. However, this study was limited by non-random allocation and post allocation exclusion of patients.37 Another study where parents were randomised to receive written materials on either antibiotic use or injury prevention found no reduction in antibiotic use in the families who received the intervention.38 This finding could indicate the need to provide parents with positive messages (how best to manage the illness) rather than negative ones (don’t use antibiotics).
Interpretation of the results
We found a statistically non-significant reduction in the proportion of children who reconsulted in the intervention group, which was considerably smaller than the 10% difference that was specified as clinically meaningful.
We did demonstrate statistically and clinically significant reductions in antibiotic prescribing and consumption, which have important implications for policy makers, practitioners, and ultimately patients. How the reduction in prescribing was mediated is not yet clear, but it was possibly through a combined effect on clinician and parental behaviour. Clinicians probably recognised the importance of changing their prescribing behaviour and felt that they had the resources to effectively achieve this.
A significant reduction in the proportion of parents who said that they would consult if their child had a similar illness in the future is encouraging and suggests that use of the intervention could have an effect on future consulting.
No differences were recorded in terms of satisfaction, reassurance, value of information received, or parental enablement. Reassuringly, a high level of satisfaction was reported in the intervention group despite the significant reduction in antibiotic prescribing.
The routine use of this intervention in primary care should now be considered along with other effective interventions such as delayed prescribing.39 The magnitude of the reduction in antibiotic prescribing achieved suggests that its use could have important implications for patients, and, as a result of the threat posed by increasing antimicrobial resistance, for public health. Furthermore, the booklet and online training could be produced and distributed fairly cheaply. Its use also seems to be safe and result in high levels of parental satisfaction. However, like any complex intervention, the precise elements that contributed to its effectiveness are unclear. The intervention not only provided parents with a take-home resource, it also aimed to modify the consultation process (especially communication within the consultation), which could have had an effect on consultation length. We are currently exploring which aspects of the intervention led to its effectiveness, the impact of its use on consultation length, its effects on long term consulting rates, and its economic impact. For example, we do not know if another booklet or leaflet on the same subject would result in a similar effect, or whether the training programme or the interactive use of the booklet was important. In the meantime, higher prescribing clinicians, or those who would like to reduce their prescribing but feel that they lack the tools to achieve this, might wish to consider use of this intervention.
What is already known on this topic
Respiratory tract infections in children are largely self limiting and benefit very little from antibiotic treatment. However, consultation rates continue to be high and antibiotics are still frequently prescribed.
What this study adds
Providing primary care clinicians with a carefully developed booklet on respiratory tract infections in children, and training in its use within the consultation, reduces antibiotic prescribing by around two thirds. Satisfaction among parents receiving this intervention was high, and no significant difference was found between those receiving the intervention and those receiving usual care.
Use of this intervention seems to have little effect on reconsulting for the same illness episode, but does reduce future consulting intentions.
Clinicians should consider the use of this intervention in routine consultations with children with respiratory tract infections.
Notes
Cite this as: BMJ 2009;339:b2885
Footnotes
We are grateful to all the patients, parents, and clinicians who participated in the development of the intervention and the trial. We gratefully acknowledge the support received from the Primary Care Research Network and from all participating research networks. We thank the administrative staff in the Department of Primary Care and Public Health and the South-East Wales Trials Unit who worked hard to ensure the success of the study. We also gratefully acknowledge the contribution made by members of the independent trial steering committee.
Contributors: CB conceived the study. NF, FW, CB, KH, and SS developed the intervention. CB, NF, KH, and SS wrote the protocol. All contributors sat on the study management group. NF managed the trial and NF and JN conducted the telephone interviews. NF wrote the first draft of the paper and all authors made subsequent contributions. NF is the guarantor.
Funding: We gratefully acknowledge funding from the Medical Research Council and the Welsh Assembly Government in the form of a joint Health Services Fellowship for NF. Funding for the development of the training website was from an educational grant from Pfizer UK. The South-East Wales Trials Unit is funded by the Welsh Office for Research and Development. All authors declare that this work was conducted independently from the study funders.
Sponsorship: This study was sponsored by Cardiff University.
Competing interests: None declared.
Ethical approval: This study was approved by the South East Wales Local Research Ethics Committee (Reference number 04/WSE04/109).
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.