CCBYNC Open access
Research

Delayed antibiotic prescribing strategies for respiratory tract infections in primary care: pragmatic, factorial, randomised controlled trial

BMJ 2014; 348 doi: http://dx.doi.org/10.1136/bmj.g1606 (Published 06 March 2014) Cite this as: BMJ 2014;348:g1606
  1. Paul Little, National Institute for Health Research senior investigator and professor of primary care research,
  2. Michael Moore, reader in primary care research,
  3. Jo Kelly, trial manager,
  4. Ian Williamson, senior lecturer in primary care research,
  5. Geraldine Leydon, reader in health research,
  6. Lisa McDermott, research fellow,
  7. Mark Mullee, director of the National Institute for Health Research research design service South Central,
  8. Beth Stuart, research fellow
  9. On behalf of the PIPS Investigators
  1. 1University of Southampton, Aldermoor Health Centre, Southampton SO16 5ST, UK
  1. Correspondence to: P Little p.little{at}soton.ac.uk
  • Accepted 5 February 2014

Abstract

Objective To estimate the effectiveness of different strategies involving delayed antibiotic prescription for acute respiratory tract infections.

Design Open, pragmatic, parallel group, factorial, randomised controlled trial.

Setting Primary care in the United Kingdom.

Patients 889 patients aged 3 years and over with acute respiratory tract infection, recruited between 3 March 2010 and 28 March 2012 by 53 health professionals in 25 practices.

Interventions Patients judged not to need immediate antibiotics were randomised to undergo four strategies of delayed prescription: recontact for a prescription, post-dated prescription, collection of the prescription, and be given the prescription (patient led). During the trial, a strategy of no antibiotic prescription was added as another randomised comparison. Analysis was intention to treat.

Main outcome measures Mean symptom severity (0-6 scale) at days 2-4 (primary outcome), antibiotic use, and patients’ beliefs in the effectiveness of antibiotic use. Secondary analysis included comparison with immediate use of antibiotics.

Results Mean symptom severity had minimal differences between the strategies involving no prescription and delayed prescription (recontact, post-date, collection, patient led; 1.62, 1.60, 1.82, 1.68, 1.75, respectively; likelihood ratio test χ2 2.61, P=0.625). Duration of symptoms rated moderately bad or worse also did not differ between no prescription and delayed prescription strategies combined (median 3 days v 4 days; 4.29, P=0.368). There were modest and non-significant differences in patients very satisfied with the consultation between the randomised groups (79%, 74%, 80%, 88%, 89%, respectively; likelihood ratio test χ2 2.38, P=0.667), belief in antibiotics (71%, 74%, 73%, 72%, 66%; 1.62, P=0.805), or antibiotic use (26%, 37%, 37%, 33%, 39%; 4.96, P=0.292). By contrast, most patients given immediate antibiotics used antibiotics (97%) and strongly believed in them (93%), but with no benefit for symptom severity (score 1.76) or duration (median 4 days).

Conclusion Strategies of no prescription or delayed antibiotic prescription result in fewer than 40% of patients using antibiotics, and are associated with less strong beliefs in antibiotics, and similar symptomatic outcomes to immediate prescription. If clear advice is given to patients, there is probably little to choose between the different strategies of delayed prescription.

Trial registration ISRCTN38551726.

Introduction

Acute respiratory tract infections are the commonest acute conditions managed in primary care, and the control of symptoms is a central concern of patients and parents of young patients.1 2 Patients’ expectations and practitioners’ perceptions of those expectations have helped fuel prescribing, and antibiotic use in primary care is rising progressively again after a reduction that followed a peak in the late 1990s (www.dh.gov.uk/health/2012/11/eaad-resources). This is a key driver for antibiotic resistance,3 4 potentially leading to major infections becoming untreatable.5 6

Delayed prescription is recommended in international guidance, and the National Institute for Health and Care Excellence currently recommends using a strategy of either no antibiotic prescriptions or a delayed antibiotic prescription for dealing with uncomplicated acute sore throats and other respiratory infections.7 Systematic reviews of delayed prescription—where the patient is advised to wait for at least the expected natural history of the illness before using the prescription—have concluded that the strategy is an effective way of reducing antibiotic use but could result in poor symptom control.8 9 10 There has also been recent debate about whether no prescription of antibiotics is better than delayed prescription, because it results in slightly lower antibiotic use.8 Trial data for acute sore throat and chest infections have suggested that an immediate prescription and particularly delayed antibiotic prescription could reduce reconsultation compared with a no prescription strategy,11 12 but the trials were underpowered to compare strategies and detect complications. There has also been no direct comparison of the different methods used to delay antibiotic prescription, which could have different rates of antibiotic use.8 9 10 These methods include recontacting the clinic to request prescription by phone (recontact), post-dating the prescription (post-date), allowing patients to collect the prescription from the clinic themselves (collection), and giving prescriptions to patients and asking them to wait (patient led).

This study reports the likely effect of different strategies of antibiotic prescribing on symptom control and antibiotic use when controlling for commonly used analgesic advice and advice to inhale with steam that could plausibly affect symptom control.

Methods

Summary of study design and trial groups

This study was a pragmatic open factorial trial of delayed antibiotic strategies, controlling for symptomatic advice regarding analgesia and steam, with a parallel observational component for patients judged to need immediate antibiotics.

Health professionals, who were mainly doctors but also some practice nurses, decided in negotiation with patients whether immediate antibiotics were needed. If antibiotics were not needed, patients were randomised to one of four delayed prescribing groups: recontact for a prescription, post-dated prescription, collection of the prescription, or patient led (that is, the patient was given the prescription). The figure and web appendix 1 provides more detail on these groups.

Figure1

CONSORT flow diagram. Of 889 patients considered, 556 were judged not to require immediate antibiotics and were randomised. *Numbers based on general practitioner reports

Each group was randomised further into 12 subgroups according to three factors. These factors were antipyretic regimens (ibuprofen, paracetamol, or both combined), regular antipyretic versus “as required” dosing, and steam inhalation advice versus no advice to inhale with steam. The web figure uses an example group (no prescription) to illustrate this randomisation process. During the trial (from January 2011), a strategy of no antibiotic prescription was added as a randomised comparison, bringing the total number of randomised groups to five (fig 1).

Summary of rationales

Factorial design

We chose a factorial design for the analgesic and steam components to deal with the management of symptoms, and the antibiotic component particularly to deal with antibiotic use and beliefs in antibiotics. The factorial design is not only efficient in assessing multiple interventions, but also provides better control of symptomatic advice (regarding analgesia or steam) that could plausibly affect symptom control in the antibiotic groups.

A non-randomised immediate prescription group was chosen to allow all patients to enter the study and provide two important opportunities. Firstly, to observe how often immediate antibiotics are thought necessary by clinicians, and secondly, to be able to compare patient outcomes in those prescribed and not prescribed antibiotics.

During the study, it became clear from systematic reviews that delayed prescribing might result in higher antibiotic use than no initial prescription.8 We therefore added a no prescription group to facilitate interpretation of the effect of delayed prescription compared with the alternatives strategies, particularly because both the delayed and no prescription groups in the current study had higher antibiotic use than in previous studies.

Randomisation

A statistician independent of the study team coordinated the randomisation using computer generated random numbers. If the doctor thought that immediate antibiotics were definitely required, they prescribed antibiotics, otherwise patients were randomised to one of four methods of delayed antibiotic prescribing. We assessed evidence of subversion of randomisation by monitoring the order of use of envelopes (there was no evidence of selective envelope use) and the baseline table (which showed that the groups were well balanced).

A key concern in complex pragmatic factorial trials is keeping the logistics simple and avoiding errors at the point of intervention delivery. We made it very simple to execute randomisation and delivery because the health professional took the next pack off the shelf that contained pre-randomised advice sheets (that is, there was no requirement—and hence no error—in finding and using the correct advice sheets). With careful attention to practitioner equipoise, this method of randomisation to different advice strategies has proved successful in previous trials.11 13 14 There was no evidence of subversion in the current study—either for selective envelope use or bias in patient characteristics.

Inclusion and exclusion criteria

The study included patients aged 3 years and over presenting to a health professional (a general practitioner or nurse). Patients had to present in a general practice setting with a respiratory tract infection diagnosed by the health professional (acute cold, influenza, sore throat, otitis media, sinusitis, croup, or lower respiratory tract infection). Patient or parental written consent was given.

Patients were excluded if they were asthmatic (unless ibuprofen or aspirin previously provided no problems), had active or previous peptic ulceration, were hypersensitive to analgesics, and were unable to complete outcome measures (for example, they were visually impaired, had psychosis, or were severely depressed). Exclusion also applied to patients who required hospital admission (for example, for meningitis, severe pneumonia, epiglottitis, or Kawasaki disease), had a known immune deficiency, or were pregnant or breastfeeding.

Outcomes

The primary outcome was symptom severity measured at the end of each day during days 2-4 of a two week symptom diary (days 2-4 are when symptoms of all respiratory infections are at their worst11 14). We chose symptom severity as a key outcome because the most recent systematic review documented worse symptom control with delayed prescription.8 The diary was completed by patients (or children) until symptoms returned to normal. It used previously validated formats11 15 for rating symptoms (0=no problem, 6=as bad as it could be). Symptoms included feeling generally unwell, sleep disturbance, fever, interference with normal activities, sore throat, cough, short of breath, facial or sinus pain, earache, and runny or blocked nose. Symptom resolution was a secondary outcome because duration differs according to the particular respiratory infection.7

Patients were telephoned (on days 2-3) to check for any problems with diary completion. If no diary was received after two weeks, one mailed reminder was sent and then a phone call made as necessary to document key outcomes using a brief questionnaire—which we have shown to be reliable.13

Secondary outcomes were:

  • Any antibiotic use in the 14 days after recruitment, as documented in the diary or the brief questionnaire

  • Side effects (rash, diarrhoea, vomiting, or abdominal pain) documented in the diary

  • Mean temperature readings in the morning and evening using tempadot thermometers (orally where possible)

  • Duration of symptoms: rated moderately bad or worse

  • Return with new or worsening symptoms or complications of intervention—that is, a patient returning with a symptom or diagnosis of respiratory tract infection recorded using a structured proforma by a member of the research team. Complications were defined as a new consultation documented in the notes within one month with otitis media, sinusitis, pneumonia, quinsy, cervical adenitis, meningitis, or septicaemia

  • Belief in the effectiveness of antibiotics and satisfaction, measured in the main diary using previously developed questions13

General practitioners were asked to complete non-recruitment logs and a questionnaire at the end of the study documenting the common reasons for non-recruitment of eligible patients and for eligible patients who declined.

Sample size calculation

We calculated the sample size based on an α value of 0.05 and β value of 0.2 using the NQuery program for multiple group sample sizes. There were two elements to the calculation, firstly for symptom control (the primary outcome), and secondly for antibiotic use. We assumed a standard deviation of 1.1 for our primary outcome.11 13 15 Assuming that one analgesic group had symptom control that was 0.5 standard deviations better than one of the other groups (that is, a moderate effect size), 228 patients were needed to allow for 12 groups and 80% follow-up, or 504 patients for 0.33 standard deviations. This effect size was equivalent to one in three people rating symptoms as mild rather than moderate, agreed as a modest effect size by the trial steering committee of a Medical Research Council funded trial of prescribing strategies for acute cough11).

For the antibiotic outcome of the antibiotic strategies (a key outcome for this component of the study), we compared the difference in antibiotic use between the delayed strategies and no antibiotic prescription. Seventy two patients per group or 450 in total were needed in the groups with no prescription or delayed prescription, allowing for 20% loss to follow-up. These numbers also assumed 15% use of antibiotics in the no antibiotic group, and 20-35% use in the delayed prescription groups (20%, 25%, 35%, and 35% for recontact, post-date, collection, and patient led, respectively). We estimated that 72 patients per group would provide 80% power to detect a difference of 0.5 standard deviations in symptom control between delayed prescription groups and the no prescription group.

Analysis

We performed an analysis of the randomised groups and a secondary analysis that included the non-randomised immediate group. We used analysis of covariance for a factorial study for the main continuous outcomes, controlling for stratification, analgesic and steam strategies, and confounders if appropriate. Logistic regression was used for antibiotic use and return to the surgery, and Cox regression was used for the duration of symptoms. Odds ratios were converted to risk ratios using standard formulas.16 The effect of antibiotic strategies, and interactions, were assessed using the likelihood ratio χ2 test. The likelihood ratio test is particularly useful for assessing the effect of variables with multiple levels (for example, the delayed prescribing factor, with five levels), and provides an overall test of whether the variable makes a significant difference to the statistical model. Analysis was intention to treat (that is, practitioners or patients were analysed in their intended randomisation groups, whether or not they complied), but we did not impute missing values, there was no interim analysis, and no clinical subgroups for antibiotic prescribing strategies were specified in advance.

Results

A total of 889 patients were recruited between 3 March 2010 and 28 March 2012 by 53 health professionals in 25 practices. Of these patients, 333 (37%) were prescribed immediate antibiotics and 556 (63%) entered the randomised trial. Those prescribed immediate antibiotics had slightly more severe symptoms at baseline and were more likely to be labelled as having lower respiratory tract infections and less likely to be labelled as having upper respiratory tract infections. However, controlling for these characteristics did not alter the inferences of comparisons with the delayed and no prescription groups. Baseline characteristics were similar in all randomised groups (table1). All patients were followed up for one month; further follow-up after the initial month was a mean of 0.84 years (standard deviation 0.36) and was similar in all groups. The diary symptom severity scale had acceptable internal reliability for days 2-4 (Cronbach’s α, day 2, 0.72; day 3, 0.79; day 4, 0.79) and was sensitive to change over the week (standardised response mean 1.60). The non-recruitment questionnaire had responses from 20 respondents who recruited most of the patients (n=704). The most common reason (given by 14 recruiters) for eligible patients declining was that the patient was too busy or insufficiently interested, followed by concern about the proposed treatment, and the patient being too unwell. The most common reason given (by 18 of 19 recruiters) for not approaching eligible patients was insufficient time.

Table 1

 Baseline characteristic of groups

View this table:

Attrition bias

The characteristics of patients where the primary outcome was not documented were similar to those followed up (n=751) for baseline symptom score (1.0 v 0.98), female sex (82/136 (60%) v 458/744 (62%)), age 16 years or less (31/136 (23%) v 200/744 (27%)). The two groups were similar in diagnosis of lower respiratory tract infections (22/135 (16%) v 113/742 (15%)) and otitis media (16/134 (12%) v 66/740 (9%)).

Performance bias: compliance with delaying antibiotics

For the 264 patients who completed the main diary and who documented taking antibiotics, the median day that antibiotics were started was day 4 for all the delayed prescription strategies and day 1 for the immediate prescription strategy.

Outcomes

For symptom severity, we saw no evidence of a significant interaction between antibiotic strategy and analgesia use (likelihood ratio test χ2 7.7, P=0.47; web appendix 4), nor dosing (4.1, P=0.39) or steam (5.3, P=0.26). There was also no evidence that the effect of antibiotic strategy differed after adaptation of the trial to include a no prescription arm, for either symptom severity (3.20, P=0.362) or antibiotic use (1.25, P=0.740).

Main results

In the randomised groups (no prescription and delayed prescription strategies), there was no significant effect of strategy on symptom severity (likelihood ratio test χ2 2.61, P=0.625), duration (4.29, P=0.368), and small differences of 0.1°C in temperature control (10.37, P=0.035; table 2 shows individual group comparisons). Antibiotic use did not differ significantly between strategies (4.96, P=0.292), with the lowest use (26%; 26/99) reported in the no prescription arm, an average 37% (134/367) in the delayed arms (varying from 33% (28/85) in the collection arm to 39% (35/89) in the patient led arm). Belief in the effectiveness of antibiotics was strong but not significantly different between groups (1.62, P=0.805). Higher levels of satisfaction were reported for the patient led and collection approaches, although the limited sample size for this outcome resulted in no significant differences overall (2.38, P=0.667). Reconsultations in the following month were similar (2.97, P=0.563) and were not significantly different after the first month (4.11, P=0.391).

Table 2

 Effectiveness of antibiotic strategies (randomised groups only)

View this table:

After including the non-randomised immediate prescription group, there was no significant effect of antibiotic prescribing strategy on symptom severity (likelihood ratio test, χ2 4.05, P=0.543), duration (4.94, P=0.424), or temperature (7.66, P=0.176; web appendix 2 shows individual group comparisons). Antibiotic use differed significantly (326, P<0.001) with 97% (270/278) of patients reporting antibiotic use in the immediate arm, and more patients believed antibiotics were very effective (93% (168/180); 36.4, P<0.01) despite immediate antibiotics having no effect on symptom control or duration.

Harms

Complications were slightly more common in the no prescription group (3/122 (2.5%)) than in the delayed strategy groups (average 6/432 (1.4%)) and similar to the immediate group 8/326 (2.5%; web appendix 3). In multivariate analysis controlling for baseline symptoms, smoking, and diagnostic group, there were fewer complications in both the delayed and immediate groups but this difference was not significant (adjusted risk ratio 0.56 (95% confidence interval 0.13 to 2.37); 0.66 (0.15 to 2.88)). We saw little difference in other side effects reported between groups (web appendix 3).

Discussion

To our knowledge, this is one of the largest studies so far to assess the effect of different antibiotic prescribing strategies on symptom control and antibiotic use, and the only trial so far to compare several commonly used methods of delaying antibiotic prescription. It shows little difference in symptom control between strategies involving no prescription, immediate prescription, or delayed prescription. This finding contrasts both health professionals’ behaviour in commonly requiring immediate antibiotics, and the persistently strong beliefs patients have in the effectiveness of antibiotics. The different ways of using delayed prescription, when the same structured approach is used, had more similar outcomes than previous trial data suggest, although the collection approach performed well on most criteria.

Study limitations and strengths

The trial adapted the delayed prescribing strategies during the trial, in response to ongoing debate comparing no prescription with delayed prescription, to include a no prescription group, but there was no evidence of a difference in estimates as a result of the adaptation. The patient group were broadly defined, comprising a range of respiratory infections, and thus the heterogenous population increases variance, making type II errors more likely. However, delayed prescribing strategies apply to all infections (that is, this was the meaningful target population), and randomisation groups were well balanced for the main diagnoses. Participants in the non-randomised group (being prescribed antibiotics immediately) had slightly more severe symptoms at baseline; therefore, comparisons with this group may have been confounded, but controlling for baseline symptoms or other potential confounders did not alter the inferences. The study was not powered to detect a range of antibiotic use that was less than 20% (between 15% and 35%) when comparing the delayed prescribing and no prescribing strategies. The primary outcome (symptom severity in the first days) should apply in all acute infections, and was reasonably reliable and sensitive to change in this patient group.

Recruitment was slow considering the incidence of respiratory infections, but feedback during and after the study indicated that this study was very easy to recruit to, and that recruitment was limited to time pressures in busy winter clinics as in previous studies,11 13 hence non-recruitment logs were poorly completed. This problem raises questions of generalisability. However, there was no evidence that patients with more severe symptoms were excluded, because comparisons to recent large, simple observational studies and trials showed patients with slightly more severe symptoms in the current study. On a scale of 0-3 for mean severity of sore throat at baseline, patients scored 2.4 in the current study versus 2.0 in the DESCARTE study17 18; for mean severity of cough at baseline, patients scored 2.6 in the current study versus 2.2 in the GRACE study.19 20 The results controlled for potential confounders, but since estimates were not meaningfully altered, the effect of any potential confounding was likely to be limited.

This study was pragmatic so that patients were free not to comply with advice, but in fact compliance was probably reasonable. Most patients who were asked to delay using antibiotics did not use antibiotics, and those who did use antibiotics on average delayed for several days. The trial was adequately powered for symptom control but was not specifically powered to assess complications.

A strength of the study was that we controlled for symptomatic advice, and we assessed interactions between such advice and antibiotic prescribing strategies: such advice is not normally measured nor assessed in trials of antibiotic strategies. However, the trial was not formally powered to detect interactions, and thus there was limited precision of the estimates for interactions. The estimates of interaction must be viewed with caution for several reasons. Firstly, the estimates for the main effects of the other interventions (analgesia, dosing, steam) suggested no effect of these interventions (therefore a ceiling effect resulting in a negative interaction was unlikely). Secondly, no interactions were postulated on theoretical grounds in advance. And thirdly, the spread of the estimates of interactions was consistent with chance. It was not possible for all outcomes to be included in the follow-ups to collect key outcome data, resulting in less power for outcomes that were only measured in the main diary, such as belief in antibiotics and satisfaction.

Main findings

We have confirmed that the use of delayed prescriptions is likely to be associated with fewer than 40% of patients using antibiotics. This finding is consistent with the systematic reviews,8 9 10 but unlike the systematic reviews, we did not confirm poor symptom control with delayed prescribing. The good symptom control in the current study could indicate that all patients were given structured advice about analgesic use. The delayed groups reported slightly higher antibiotic use than the no prescription group, in line with previous evidence.8 9 10 About a quarter of patients not initially prescribed antibiotics ended up using them, as opposed to a little more than a third of patients given a delayed prescription. The previous systematic reviews of delayed prescription documented variation between the antibiotic redemption rates for different strategies of delayed prescription,8 9 10 with higher redemption rates for some studies using the patient led approach. We documented similar outcomes in our study, but had the advantage of the same approach to advice for each strategy. Therefore, the larger differences observed between previous studies may not reflect differences in the methods of delayed prescribing themselves.

Complications occurred in about 2-3% of patients given no antibiotic prescription compared with 1% of the delayed groups. The current study was not designed to detect differences in complications, but a recent large observational study of antibiotic prescribing strategies for sore throat (DESCARTE study, n=14 610, led by PL17) has confirmed significant reductions in complication rates using delayed or immediate prescriptions of the same order as the current study.18 There was little to choose between the different groups of delayed prescribing, but there may be marginal preference for the collection group, which had the most data from previous trials. In the current study, patients randomised to the collection strategy had a slightly lower use of antibiotics than the other delayed strategies—presumably due to the hurdle of having to return to the surgery for the prescription—as well as higher satisfaction rates and the lowest reconsultation rates.

What is already known on this topic

  • Strategies involving no antibiotic prescription or delayed antibiotic prescription are common in managing respiratory tract infections

  • But systematic reviews have suggested that delayed prescription could result in worse symptom control than immediate use of antibiotics, and could lead to higher antibiotic use than a no prescription strategy

  • Different methods of delaying prescriptions (such as giving prescriptions with instructions, leaving prescriptions for collection, post-dating prescriptions, or requesting recontact) have been used but not directly compared

What this study adds

  • There is probably little difference in symptom control in the short term between strategies of delayed prescription, no prescription, or immediate prescription, despite strong belief in the effectiveness of antibiotics among patients

  • Both no and delayed antibiotic prescription result in the minority of patients using antibiotics

  • With clear guidance, any strategy of delayed prescribing is likely to result in fewer than 40% of patients using antibiotics

Notes

Cite this as: BMJ 2014;348:g1606

Footnotes

  • We thank the general practitioners, practice nurses, and particularly the patients who gave their time to this study. The views expressed are those of the authors and not necessarily those of the National Health Service, National Institute for Health Research, or Department of Health.

  • PIPS Investigators: Paul Little, Michael Moore, Jo Kelly, Ian Williamson, Geraldine Leydon, Lisa McDermott, Mark Mullee, Beth Stuart, Karen Middleton, Julie Hooper, Katherine Salisbury, Emily Edwards, Jennifer White, Adam Nicholls, Amanda Nagle, Susannah Gant.

  • Contributors: All authors and Daniel Lane contributed to the development of the protocol. All authors contributed to overseeing the management of the study, agreeing the analysis plan, and to the write-up of the paper. KS, EE, JW, AN, HE, and SG developed and piloted the initial study documents supervised by the trial team; PL led the grant application and the initial drafting of the paper, and is the guarantor of the paper. PL, MM, and BS performed the analysis. JK and JH performed day to day management of the study, supervised by PL. Alastair Hay provided helpful comments on the analysis approach and the manuscript. All authors had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis.

  • Funding: This article presents independent research funded by the National Institute for Health Research under its Programme Grants for Applied Research programme (grant reference no RP-PG-0407-10098). The National Institute for Health Research did not interfere in the research, nor have input into the analysis, interpretation, or writing of the paper.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: support from the National Institute for Health Research for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; and no other relationships or activities that could appear to have influenced the submitted work.

  • Ethical approval: Ethical approval was given by the Southampton and Southwest Multi Centre Research Ethics Committee (no 06/Q1702/154).

  • Data sharing: No further data are available.

  • Transparency: The lead author (the manuscript’s guarantor) affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/.

References