Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
A O'Cathain a School of Health and Related Research,
University of Sheffield, Regent Court, Sheffield S1 4DA, b Women's Informed Childbearing and Health Research
Group, School of Nursing and Midwifery, University of Sheffield,
Sheffield S3 7ND Correspondence to: A O'Cathain
a.ocathain{at}sheffield.ac.uk
| |
Abstract |
|---|
|
|
|---|
Objective:
To assess the effect of leaflets on
promoting informed choice in women using maternity services.
Design:
Cluster trial, with maternity units
randomised to use leaflets (intervention units) or offer usual care
(control units). Data collected through postal questionnaires.
Setting:
13 maternity units in Wales.
Participants:
Four separate samples of women using
maternity services. Antenatal samples: women reaching 28 weeks'
gestation before (n=1386) and after (n=1778) the intervention.
Postnatal samples: women at eight weeks after delivery before
(n=1741) and after (n=1547) the intervention.
Intervention:
Provision of 10 pairs of Informed
Choice leaflets for service users and midwives and a training
session for staff in their use.
Main outcome measures:
Change in the proportion of
women who reported exercising informed choice. Secondary outcomes:
changes in women's knowledge; satisfaction with information, choice,
and discussion; and possible consequences of informed choice.
Results:
There was no change in the proportion of
women who reported that they exercised informed choice in the
intervention units compared with the control units for either antenatal
or postnatal women. There was a small increase in satisfaction with information in the antenatal samples in the intervention units compared
with the control units (odds ratio 1.40, 95% confidence interval 1.05 to 1.88). Only three quarters of women in the intervention units
reported being given at least one of the leaflets, indicating problems
with the implementation of the intervention.
Conclusion:
In everyday practice, evidence based
leaflets were not effective in promoting informed choice in women using maternity services.
|
What is already known on this topic
Ten evidence based leaflets (Informed Choice) are used by maternity services in the United Kingdom to promote informed choice in women using these services What this paper adds
Decision aids may not be effective in the real world |
| |
Introduction |
|---|
|
|
|---|
There is a growing consensus that people should be informed about, and able to influence, decisions about their own health care. 1 2 Decision aids, which present the options available to patients with evidence from research on their effects, can help people to participate in decisions about their care.3 Midwives Information and Resource Service (MIDIRS) and the NHS Centre for Reviews and Dissemination have produced a set of 10 leaflets on informed choice in maternity care. The leaflets summarise evidence on 10 decisions that women face in pregnancy and childbirth to encourage their involvement in decisions about their own care. Many maternity units buy the leaflets, yet little is known about their effectiveness.
We investigated whether the leaflets promoted informed choice and led
to increased levels of knowledge, satisfaction with information,
satisfaction with the way choices were made, and discussion with health
professionals. We also examined whether they changed the actions women
took or the services they used.
| |
Methods |
|---|
|
|
|---|
We tested the hypotheses in a cluster randomised controlled trial, with maternity units as clusters, in everyday practice. Qualitative research was undertaken alongside the trial to explore the use of the leaflets in practice and is reported separately.4
We randomised maternity units rather than individual women because of
the risk of women sharing the leaflets in an individual level trial.
Units were included if they had not already purchased the leaflets and
had over 1000 deliveries annually. Twelve of the 15 large maternity
units in Wales had not already purchased the leaflets and agreed to
participate in the study. We also included a small unit under the
managerial control of one of the 12 larger units. Maternity units were
grouped into 10 clusters because some shared management or clinicians.
Clusters were paired on the basis of their annual numbers of deliveries
to ensure balance in the two arms of the trial. Members of pairs were
randomly assigned by tossing a coin to receive the set of leaflets
(five intervention units) or to continue with usual care (five control
units). The intervention is described in the box.
|
The intervention
|
Participants
We identified two samples of women. The first sample was all women
who reached 28 weeks' gestation during a six week period and were
receiving antenatal care in any setting (antenatal sample). Women were
identified through hospital computer systems and the records of
midwives and clerks in hospital and community antenatal clinics. The
second sample was all women who delivered during a six week period
(postnatal sample). Women were identified through child health computer
records and hospital and home delivery registers. Women were excluded
if they lived outside the catchment area of the hospital or in areas
where antenatal care was provided by midwives from other hospitals,
were under 16 years old, or had miscarried or if their baby had died or
was seriously ill.
We identified an antenatal sample and a postnatal sample before the introduction of the leaflets and again nine months after they were introduced. We assessed outcomes using a postal questionnaire sent to women in these four different samples (figure). Women in the antenatal samples received the questionnaire at 28 weeks' gestation, and women in the postnatal samples received the questionnaire eight weeks after delivering their babies. Up to two reminders were sent at intervals of three weeks. The second reminder for the women in the antenatal samples was a shorter questionnaire that covered only key questions.
|
Outcome measures
The primary outcome was the proportion of women who answered
"yes" to the question "Have you had enough information and
discussion with midwives or doctors to make a choice together about all
the things that happened during maternity care?" with the options
"yes," "partly," "no," "there was no choice," and
"did not apply." As informed choice is a difficult concept to
measure2 we also asked women about the role they took when choices were made, with six options ranging from "active" to
"passive."5
Secondary outcomes were the "components" and the "consequences" of informed choice. The components measured were women's levels of knowledge of the 10 topics covered by the leaflets; satisfaction with information and with how choices had been made; and views of whether they had had sufficient discussion with health professionals. The consequences measured were the actions taken or services used by women. We also collected data on sociodemographic factors, parity, and women's preferences for involvement in decision making.5
Validation and quality assurance
We developed and piloted some measures specifically for the study
on the basis of interviews with women in three maternity units not
involved in this trial.6 Other measures were modified from
published sources. The questionnaires were piloted by post outside the
study area. Ethical approval was obtained for the study in each area.
Sample size and statistical analysis
Assuming an intraclass correlation coefficient of 0.007 and an
average cluster size of 200 we calculated we would need a sample size
of 925 in the intervention units and 925 in the control units for each
of the antenatal and postnatal samples. This would give us an 80%
chance of detecting an increase from 50% to 60% in the proportion of
women reporting that they made informed choices in the intervention
units compared with no change in the control units, at a two tailed
significance level of 5%. We paired maternity units to ensure balance
and undertook an unmatched analysis.7 We compared
sociodemographic variables of respondents in all four antenatal samples
and in all four postnatal samples at the individual level using
analysis of variance and
2 tests. We compared any
changes in the intervention units with changes over the same period in
the control units using multilevel modelling.
8 9
Analysis
was by intention to treat. We adjusted for women's age, age at leaving
full time education, parity, and preference for involvement in decision
making in the analyses. Intraclass correlation coefficients were 0.01 and 0.002 for the change in informed choice in antenatal and postnatal
samples respectively.
| |
Results |
|---|
|
|
|---|
Response rates
The overall response rate to the
questionnaires was 64% (6452/10 070), with a rate of 65% (3164/4835)
for the antenatal sample and 63% (3288/5235) for the postnatal sample. Response rates were lower in women with manual occupations and from
ethnic minorities but did not differ by type of delivery, type of pain
relief, parity, or age.6
Comparison of intervention and control
groups
Sociodemographic variables of respondents in all four
antenatal samples were similar (table 1). Women's age was different in
the four postnatal samples, with respondents after the intervention an
average of about seven months younger than respondents
before.
|
|
Impact on informed choice
Before the intervention about
half of women in both intervention and control units reported
exercising informed choice "overall" in their maternity care. After
the intervention, this proportion increased slightly in both groups
(table 2) but with no significant difference in the change between
groups. Results were similar for the proportion of women reporting
active involvement in decision making. In the antenatal samples there
were increases in knowledge, discussion, and satisfaction with
information and with the way choices were made in intervention units
(tables 2 and 3). They were not significant, however, with the
exception of satisfaction with information. For this variable the
difference in change was less than the minimum important difference of
10 percentage points. There was only one change in postnatal samples, with an increase of 0.24 points on a 10 point knowledge score, which
was no longer significant after adjustment for covariates (table
3).
|
Consequences of informed choice
Given that there was no
change in the proportion of women who reported that they exercised informed choice we would not expect changes in choices made. The one
significant difference, which was in the proportion of women having
screening tests for Down's syndrome and spina bifida, was due in part
to an increase in reported uptake in the control units (table
4).
|
Uptake of leaflets
During the intervention period there was
a significant increase in the proportion of women who reported that
they had been given any of the Informed Choice leaflets in the intervention units compared with the control units, which showed
little change (table 5). However, it was difficult to assess the uptake
of the intervention leaflets with any precision. A large minority of
women in the intervention units (44%) reported that they had been
given at least one of the Informed Choice leaflets before
the intervention had taken place (table 5). It is possible that a few
Informed Choice leaflets were distributed in all the maternity units before the trial. However, most of this reported use
probably relates to leaflets other than those under study because women
had difficulty in distinguishing the intervention leaflets from other
leaflets available in the maternity units.
|
| |
Discussion |
|---|
|
|
|---|
In this randomised controlled trial the use of Informed Choice leaflets did not change the proportion of women who reported exercising informed choice, or components or consequences of informed choice, in maternity care. This is surprising as a recent systematic review concluded that decision aids improve knowledge and increase the proportion of people who assume a more active role in decision making.3
Limitations in design
Possible limitations of this study are response bias, poor
definition of "informed choice," and lack of power. The response
rate of 64% may have introduced some bias, with under-representation of non-white women and women with manual occupations in both
intervention and control groups. The pilot study of two of the leaflets
suggested that women with manual occupations might benefit more from
the leaflets,10 suggesting that we may have underestimated
the true effect of the leaflets. However, the main study found no
relation between social class and effect of the leaflets.6
The question used to measure informed choice may have been insensitive. However, we used two different questions and neither showed change. Additionally, we found little change in the components of informed choice, which was consistent with a genuine lack of change in informed choice. Although we recruited fewer women than planned, the analysis for postnatal women was adequately powered due to a smaller intraclass correlation coefficient than estimated for the sample size calculation. The analysis for antenatal women had a power of about 65%. However, observed changes were small, and, although low power can explain the lack of significance, it cannot explain the size of the observed effect. Overall, it is unlikely that the study failed to detect any important change.
Everyday practice
We carried out this trial in everyday practice. We included
thousands of women who might have received the 10 leaflets, but only
70% reported receiving one of them. Studies reported in the systematic
review of decision aids were explanatory trials, with the implicit
assumption that all patients received the intervention.3
One conclusion might be that the systematic review showed that decision
aids can be effective under certain circumstances but that our study
showed that they are not necessarily effective in the real world. The
pragmatic nature of our design may have affected the outcome, but that
outcome represents a true picture of the impact of introducing the
leaflets into clinical practice.
Quality of implementation
There is some evidence from the trial that there were difficulties
with the implementation of the intervention. The accompanying
qualitative study shows that the Informed Choice leaflets
were not introduced to women as special and different from other
leaflets.4 Additionally, not all women reported that they
had been given any of the leaflets during the intervention. This
limited implementation of decision aids is by no means unique to either
the Informed Choice leaflets or maternity
care.11
Generalisability of findings
The results are generalisable to maternity units that use
Informed Choice leaflets to promote informed choice but not
to health professionals purchasing the leaflets to guide evidence based
practice or individual enthusiastic health professionals purchasing the
leaflets to help meet the information needs of their clients.
| |
Acknowledgments |
|---|
We thank midwives, managers, and administrative staff in the maternity units in Wales (unnamed to ensure confidentiality of participating units), who worked so hard to help us with data collection. We thank the thousands of women who completed our questionnaires at such an important time in their lives.
Contributors: AO'C contributed to the design of the study, designed the questionnaire, coordinated data collection, contributed to data analysis, wrote the paper, and is guarantor for the paper. SJW contributed to the design of the study, undertook the data analysis, and contributed to the writing of the paper. JPN and KJT contributed to design of the study and the questionnaire, interpretation of the data, and writing of the paper. MK contributed to the design of the study and the questionnaire and writing of the paper. Helen Stapleton contributed to the design and piloting of the questionnaire. Heather Rothwell helped to establish data collection systems. Andrea Shippam and April Dagnell undertook data administration. Donna Mead, Laurence Moseley, Barbara Bale, Gwenan Thomas, and Sandy Kirkman were members of the research team for the wider study, of which the randomised controlled trial forms a part.
| |
Footnotes |
|---|
Funding: This work was commissioned by the NHS Centre of Reviews and Dissemination and funded by the Department of Health. The views expressed here are those of the authors and not necessarily those of the Department of Health.
Competing interests: None declared.
| |
References |
|---|
|
|
|---|
| 1. | Charles C, Gafni A, Whelan T. International conference on treatment decision-making in the clinical encounter [editorial]. Health Expect 2000; 3: 1-5[CrossRef][Medline]. |
| 2. | Entwistle VA. Supporting and resourcing treatment decision-making: some policy considerations. Health Expect 2000; 3: 77-85[CrossRef][Medline]. |
| 3. |
O'Connor AM, Rostom A, Fiset V, Tetroe J, Entwistle V, Llewellyn-Thomas H, et al.
Decision aids for patients facing health treatment or screening decisions: systematic review.
BMJ
1999;
319:
731-734 |
| 4. |
Stapleton H, Kirkham M, Thomas G.
Qualitative study of evidence based leaflets in maternity care.
BMJ
2002;
324:
639-643 |
| 5. | Degner L, Sloan JA, Venkatesh P. The control preference scale. Can J Nurs Res 1997; 29: 21-43[Medline]. |
| 6. | Kirkham M, Stapleton H, eds. Informed choice in maternity care: an evaluation of evidence based leaflets. York: University of York, 2001 (report 20). |
| 7. | Diehr P, Martin DC, Koepsell T, Cheadle A. Breaking the matches in a paired t-test for community interventions when the number of pairs is small. Stat Med 1995; 14: 1491-1504[Web of Science][Medline]. |
| 8. | Murray DM. Design and analysis of group randomised trials. Oxford: Oxford University Press, 1998. |
| 9. | SAS Institute. SAS/STAT user's guide. Version 6. 4th ed. , Vol 2 Cary, NC: SAS Institute, 1989. |
| 10. | Oliver S, Rajan L, Turner H, Oakley A. A pilot study of two informed choice leaflets on positions in labour and routine ultrasound. York: Social Science Research Unit and NHS Centre for Reviews and Dissemination, 1996 (CRD report 7). |
| 11. | Holmes-Rovner M, Valade D, Orlowski C, Draus C, Nabozny-Valerio B, Keiser S. Implementing shared decision-making in routine practice: barriers and opportunities. Health Expect 2000; 3: 182-191[CrossRef][Medline]. |
(Accepted 5 October 2001)