Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
Natalie Kenney National
Perinatal Epidemiology Unit, Institute of Health Sciences, Oxford OX3
7LF
Correspondence to: A Macfarlane
A.J.Macfarlane{at}city.ac.uk
| |
Abstract |
|---|
|
|
|---|
Objectives:
To document the extent to which maternity data are collected and how they are recorded, and to identify problems
that may affect their availability throughout the NHS.
Methods:
Postal survey in September 1997 with
structured questionnaires.
Setting:
207 NHS trusts with maternity units in England.
Participants:
Heads of midwifery in maternity units.
Main outcome measures:
Extent to which maternity data
were routinely recorded, how they were recorded and evaluated, and to
whom they were made available.
Results:
167 (81%) of questionnaires were returned, representing 166 trusts. Of these trusts, 165 collected
17 of the 19 data items in HES maternity tail, and 158 collected
40 of the 45 items selected from Körner dataset. Only 18 collected all five items
selected from the "indicators of success," and 17 did not collect
any. In 58 of trusts data were primarily recorded on paper. A
computerised maternity information system was used by 106 (63%) of
trusts, but many recorded data on paper first. Thirty four did not
audit data for accuracy. Most trusts analysed data not routinely
collected at national level, but 18 did not analyse HES maternity tail
and 17 did not analyse Körner data.
Conclusions:
Improvement is needed in quality,
completeness, and availability of maternity data at a national level,
particularly if the NHS information strategy is to be successfully
implemented. Although most of the data items in national datasets are
recorded locally, variations in the way data are defined, recorded, and analysed and lack of linkage between computer systems restrict their
access, availability, and use at local, district, and national levels.
|
Key messages
|
| |
Introduction |
|---|
|
|
|---|
The NHS information strategy for England, described in Information for Health,1 reiterated the need to improve the accuracy, completeness, and availability of NHS data.2 Data about maternity care are needed at all levels of the NHS to monitor the health of women and their babies and the services provided. 3 4 These data are also required to audit, monitor, and evaluate changes in the provision of care.5 Women need this information to inform decisions about their care. 1 6 It is widely acknowledged that national maternity data for England are incomplete and that some are inaccurate or unavailable7-9 and that they need to be improved. 7 9 10
At a national level, the Department of Health's hospital episode statistics (HES) system collects a core set of data about each episode of "admitted patient care." For episodes in which a baby is born, a supplementary set of data should be appended in the HES "maternity tail."11 These data are lacking from about a third of delivery records.11 The core HES record, the maternity tail, and additional maternity data are commonly referred to jointly as "Körner" datasets.12
To investigate the reasons for deficiencies in national maternity data,
a project was commissioned to document the extent to which maternity
data are recorded in NHS trusts and to identify problems that may
affect the quality or availability of this information for use
elsewhere in the NHS and to women using the maternity services. This
paper reports, in brief, on the survey of NHS trusts with maternity
units in England.
| |
Methods |
|---|
|
|
|---|
We designed a structured questionnaire that asked NHS trusts which maternity data items were routinely collected, how the data were recorded, whether they were audited for accuracy, the extent to which they were analysed, how accessible they were, how they were used, and to whom they were made available. The questionnaire was piloted in Northern Ireland.
In September 1997 we sent questionnaires to heads of midwifery in all 207 NHS trusts with maternity units in England. Reminder letters were sent to non-respondents three and six months later.
The replies were checked for anomalies and analysed with SPSS 7.5 for Windows.
| |
Results |
|---|
|
|
|---|
We received replies from 167 (81%) of maternity units, representing 166 NHS trusts. Some of the respondents did not answer all of the questions. Midwifery managers and midwives usually completed the questionnaires.
Extent of data collection
Of the 165 NHS trusts that replied to the question about data
collection, all routinely collected
17 of the 19 data items contained
in the HES maternity tail11 and 158 (96%) routinely
collected
40 of the 45 data items selected from the Körner
maternity dataset.12 Most trusts also recorded a
substantial number of other maternity data items. Of the 10 "indicators of success" listed in Changing
Childbirth,6 five are easily quantified, but only 18 trusts routinely collected all five items, while 17 collected none
(table 1).
|
How data were recorded
In 58 of the 166 trusts, data were primarily recorded on paper.
Some data may have been recorded on the patient administration system,
but we did not investigate the extent to which this was done. Of these
trusts, 48 stated that they experienced problems recording data.
Audit of data
One hundred and twenty six (76%) of the trusts stated that data
were routinely audited for accuracy, with 63 doing so monthly or more
frequently. Resources did not allow us to check the extent or quality
of these audits. Data were more likely to be audited if midwives
collected data on paper and subsequently entered them onto computers.
Analysis of data
Data from the HES maternity tail and Körner dataset were
analysed by 150 (90%) of the trusts, and most trusts produced at least
some statistical analyses for the additional data that they collected.
We did not ascertain the extent to which data were analysed. Most
trusts analysed data with computer software, but 28% did so manually.
Access to data
We asked the trusts to provide aggregated figures for six data
categories for the year 1996, including items in the HES maternity tail
and Körner dataset (table 2). Only 15 trusts could provide figures
for all the data items. Although a further 151 trusts were able to
provide some of the data, many could not provide them in the form
requested, either because aggregated statistics were not routinely
produced for those items or there were difficulties accessing paper
records. Some trusts provided aggregated statistics for the whole data
category. Many NHS trusts could not provide the required figures
because they used different definitions or groupings of data. Other
researchers have encountered the same
problem.13
|
Availability and use of data
Of those trusts that answered the question, 93% (141/152)
presented maternity data at local clinical meetings. Only 66% (97/146)
routinely provided data to all clinicians, 53% (57/108) provided data
to general practitioners, and 27% (32/118) included data in
information leaflets for women. The type of data made routinely
available was not specified. Although 91% (128/140) of trusts provided
data to their local health authority, our parallel survey of health
authorities showed that these were more likely to relate to contracting
than to clinical practice.14
| |
Discussion |
|---|
|
|
|---|
Problems in the collection of maternity data in English NHS trusts lead to inadequacies in the quality, completeness, and availability of the information. These problems restrict the use of the data by the NHS and may impede the implementation of the NHS information strategy.1
We found that the NHS maternity units collected a substantial amount of data, but many trusts used different definitions for various data items. This limits their use throughout the NHS because of the difficulty in aggregating and comparing data that have been collected using different definitions.15
There may be justifiable reasons for not collecting data for the "indicators of success" listed in Changing Childbirth,16 but the lack of these data makes it difficult to assess the policy's overall impact. This information may be collected on a sample or ad hoc basis for health authorities, but our survey of health authorities found that only 58% monitored the implementation of the policy.14
The combination of computerised and paper methods commonly used by NHS trusts to record data can make linkage and management of data difficult, restrict their use, and affect the flow of data through the NHS and to the Department of Health. The duplication of data recording is wasteful of time and NHS resources.15 Improved linkage is needed between computerised maternity information systems and patient administration systems to ensure that data are recorded only once.
Although computerised maternity information systems are supposed to make it easier to record and use data,17 many problems persist. 18 19 Eleven of the trusts in our survey reported that it would take two or more weeks to obtain data that were not immediately accessible. Unless information is readily available it cannot be used effectively to inform NHS decision making. 1 6 9
It is of concern that 28% of the trusts analysed their data manually. This is laborious, time consuming, and limits the extent of analyses. This can impede the use of data locally and the forwarding of information to NHS systems. If the NHS information strategy is to be successfully implemented, these issues must be addressed.
Evaluating the quality of data will soon become mandatory in the NHS,1 but 24% of the trusts did not routinely audit their maternity data for accuracy. Conducting regular audit of data and educating clinicians about how to audit their maternity records can improve data quality. 10 20 Feeding back data to those who collect them is also associated with improving data quality and clinical practice, 20 21 but 33% of the trusts did not routinely provide these data to clinicians.
Most trusts produced statistical analyses of data not routinely collected by the Department of Health. This suggests that there is a local need for these analyses, but their use is limited by a lack of comparable national data. Although maternity data were often made available within NHS trusts, the availability of data to others was limited. With the emphasis on sharing information in the NHS and the provision of information to users of the health services, 1 2 availability must be improved.
Conclusions
Most of the maternity data missing at a national level are
widely collected at a local level. Variations in the ways data are
recorded, and many other problems, contribute to inadequacies in the
quality, completeness, and availability of this information. Lack of
computer systems for recording data in some trusts and lack of linkage
between "stand alone" computer systems and hospitals' patient
administration systems in others are major problems. These problems
restrict data use at all levels of the NHS15 and may
impede the implementation of the NHS information strategy.1
| |
Acknowledgments |
|---|
We thank all those who completed questionnaires for this project.
Contributors: AM initiated the research at the suggestion of Kate Jackson, director of the Changing Childbirth Implementation Team; cowrote the protocol; assisted with questionnaire design and data analysis; and participated in writing and editing the paper. NK cowrote the protocol, assisted with questionnaire design, and participated in data collection and analysis and writing and editing the paper. Pam Dobson (Kings College Healthcare NHS Trust), Cathy Winter (Southmead NHS Trust), Maggie Jeffries (Oxford Radcliffe NHS Trust), Fiona Alderdice (Queens University Belfast), Lesz Lancucki (Department of Health), Jane Cowl (Changing Childbirth Implementation Team), and Meg Goodman (Maternity Alliance) commented on and discussed core ideas about the content and design of the questionnaire. Sarah Ayers (National Perinatal Epidemiology Unit) designed the computer databases and dealt with all computing issues. Jo Garcia, Rona McCandlish, Sally Marchant, Valerie King, and Kirstie McKenzie-McHarg commented on the questionnaire design and drafts of the paper. Suzanne Williams, Sarah Bowler, and Hedwig Van Asten entered the data. AM and NK are guarantors for the paper.
| |
Footnotes |
|---|
Funding: AM was funded through the Department of Health's policy research programme. NK was funded by the Changing Childbirth Implementation Team, Department of Health.
Competing interests: None declared.
| |
References |
|---|
|
|
|---|
| 1. | NHS Executive. Information for health: an information strategy for the modern NHS 1998-2005. Leeds: NHS Executive , 1998. |
| 2. | Department of Health. The new NHS: modern and dependable. London: DoH , 1997. |
| 3. | Kenney N, Macfarlane A, Dobson P. The use of maternity statistics at a local level. Br J Midwives 1999; 7: 49-51. |
| 4. | Kenney N, Macfarlane A, Lancucki L, Chapple J, Davidson L. Information for local, national and international populations. Br J Midwives 1999; 7: 120-123. |
| 5. | Banfield PJ, O'Hanlon M, Chapple JC, Mugford M, Beard RW. How clinicians respond to computer-generated statistics in maternity care. In: Richards B, ed. Current Perspectives in Healthcare Computing. Proceedings of conference in Harrogate, 9-11 March, 1992. Weybridge: British Journal of Healthcare Computing, 1992:367-372. |
| 6. | Department of Health. Changing childbirth: the report of the Expert Maternity Group. London: HMSO , 1993. |
| 7. | Middle C, Macfarlane A. Labour and delivery of `normal' primiparous women: analysis of routinely collected data. Br J Obstet Gynaecol 1995; 102: 970-977[Medline]. |
| 8. |
Smith L.
Problems in retrieving national data on births: questionnaire survey.
BMJ
1998;
316:
1710-1711 |
| 9. | House of Commons Health Committee. 2nd report, maternity services. , Vol 1 London: Stationery Office , 1992. |
| 10. | Department of Health. Confidential enquiry into stillbirths and deaths in infancy: CESDI annual report 1 January to 31 December 1993. Part 2. London: DoH , 1995. |
| 11. | Department of Health. Statistical bulletin: NHS maternity statistics, England: 1989-90 to 1994-95. London: DoH , 1997. |
| 12. | Steering Group on Health Services Information. Supplement to the 1st and 4th reports to the secretary of state. London: HMSO , 1985. |
| 13. | Cleary R, Beard RW, Coles J, Devlin HB, Hopkins A, Roberts S, et al. The quality of routinely collected maternity data. Br J Obstet Gynaecol 1994; 101: 1042-1047[Medline]. |
| 14. | Kenney N, Macfarlane A. The use of maternity data by health authorities in England. Oxford: NPEU, (in press). |
| 15. | NHS Executive. Seeing the wood, sparing the trees: efficiency scrutiny into the burdens of paperwork in NHS trusts and health authorities. Leeds: NHS Executive , 1996. |
| 16. |
Bradshaw MG, Bradshaw PL.
Changing childbirth the midwifery managers' tale.
J Nurs Manage
1997;
5:
143-149.
|
| 17. | NHS Executive. Benefits realisation monograph on maternity information systems: British Computer Society Nursing Specialist Group, Midwifery Focus Group and Information Management Group of the NHS Executive. Leeds: NHS Executive , 1996. |
| 18. | Kenney N, Macfarlane A. The use of computerised maternity information systems in England and Wales. Midwives 1997; 110: 204-206[Medline]. |
| 19. | Dobson P. Survey of computerised midwifery information systems. Br J Midwives 1995; 3: 487-492. |
| 20. | Bowns I, Whitfield M, Coleman P, Sampson F, Stevenson M, Bacigalupo R. Health data marker research project: conclusion and recommendations. In: Clinical Systems Group. Improving clinical communications. Leeds: Clinical Systems Group, 1998:1-66. |
| 21. | Mugford M, Banfield P, O'Hanlon M. Effects of feedback on clinical practice: a review. BMJ 1991; 303: 398-402. |
| 22. | Hartshorn A. Maternity care data project: overview, updated June 1999. Leeds: NHS Executive , 1999. |
(Accepted 29 July 1999)