Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
a Department of Community Paediatric Research, Montreal Children's Hospital, McGill University Faculty of Medicine, Montreal, Quebec, Canada, b Departments of Pediatrics and of Epidemiology and Biostatistics, McGill University Faculty of Medicine, c Division of Clinical Epidemiology, Royal Victoria Hospital, Montreal
Correspondence to: Dr Ian Roberts, Department of Epidemiology and Biostatistics, Institute of Child Health, London WC1N 1EH.
Abstract
Objective: To quantify the effectiveness of home visiting programmes in the prevention of child injury and child abuse.
Design: Systematic review of 11 randomised controlled trials of home visiting programmes. Pooled odds ratios were estimated as an inverse variance weighted average of the study specific odds ratios.
Setting: Randomised trials that were available by April 1995.
Subjects: The trials comprised 3433 participants.
Results: Eight trials examined the effectiveness of home visiting in the prevention of childhood injury. The pooled odds ratio for the eight trials was 0.74 (95% confidence interval 0.60 to 0.92). Four studies examined the effect of home visiting on injury in the first year of life. The pooled odds ratio was 0.98 (0.62 to 1.53). Nine trials examined the effect of home visiting on the occurrence of suspected abuse, reported abuse, or out of home placement for child abuse. Because of the potential for bias in outcome reporting in these studies, pooled effect estimates were not calculated.
Conclusions: Home visiting programmes have the potential to reduce significantly the rates of childhood injury. The problem of differential surveillance for child abuse between intervention and control groups precludes the use of reported abuse as a valid outcome measure in controlled trials of home visiting.
|
Key messages
|
Introduction
Home visiting programmes have long been advocated for improving the health of disadvantaged children. In Britain home visits by health visitors are considered to have a key role in accident prevention because of the advice given during the visits on child development and home safety.1 In the United States home visiting has been promoted primarily for the prevention of child abuse and neglect.2 In 1991 the United States Advisory Board on Child Abuse and Neglect called for the establishment of a universal programme of home visiting in an attempt to stem the increase in numbers of child abuse reports.3
Over the past two decades several randomised trials have examined the effect of home visiting programmes on the occurrence of child abuse and other child health outcomes. The results of these trials, however, have been conflicting. Although several published articles have reviewed the evidence from randomised trials,4 5 none of these satisfies the methodological criteria that have been proposed for scientific overviews.6 To quantify the effect of home visiting programmes on the occurrence of child injury and abuse we conducted a systematic review.
Methods
Inclusion criteria--We included studies in the systematic review if they met all three of the following criteria: (a) the assignment of the study participants to the intervention or control group had to be random or quasi-random--for example, alternate record numbers; (b) the study intervention had to include one or more postnatal home visits; and (c) the study had to address the outcomes of child injury (unintentional or intentional).
Identification of relevant trials--We identified trials by a computerised literature search of Medline (January 1966 to April 1995) and Embase (January 1975 to April 1995). We also searched the social sciences citation index for articles referencing randomised trials of home visiting. Key terms used for searching included social support, family support, home (and health) visitors, home (and health) visitation, child abuse, and child neglect. We reviewed the references of all relevant papers found in the searches, as well as those of review articles and textbooks. Because home visiting is often encountered in the context of the prevention of child abuse, a hand search was conducted of the Journal of Child Abuse and Neglect (from 1977 1(1) through to 1995 19(3)). We contacted the authors of identified papers and experts in the field and asked about any published or unpublished work that they might be aware of. To access studies not formally published, such as research reports and abstracts, we searched relevant conference proceedings. If studies met the first two inclusion criteria but did not report outcomes of child injury or abuse we asked the authors to provide any unpublished data on child injury.
Data extraction and study appraisal--We extracted the following data from each study: strategy for allocation concealment, number of randomised participants, duration of follow up, loss to follow up, blinding of outcome assessment, and the professional background of the home visitor (health or welfare professional or non-professional). We evaluated the quality of the trial using a modification of Prendiville's criteria.7 With this approach trials are scored from 1 to 3 (1=poorest score, 3=best score) on three important aspects of study methodology: control of confounding at entry (adequacy of allocation concealment); control of selection bias (extent to which analyses are based on all randomised participants); and control of information bias in assessing outcome (blinding of observers). While the original criteria assigned a score of 3 for random assignment by telephone and 2 for using opaque sealed envelopes, we assigned a score of 3 for using either of these methods. Trials that assigned subjects to treatment by using methods intended to reduce the risk of foreknowledge of allocation but which were not as secure as random assignment by telephone or use of opaque sealed envelopes scored 2. Trials in which the authors did not report the method of allocation concealment (and were unable to provide further details or could not be contacted) and trials using alternate record numbers or other similar strategies scored 1. If a published report contained insufficient information for us to assess the quality of the trial, we asked the authors to provide further details. Two assessors performed the data extraction independently, with agreement on methodological criteria evaluated with weighted (kappa).8 Each point of disagreement was settled by collaborative review.
Statistical methods--The measure of association, the odds ratio, was calculated directly for studies in which injury was expressed in binary (yes/no) form, with the variance estimated by Wolf's method.9 For studies in which injury occurrence was allowed to be multiple and expressed as an incidence density, the odds ratio was estimated on the assumption of a Poisson distribution, with the probability of a participant having at least one event being given by 1-e-ID, where ID is the incidence density. Pooled odds ratios were then calculated as an inverse variance weighted average of the study specific odds ratios.
Results
The combined search strategies identified 33 trials meeting the first two inclusion criteria (randomised trials of postnatal home visiting).10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 Eleven of these trials (with 3433 participants) reported outcome data on injury or abuse, or on both.10 11 12 13 14 15 16 17 18 19 42 One of the eleven trials was published as an abstract only42; the author of this report was contacted, but the relevant outcome data were not available for inclusion in the review. Of the remaining 10 trials, one reported no differences in the occurrence of accidents,13 and in another injury outcome data had been collected but not reported.19 In both of these trials the authors gave us the relevant data. The authors of 13 of the 22 trials meeting the first two inclusion criteria but not reporting outcome data on injury or abuse responded to our request for information on unpublished injury outcomes. As a result of this process one further trial was identified that met all three inclusion criteria.43 Eleven trials were therefore identified that had outcome data on injury or abuse, or both.
Table 1 shows the scores for the quality of methodology for the trials included in the systematic review. The weighted (kappa) for agreement between the two assessors was 0.94 for adequacy of allocation concealment, 0.51 for the extent to which analyses were based on all randomised participants, and 0.78 for blinding. The mean scores for the unintentional injury outcomes were: adequacy of allocation concealment, 2.4; extent to which analyses were based on all randomised participants, 1.9; blinding, 1.5.
Table 1--Scores* for quality of methodology and study characteristics for randomised trials of home visiting
----------------------------------------------------------------------------------------------------------------------------
Allocation Analysed as No of participants
Trial (year, country) concealment randomised+ Blinding+ randomised Follow up (years)
----------------------------------------------------------------------------------------------------------------------------
IHDP (1995, USA)43 3 2 1 985 1
Marcenko et al (1994, USA)10 2 2 1 225 0.8
Johnson et al (1994, Republic of Ireland)11 3 2 1 262 1
Barth (1991, USA)12 1 2 1 313 3
Dawson et al (1989, USA)13 1 1 1 145 1
Hardy et al (1989, USA)14 1 2 2 290 1.9
Olds et al (1986, USA)15 3 1 2 400 4
Lealman et al (1983, England)16 3 2 3 312 1.5
Larson (1980, Canada)17 3 2 2 80 1.5
Siegel et al (1980, USA)18 3 3 1 321 1
Gray et al (1979, USA)19 3 2 1 100 1.4
----------------------------------------------------------------------------------------------------------------------------
IHDP=infant health and development programme.
*On scale of 1 to 3 (1=poorest score, 3=best score).
+Judged for injury outcome measures whenever possible. |
CHILD INJURY
Table 2 shows the data for the eight trials that examined the effect of home visiting on the occurrence of childhood injury. Six of the eight trials reported a lower incidence of injury in the group that received home visits. One study reported three injury outcome measures, representing three different time periods of follow up. For this study, the overall injury rates and odds ratios were calculated for the entire (four year) follow up period (odds ratio 0.74 (95% confidence interval 0.55 to 0.99)). The pooled odds ratio for injury for the eight trials (figure) was 0.74 (0.60 to 0.92). Four studies examined the effect of home visiting on injury occurrence in the first year of life only. The pooled odds ratio was 0.98 (0.62 to 1.53).
Table 2--Home visiting and childhood injury
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Participants Odds ratio (95%
Trial (year, country) Study population Intervention Outcome visited Controls confidence interval)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
IHDP (1995, Parents of low birthweight Postnatal, non-professional, "Non-hospitalised injuries by 17/345 26/551 1.05 (0.56 to 1.96)
USA)43 premature infants emotional, social, practical, and maternal report"
informational support
Johnson et al Disadvantaged first time Postnatal, non-professional support "Suffered an accident" 3/127 8/105 0.29 (0.08 to 1.14)
(1993, Republic mothers and encouragement in child
of Ireland)11 rearing using the child
development programme
Hardy et al Inner city mothers of poor Postnatal, non-professional "Outpatient diagnosis of 8/131 15/132 0.51 (0.21 to 1.24)
(1989, USA)14 infants parenting and childcare education closed head trauma
Dawson et al Pregnant women attending for Antenatal and postnatal, "Accidents or ingestion 5/67 6/44 0.51 (0.15 to 1.79)
(1989, USA)13 maternity care not selected non-professional emotional requiring medical attention
for psychosocial risk support; information and help in
using community resources
Olds et al Primiparas who were Antenatal and postnatal parenting "Emergency visit for accidents 0.12* 0.06* 2.06 (0.83 to 5.15)
(1986, USA)15 teenagers, unmarried, or of education in infant development and poisoning (1st year of
low socioeconomic status from nurse; involvement of life)"
family members and friends in
child care; linkage of family
members with health and human
services
"Emergency visit for accidents 0.15* 0.34* 0.40 (0.21 to 0.77)
and poisoning (2nd year of
life)"
"Emergency department 0.47* 0.61* 0.71 (0.49 to 1.04)
visits for injuries/ingestion
(25 to 50 months)"
Lealman (1983, Families predicted to be at risk Postnatal intervention and support "Admissions with trauma" 1/103 4/209 0.50 (0.06 to 4.55)
England)16 of child abuse from social worker
Larson (1980, Working class families Postnatal, non-professional "Significant falls, cuts, burns, 1.26** 1.55** 0.73 (0.46 to 1.16)
Canada)17 emotional and informational poisonings or other injuries"
support
Gray et al Families most likely to exhibit Postnatal emotional support from "Accidents by maternal report" 16/26 13/25 1.48 (0.49 to 4.5)
(1979, USA)19 abnormal parenting practices physician/nurse/lay visitor
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Pooled results 0.74 (0.60 to 0.92)
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------
IHDP=infant health and development programme.
*Adjusted mean. **Cumulative accident rate per child.
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
CHILD ABUSE
Table 3 shows the data for the nine trials that examined the effect of home visiting on the occurrence of suspected abuse, reported abuse, or out of home placement for child abuse. In four trials the frequency of occurrence of abuse was lower in the visited group. In five trials the frequency of occurrence was higher in the visited group. Substantial heterogeneity of the odds ratios was found across the studies. The potential for bias in the outcome reporting was considered to be a serious threat to validity in all nine studies. Specifically, the presence of the home visitor may have resulted in an increased surveillance for child abuse and hence an increase in the number of reports of abuse. If present, this bias would have resulted in an apparent increased incidence of abuse in the visited group. Pooled effect estimates were therefore not calculated.
Table 3--Home visiting and child abuse
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Participants Odds ratio (95%
Trial (year, country) Study population Intervention Outcome visited Controls confidence interval)
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Marcenko et al Women at risk of out of home Antenatal, postnatal, Out of home placement 35/110 15/77 1.93 (0.97 to 3.85)
(1994, USA)10 placement of their newborns professional/non-professional
to provide peer support; help
to identify service needs;
home based health education
and parenting training
Johnson et al Disadvantaged first time Postnatal, non-professional Abuse unspecified 0/127 3/105 0.11 (0.01 to 2.25)
(1993, Republic mothers support and encouragement
of Ireland)11 in child rearing using the
child development programme
Barth Parents identified as at risk of Antenatal and postnatal, Reported abuse 64/97 54/94 1.44 (0.80 to 2.58)
(1991, USA)12 engaging in child abuse by non-professional, informational,
community professionals emotional, and practical support
Hardy et al Inner city mothers of poor Postnatal, non-professional Suspected abuse 2/131 13/132 0.14 (0.03 to 0.64)
(1989, USA)14 infants parenting and childcare
education
Dawson et al Pregnant women attending for Antenatal and postnatal, Reported abuse 5/67 1/44 3.47 (0.39 to 30.74)
(1989, USA)13 maternity care not selected non-professional emotional
for psychosocial risk support; information and help in
using community resources
Olds et al Primiparas who were Antenatal and postnatal parenting Registered abuse (age 0-2 years) 0.05* 0.10*
(1986, USA)15 teenagers, unmarried, or of education in infant development Registered abuse (age 2-4 years) 0.08* 0.05*
low socioeconomic status from nurse; involvement of
family members and friends in
child care; linkage of family
members with health and human
services
Lealman et al Families predicted to be at risk Postnatal intervention and support Registered abuse 1/103 3/209 0.67 (0.07 to 6.55)
(1983, England)16 of child abuse from social worker
Siegel et al Women with low income Postnatal, non-professional support Reported abuse 14/159 9/162 1.64 (0.69 to 3.91)
(1980, USA)18 to promote mothers' involvement
with their infants and to support
mothers in coping with range of
stresses
Gray et al Families most likely to exhibit Postnatal emotional support from Suspected abuse 0/50 5/50 0.08 (0.00 to 1.52)
(1979, USA)19 abnormal parenting practices physician/nurse/lay
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------
*Adjusted means. |
Discussion
Although home visiting is unlikely to be associated with adverse effects, the widespread implementation or intensification of home visiting programmes may have important resource implications. Our meta-analysis of the results from eight randomised trials shows a significant preventive effect of home visiting on the occurrence of childhood injury.
METHODOLOGICAL ISSUES
The effect of home visiting on the occurrence of child abuse varied across studies in both magnitude and direction. This may have been the result of bias in the assessment of child abuse outcomes. A report of child abuse entails the occurrence and discovery of an injury, as well as an attribution of intent. In several of the primary studies the information leading to the report of child abuse was provided by the home visitor, raising the possibility of "surveillance bias." Differential surveillance for child abuse between the intervention and control groups would almost certainly result in a substantial underestimation of any beneficial effect of home visiting programmes on the occurrence of child abuse, possibly to the extent of reversing the direction of the apparent effect. Indeed, the usefulness of reported abuse as an outcome measure in trials of home visiting deserves reconsideration.
Publication bias is one of the most important potential threats to the validity of systematic reviews. Such bias may arise if certain outcome data are selectively omitted from published reports because the results fail to reach significance. To avoid this type of bias we wrote to the authors of all identified randomised trials of home visiting programmes, asking them to provide any unpublished outcome data on injury or abuse (one further trial was identified by this approach). The authors of nearly half of the studies meeting the first two inclusion criteria, however, could not be traced. These were predominantly small studies and so would make a comparatively minor impact on the overall result. Funnel plots can be used to estimate the extent of publication bias, but because their use is limited to meta-analyses that have enough trials to allow a funnel shape to be visualised, this approach is not helpful in this review.44
A recurring issue in the context of systematic reviews is the extent to which the interventions examined are sufficiently comparable for the results from the studies to be combined. The effectiveness of home visiting may depend on its timing, duration, and intensity. Nevertheless, for unintentional childhood injuries no clear heterogeneity was seen in the effect across studies.
IMPLICATIONS
Because most of the trials included in this review used non-professional home visitors, the question of the relative effectiveness of professional versus non-professional home visiting remains unanswered. The observed effect of home visiting on child injury is consistent with a generic effect of home based maternal support. In Britain a programme of home visiting is provided by health visitors. Current health visiting programmes, however, should not be assumed to achieve the effects on childhood injury that are implied by the results of this systematic review. Firstly, the experimental home visiting may have been more intense than that which is typically provided by health visitors. Secondly, in all but one of the trials the intervention was targeted at groups considered to be at increased risk for adverse child health outcomes. This may restrict the extent to which the results are generalisable to programmes of universal health visiting.
The Health of the Nation strategy established child accident prevention as a national priority. Few injury prevention interventions, however, have been shown to reduce injury rates in randomised controlled trials. Given the results of this systematic review, the effectiveness of home visiting by health visitors and non-professional support agencies in preventing childhood injury deserves further examination.
|
We thank the authors of the original articles who replied to inquiries and provided data not included in their published articles. We specifically thank Drs Marie McCormick and Pamela Klebanov for conducting new analyses of the data from the infant health and development programme.
Funding: IR was supported by an overseas fellowship from the Health Research Council of New Zealand. SS is a research scholar of the Fonds de la Recherche en Sante in Quebec.
Conflict of interest: None.