Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
what does meta-analysis add?
J L Tang a Division of Public Health and
Primary Care, University of Oxford, Radcliffe Infirmary, Oxford OX2 6HE, b Clinical Trial Service Unit and
Epidemiological Studies Unit, Harkness Building, Radcliffe Infirmary, c Flinders University of South Australia School of Medicine,
Adelaide, Australia
Correspondence to: Dr Armitage
Jane.armitage{at}ctsu.ox.ac.uk
Abstract
Objectives: To estimate the efficacy of dietary
advice to lower blood total cholesterol concentration in free-living subjects and to investigate the efficacy of different dietary recommendations.
Design: Systematic overview of 19 randomised
controlled trials including 28 comparisons.
Subjects: Free-living subjects.
Interventions: Individualised dietary advice to
modify fat intake.
Main outcome measure: Percentage difference in blood
total cholesterol concentration between the intervention and control groups.
Results: The percentage reduction in blood total
cholesterol attributable to dietary advice after at least six months of
intervention was 5.3% (95% confidence interval 4.7% to 5.9%). Including both short and long duration studies, the effect was 8.5% at
3 months and 5.5% at 12 months. Diets equivalent to the step 2 diet of
the American Heart Association were of similar efficacy to diets that
aimed to lower total fat intake or to raise the polyunsaturated to
saturated fatty acid ratio. These diets were moderately more effective
than the step 1 diet of the American Heart Association (6.1%
v 3.0% reduction in blood total cholesterol concentration; P<0.0001). On the basis of reported food intake, the
targets for dietary change were seldom achieved. The observed reductions in blood total cholesterol concentrations in the individual trials were consistent with those predicted from dietary intake on the
basis of the Keys equation.
Conclusions: Individualised dietary advice for
reducing cholesterol concentration is modestly effective in free-living subjects. More intensive diets achieve a greater reduction in serum
cholesterol concentration. Failure to comply fully with dietary
recommendations is the likely explanation for this limited efficacy.
|
Key messages
|
Introduction
Blood cholesterol concentration is an important and modifiable risk factor for coronary heart disease.1 A sustained reduction in blood total cholesterol concentration of 1% is associated with a 2-3% reduction in incidence of coronary heart disease.2 Even small reductions in population cholesterol concentrations could therefore be worth while.
Dietary changes can reduce blood total cholesterol concentrations. Results from metabolic ward studies have shown that feasible changes in diet can reduce blood total cholesterol concentration by 10-15%.3 The chief determinants of blood total cholesterol concentrations are dietary intake of saturated fat, polyunsaturated fat, and cholesterol.3-6 Cholesterol concentrations are also affected by reduced energy intakes resulting in weight loss7 and possibly by specific dietary supplements such as fibre,8 garlic,9 and fish oils.10 Diets that lower cholesterol concentrations may modify some or all of these factors.
Individualised dietary counselling, usually delivered through primary care, has been proposed as a method of achieving population goals for reducing coronary artery disease by the British government in its Health of the Nation targets.11 But, the extent to which individualised cholesterol lowering diets are effective in free-living populations is controversial. One review claimed that the effect of the usual diet advised (step 1 of the American Heart Association dietary guidelines12) produced too small a reduction in blood total cholesterol concentration (less than 4%) to have much value in clinical management and that the feasibility of implementing more intensive diets was unknown.13 Another more selective review claimed, however, that dietary counselling could achieve reductions in blood total cholesterol concentration of 10% or more in free-living subjects and, hence, could play an important part in reducing rates of coronary heart disease.14
In view of the public health importance of the issue, the resource implications, and the disagreements in the literature, we reviewed systematically and quantitatively the evidence from randomised trials for the efficacy of individualised counselling for lowering cholesterol concentration.
Methods
Identification of trials and extraction of data
We aimed to identify all unconfounded randomised trials of
dietary advice to lower cholesterol concentration in free-living subjects published before 1996. Trials were eligible for inclusion if
there were at least two groups, of which one could be considered a
control group; treatment assignment was by random allocation; the
intervention was a global dietary modification (changes to various food
components of the diet to achieve the desired targets); and lipid
concentrations were measured before and after the intervention.
Statistical analysis
For each comparison within each trial we computed the
absolute difference (in mmol/l) in the mean change in blood total
cholesterol values (baseline minus final value) between the
intervention and control group. (No distinction was made between serum
or plasma cholesterol values.) We expressed this difference as a
percentage change in blood total cholesterol concentration using a mean
of the baseline values as the denominator. The principal end point for
each comparison was the percentage reduction in cholesterol concentration at the end of the intervention or at 12 months, whichever
was the sooner (although we also considered reductions in cholesterol
concentration at different time points). The standard error (SE) of the
difference (x1
x0) for each comparison within each trial was calculated using the formula
SE(x1
x0)=
(SD12/n1+SD02/n0), where x1 and x0 are the mean changes over time
in the intervention and control groups respectively, SD1
and SD0 are the standard deviations of these mean changes,
and n1 and n0 are the number of subjects in
each group.15 When the values for SD were not given we
imputed values16 using as much information as was
available from that trial. The summary effect for each grouping of
different trials was derived from the average of the means of each
separate trial weighted by 1/SE2 for each
trial.15 For studies with more than one intervention group
the standard errors were adjusted to take account of the control group
having been used more than once. Results are presented as mean
percentage changes in blood total cholesterol concentration with 95%
confidence intervals.
Results
Description of trials
We identified published reports of 133 randomised
trials of some type of dietary advice to lower blood cholesterol
concentration in free-living subjects; we did not find any unpublished
trials. Sixty five trials were excluded because the intervention
entailed supplementation with a specific dietary factor such as fish
oil, cooking oil, or a modified fat product, and a further 34 were excluded because dietary advice was part of a multifactorial
intervention. Five trials were excluded because they did not have an
appropriate untreated control group,18-22 three trials
because they reported insufficient data for
analysis,23-25 three trials because lowering body weight
was their primary aim,26-28 two trials because reducing other coronary risk factors and not cholesterol concentration was their
primary aim,
and one trial because a large
proportion of subjects were taking tamoxifen, which alters blood
cholesterol concentration.31 This left 19 trials,32-52 yielding 28 comparisons eligible for
inclusion in this report. Information about the trial reported by Leren
is included in three publications,44-46 and the American
diet-heart study includes seven different dietary
comparisons.37
|
Grouping of trials
The table groups trial comparisons according to their
target diet. Dietary interventions that entailed both a decrease in total fat intake and an increase in the ratio of polyunsaturated to
saturated fatty acid but without stated targets and those that differed
from the standard diets of the American Heart Association were grouped
with the diet they most closely resembled. In eight comparisons the
intervention was roughly equivalent to the association's step 1 diet
and in nine to the step 2 diet. In seven comparisons the intervention
diet was primarily an increase in ratio of polyunsaturated to saturated
fatty acid without a change in the total fat intake. The target diet in
the early trial by Leren was not clearly described but we judged it to
be an increase in ratio of polyunsaturated to saturated fatty acid
concentration on the basis of information given on fat intake in the
Norwegian population at that time.44-46 In four trials
the target diet was primarily reduced or low total fat intake. In
almost all trials which provided information on the methods of dietary
intervention, the methods were categorised as moderate or intensive
(table), thereby not allowing any discrimination by intensity of
advice.
Overall effect of dietary advice on blood total
cholesterol
The overall weighted mean reduction in blood total
cholesterol concentration across all dietary comparisons was 5.7%
(95% confidence interval 5.2% to 6.3%) using either the final
reduction in cholesterol concentration at the end of the intervention
or at 12 months (whichever was the sooner). For the 22 comparisons available from trials of at least six months duration, the weighted mean reduction in blood cholesterol concentration was 5.3% (4.7% to
5.9%) (figure) or, if it was assumed that subjects lost to follow
up experienced no change, the mean reduction in cholesterol concentration in the longer trials was 4.5% (3.9% to 5.1%). There was obvious statistical heterogeneity between the percentage
reductions in blood cholesterol concentration observed in the
individual comparisons of more than six months
(
221=104, P<0.001), and this was not
explained by grouping the trials by category of diet (see below).
Trials published before 1981 (about halfway between the first and most
recently published studies) achieved greater mean reductions in blood
total cholesterol concentration (7.0% ( 6.1% to 7.9%)) than those
published later (3.9% (3.1% to 4.7%))
(
21=26, P<0.001). But all except one of the
earlier studies were of diets that were more intensive than the step 1 diet of the American Heart Association.
|
Reductions in blood cholesterol by category of diet
There were significant differences between the reductions
in blood cholesterol concentration observed with the four different categories of diet (
23=17, P<0.001). The
estimated reduction in blood total cholesterol concentration with
American Heart Association step 1 or equivalent diets, which lasted at
least six months, was 3.0% (1.8% to 4.1%). That estimate depends
heavily on one large study,35 but there was no significant
heterogeneity between these different comparisons (
24=6, P>0.1). The reduction in blood total
cholesterol concentration with American Heart Association step 2 or
equivalent diets was 5.6% (4.7% to 6.5%), but there was significant
heterogeneity between the effects of different step 2 diets
(
27=45, P<0.001). Among the step 2 diets
the dietary intervention study in children was the only trial in
children (aged 8-10) and it achieved a smaller effect (3.1% (1.7% to
4.5%))43 than most of the other trials in this group.
There was a significant difference between the effect observed in this
trial and that observed in the other comparisons of step 2 diets
(
21=23, P<0.001) (7.4% (6.2% to 8.6%)).
Diets that increased the ratio of polyunsaturated to saturated fat
reduced blood cholesterol concentration by 7.6% (6.2% to 9.0%), but
there was significant heterogeneity between their effects
(
24=24, P<0.001). Among the diets that
increased the ratio of polyunsaturated to saturated fatty acid
concentration the estimate from the trial by Leren was
extreme,45 with significant heterogeneity between the
estimated reduction in blood total cholesterol concentration in that
trial (14.5% (11.2% to 17.8%)) and the other comparisons of diets
increasing the ratio of polyunsaturated to saturated fat (6.2% (4.7%
to 7.7%)) (
21=20, P<0.001). The four
comparisons of low fat diets seemed overall to reduce blood total
cholesterol concentration by 5.8% (3.8% to 7.8%) without significant
heterogeneity between their separate effects.
Reduction in cholesterol concentration by duration of
intervention
Changes in blood total cholesterol concentration around 6 weeks and around 3, 6, 12, and 24 months were estimable in 11, 18, 14, 14, and 4 comparisons respectively, based on 2546, 3686, 4768, 6438, and 1688 subjects. The overall reduction in blood total cholesterol
concentration attributable to dietary advice was 6.6% at about 6 weeks
(including some values at 1 month and 2 months), 8.5% at about 3 months, 6.8% at 6 months, 5.5% at 12 months, and 4.4% at 24 months.
Compliance with dietary advice
Sixteen comparisons provided some information on reported
dietary intake before and during the intervention. The table shows by
category of diet reported dietary consumption of type and amount of fat
and the reductions in blood total cholesterol predicted by the Keys
equation. Fat intakes in the control groups were variable (ranging from
29% to 42% of total energy intake) and, in general, the dietary
targets were not achieved. Among the comparisons of step 1 diets only
two trials
met the targets for both saturated fat
and the ratio of polyunsaturated to saturated fat (10% of total fat as
saturated fat and a ratio of at least 1.0); both trials also achieved
the largest reductions in blood total cholesterol concentration
(table). Among the comparisons of step 2 diets only the comparison of
the first and second American diet heart study reached the target of
7% of energy intake as saturated fat and a ratio of polyunsaturated to
saturated fatty acid concentration greater than 1.4.37 All
of the interventions to increase the ratio of polyunsaturated to
saturated fat achieved an increase in the ratio but the targets varied.
Similarly, all the low fat diets reduced total and saturated fat intake
but the targets differed. Dietary compliance might be expected to be
better in patients at higher risk of cardiovascular disease, but the
reduction in blood cholesterol concentration was similar in the five
comparisons among patients with coronary heart disease (5.3% (4.2% to
6.4%)) and in the 17 other comparisons of at least 6 months duration (5.3% (4.9% to 5.7%)).
Discussion
The results of metabolic ward studies of dietary lipid and cholesterol concentrations suggest that switching from the typical British diet53 to at least the step 1 diet of the American Heart Association could reduce blood total cholesterol concentrations by an average of about 9% and that a step 2 diet might yield a further reduction of about 4%.3 Most of the reduction in blood total cholesterol concentration is due to reductions in low density lipoprotein cholesterol concentration. Our review shows that prescribed dietary advice about as intensive as the step 1 diet would typically achieve a reduction in blood cholesterol concentration of only about 3% in free-living subjects. The more intensive diets studied typically achieved a reduction of about 6% in blood cholesterol concentration.
The most plausible explanation for the modest effects of these diets in our overview is incomplete compliance with dietary advice. In this analysis the achieved reduction in cholesterol concentration was consistent with that predicted by the Keys equation from the estimated changes in intake of saturated and polyunsaturated fatty acid. But among the comparisons of step 1 diets, only two comparisons reported reaching the target ratio of about 1.0 for polyunsaturated to saturated fat, although the target for saturated fat intake of 10% or less was reached in five of the six comparisons which provided this information. Similarly, in the step 2 diets the target ratio of polyunsaturated to saturated fat was achieved in only one out of eight comparisons and the target of 7% of energy intake as saturated fat in only three.
Heterogeneity between study effects
The design and results of these dietary studies differed
greatly. They were conducted over 30 years and varied in their aims, in
the intensity and type of intervention, and in the different baseline
characteristics of the subjects included. Completeness and duration of
follow up also differed. Unsurprisingly, the heterogeneity between
their effects on blood cholesterol concentration was also significant.17 Among the longer trials some, but not all,
of the heterogeneity between the effects on blood cholesterol
concentration seemed to be due to the type of diet recommended.
Deciding which trials should be included in which groups is open to
different interpretation and, although we tried to be consistent, for
some trials the target diets either were not clearly stated or did not
fit neatly into recognised categories such as the step 1 and 2 diets.
It is important to be cautious in interpreting meta-analysis when there
is evidence of significant heterogeneity, although there was no
evidence that the overall results were influenced by trials with
outlying values.
Methodological issues
We included only comparisons in which the dietary advice
was a single intervention. Excluding trials in which dietary advice was
given together with other interventions reduced the number of subjects
available for analysis. However, limiting the overview to single
interventions may provide a better estimate of the effect of dietary
advice by increasing the likelihood that dietary messages were
delivered without dilution by other forms of health advice. In
addition, this approach had the advantage that the estimate of the
effect of dietary advice was largely unconfounded by other interventions which might affect cholesterol values such as exercise and substantial weight loss. The low fat diets were associated with
significant weight loss (2-3 kg), and this may contribute to some of
the cholesterol lowering
for example, a weight loss of 1 kg is
associated with a reduction in cholesterol concentration of
0.05 mmol/l.7 However, weight loss was minimal in most of the other trials included in this overview and so is unlikely to
account for much of the reduction in cholesterol concentration.
Conclusions
This systematic review suggests that dietary advice to
free-living subjects can be expected to reduce blood total cholesterol by only 3-6%, depending on the type and intensity of the diet advocated. In particular, the step 1 diet of the American Heart Association has only a small cholesterol lowering effect even among
those with evidence of coronary disease. Our analyses relate to effects
on blood total cholesterol concentration, and diets that simply lower
total fat intake may lower high density lipoprotein cholesterol
concentration and offset beneficial effects on coronary heart disease
from lowering low density lipoprotein cholesterol.3 This
is less likely to be the case with diets in which reduction in
saturated fat is replaced by polyunsaturated and monounsaturated fats
rather than by complex carbohydrates. The limited efficacy of dietary
advice alone should be taken into account in routine clinical practice
and when assessing the cost effectiveness of different preventive
strategies. More research is required to develop better methods of
communicating dietary advice and maintaining compliance with such
advice. Small changes in population blood total cholesterol
concentrations may be worth while, but this may be better achieved by
interventions aimed at populations than by advising individual people
about diet.
Acknowledgments
We acknowledge the help of Simon Wilson and Paul Sherliker in preparing the original figure, and we thank Robert Clarke for his helpful comments about the manuscript.
JLT searched the databases for relevant papers, extracted the data from identified studies, performed most of the statistical analyses, and contributed to writing the manuscript. JMA initiated and coordinated the project, extracted data from the identified trials independently, wrote the manuscript, prepared the table, coordinated contributions from other authors, and performed some of the statistical analyses. TL was on the steering group for the project, discussed core ideas, and helped prepare the manuscript. CAS initiated the project, helped in designing and writing up the study protocol, discussed core ideas, and helped prepare the manuscript. GHF was on the steering group of the project and participated in the design and execution of the project. HAWN initiated the project, wrote the grant application for funding from the Department of Health, was on the steering group, discussed core ideas, and helped prepare the manuscript.
Funding: The study was funded by a project grant from the nutrition programme phase 1 of the Department of Health and Medical Research Council. JMA is supported by the British Heart Foundation. TL is supported by the Imperial Cancer Research Fund. The Clinical Trial Service Unit and Epidemiological Studies Unit receives funding from the Medical Research Council, British Heart Foundation, and Imperial Cancer Research Fund.
Conflict of interest: None.
References
a meta-analysis.
J R Coll Phys Lond
1994;
28:
39-45[Medline].(Accepted 23 September 1997)
what does meta-analysis add?
George Davey Smith a Department of
Social Medicine, Canynge Hall, Bristol BS8 2PR, b Department
of Primary Care and Population Sciences, Royal Free Hospital School of
Medicine, London NW3 2PF
Dietary changes can lead to sizeable
reductions in circulating cholesterol concentrations,1
which would translate into meaningful decreases in morbidity and
mortality from coronary heart disease. The dietary manipulations which
have produced substantial lowering have, however, been implemented in
strictly controlled conditions in volunteers living in institutions,
whose food intake is directly regulated. Animal experimentation and
metabolic ward studies carried out over half a century show that we
should not be surprised by substantial declines in cholesterol
concentration in someone who is locked in a room and fed lettuce. The
results of studies with externally regulated dietary intake have,
inappropriately, been taken to be directly translatable into public
health terms When dietary interventions are implemented in community settings the
outcomes may differ from expectation. Firstly, compliance with dietary
advice may be poor There have been several quantitative and semiquantitative reviews of
trials of dietary interventions in real world
settings,
of which the paper by Tang et al is the
latest. The differences between these analyses illustrate the problems
of meta-analyses of complex interventions. In particular, the inclusion
criteria are difficult to define. What kind of intervention counts as
"global dietary modification" (and thus is included by Tang et al)
rather than a single component intervention (and thus excluded)? What constitutes "specific supplementation" of the diet (and is thus excluded)? It is difficult to make these criteria objective and reproducible A striking finding of the reviews of real life dietary intervention
trials is the great variation seen in the effects produced in different
studies. Even with a weak test, formal statistical analysis yields
substantial heterogeneity between the studies, and in this case the
combination of results should be cautiously applied, if at all. It is
more useful to look at differences between studies to identify elements
of the intervention or characteristics of the study group which may
account for the variation. This was the case in our recent
meta-analysis of multiple risk factor intervention studies, in which
the differences between studies is in some ways more informative than
the pooled effect.5
For public health purposes the bottomline findings of reviews and
meta-analyses of single factor and multifactorial
interventions3-5 is that even with the substantial
resources given to changing people's diets the resulting reduction in
cholesterol concentrations is disappointing. General population health
education campaigns (or health promotion programmes, as they tend to be
called now) are of limited effectiveness. Health protection References
for example, a review of metabolic ward studies has been
cited as an apparent refutation of scepticism about the ability to
modify cholesterol concentrations in the general population by
diet.2 This is extrapolating well beyond what the studies
show: to understand what could be produced in real life settings by
dietary interventions requires studies which have attempted to produce
sustained changes in the diet of subjects who continue living their
lives.
people eat particular foods because they are easily
available and affordable and they like them, not because of ignorance
or a death wish. Thus the dietary changes produced by an
intervention
and the consequent decline in serum cholesterol
concentration
may be considerably less than anticipated. Secondly,
outside metabolic wards, diets consist of complex and changing mixtures
of food, whose individual elements may interact
either behaviourally
or biologically
to produce different effects from those that occur
when single dietary components are manipulated.
Tang et al have included only four of the 10 trials included in a previous meta-analysis,4 and in many of
these cases it is not clear from differences in inclusion criteria why this is so.
through
legislative and fiscal means
is likely to be a better investment.
© BMJ 1998
Read all Rapid Responses