Comparison of metformin and insulin versus insulin alone for type 2 diabetes: systematic review of randomised clinical trials with meta-analyses and trial sequential analyses
BMJ 2012; 344 doi: https://doi.org/10.1136/bmj.e1771 (Published 19 April 2012) Cite this as: BMJ 2012;344:e1771
- Bianca Hemmingsen, PhD student1,
- Louise Lundby Christensen, physician2,
- Jørn Wetterslev, chief physician1,
- Allan Vaag, professor3,
- Christian Gluud, chief physician and head of department1,
- Søren S Lund, physician4,
- Thomas Almdal, chief physician and head of department4
- 1Copenhagen Trial Unit, Centre for Clinical Intervention Research, Rigshospitalet, Copenhagen University Hospital, DK-2100 Copenhagen, Denmark
- 2Department of Paediatrics, Hvidovre University Hospital, Hvidovre, Denmark
- 3Department of Endocrinology, Rigshospitalet, Copenhagen University Hospital
- 4Steno Diabetes Centre, Gentofte, Denmark
- Correspondence to: B Hemmingsen bh{at}ctu.rh.dk
- Accepted 3 February 2012
Abstract
Objectives To compare the benefits and harms of metformin and insulin versus insulin alone as reported in randomised clinical trials of patients with type 2 diabetes.
Design Systematic review of randomised clinical trials with meta-analyses and trial sequential analyses.
Data sources The Cochrane Library, Medline, Embase, Science Citation Index Expanded, Latin American Caribbean Health Sciences Literature, and Cumulative Index to Nursing and Allied Health Literature until March 2011. We also searched abstracts presented at the American Diabetes Association and European Association for the Study of Diabetes Congresses, contacted relevant trial authors and pharmaceutical companies, hand searched reference lists of included trials, and searched the US Food and Drug Administration website.
Review methods Two authors independently screened titles and abstracts for randomised clinical trials comparing metformin and insulin versus insulin alone (with or without placebo) in patients with type 2 diabetes, older than 18 years, and with an intervention period of at least 12 weeks. We included trials irrespective of language, publication status, predefined outcomes, antidiabetic interventions used before randomisation, and reported outcomes.
Results We included 26 randomised trials with 2286 participants, of which 23 trials with 2117 participants could provide data. All trials had high risk of bias. Data were sparse for outcomes relevant to patients. Metformin and insulin versus insulin alone did not significantly affect all cause mortality (relative risk 1.30, 95% confidence interval 0.57 to 2.99) or cardiovascular mortality (1.70, 0.35 to 8.30). Trial sequential analyses showed that more trials were needed before reliable conclusions could be drawn regarding these outcomes. In a fixed effect model, but not in a random effects model, severe hypoglycaemia was significantly more frequent with metformin and insulin than with insulin alone (2.83, 1.17 to 6.86). In a random effects model, metformin and insulin resulted in reduced HbA1c, weight gain, and insulin dose, compared with insulin alone; trial sequential analyses showed sufficient evidence for a HbA1c reduction of 0.5%, lower weight gain of 1 kg, and lower insulin dose of 5 U/day.
Conclusions There was no evidence or even a trend towards improved all cause mortality or cardiovascular mortality with metformin and insulin, compared with insulin alone in type 2 diabetes. Data were limited by the severe lack of data reported by trials for patient relevant outcomes and by poor bias control.
Introduction
Metformin is a glucose lowering drug that, among other mechanisms, is supposed to work by enhancing insulin action mainly in the liver.1 Metformin is often recommended as the first line drug in patients with type 2 diabetes.2 Because of disease progression, a substantial proportion of these patients eventually end up on insulin, at which point doctors are recommended to continue metformin use.2 The rationale behind this combination mainly relates to suggested beneficial metabolic effects, such as reduced blood glucose and body weight.2 3 4
The United Kingdom Prospective Diabetes Study suggested a beneficial effect of metformin monotherapy, compared with conventional (diet) treatment, on cardiovascular disease and mortality after about 10 years in overweight patients with type 2 diabetes.5 These findings were partly supported by the Hyperinsulinemia: the Outcome of its Metabolic Effects (HOME) trial comparing combined metformin and insulin versus insulin alone.6 However, other trials have suggested that metformin combined with sulphonylurea (that is, insulin secretagogues) versus sulphonylurea alone could increase mortality.5 7 Thus, the effect of metformin combined with other glucose lowering drugs such as insulin providing regimens on patient relevant outcomes might differ from its effects during monotherapy.
Whether oral glucose lowering drugs should be continued when initiating insulin remains unclear.8 9 An insulin sparing effect has been observed when using oral glucose lowering drugs with insulin.9 However, the progressive nature of type 2 diabetes with its decline in endogenous insulin secretion could result in patients with advanced disease more closely resembling type 1 diabetes, in which adjunct treatment with, for example, metformin, has not proven to improve glycaemic control.10 Thus, despite international recommendations to use metformin in combination with insulin in patients with type 2 diabetes and therefore the possible widespread use of this treatment regimen worldwide, insufficient and contradictory data exist in the literature to justify this policy.2
Previous meta-analyses of glucose lowering drugs have included trials of insulin in combination with various glucose lowering compounds such as metformin, but have not addressed the specific effect of metformin and insulin in this respect.11 12 13 In the light of these considerations and the growing number of patients with type 2 diabetes receiving insulin worldwide, we compared the benefits and harms of metformin and insulin versus insulin alone in randomised clinical trials.
Methods
The present review followed the Cochrane Collaboration’s recommendations for preparation of systematic reviews of interventions14 and was based on a previously published protocol.15
Search strategy
We searched the Cochrane Library, Medline, Embase, Science Citation Index Expanded, Latin American Caribbean Health Sciences Literature, and Cumulative Index to Nursing and Allied Health Literature until March 2011 (web appendix). We also searched abstracts presented at the American Diabetes Association and European Association for the Study of Diabetes Congresses. We contacted relevant pharmaceutical companies, and searched the US Food and Drug Administration website for unpublished randomised trials relevant to the review. We also scanned reference lists of included trials and systematic reviews, meta-analyses, and health technology assessment reports. We contacted experts to request for information on additional trials.
Study selection
Two authors (BH and LLC or TA) independently screened titles and abstracts according to the inclusion criteria. Randomised clinical trials were included if they compared metformin and insulin versus insulin alone (with or without placebo) in patients with type 2 diabetes older than 18 years, and had an intervention period of at least 12 weeks. We included trials irrespective of language, publication status, predefined outcomes, antidiabetic interventions used before randomisation, and reported outcomes. We excluded intervention groups including concomitant use of glucose lowering drugs other than metformin or insulin.
Data extraction and risk of bias assessment
Two authors (BH and LLC or TA) independently extracted data from the included trials using standard forms, and assessed the risk of bias according to the Cochrane Collaboration.14 They assessed the following risk of bias domains: generation of the allocation sequence, allocation concealment, blinding of investigators and participants, blinding of outcome assessors, incomplete outcome data, selective outcome reporting, and other sources of bias.15 Each item was classified as low, unclear, or high risk of bias.15 The involvement of a third author (JW or CG) resolved any discrepancies. Data extraction and assessment for all relevant non-English articles were obtained through translated texts.
The primary outcomes in this review were all cause mortality and cardiovascular mortality.15 The secondary outcomes were macrovascular and microvascular diseases assessed as composite outcomes and in separate (non-fatal myocardial infarction, non-fatal stroke, abdominal aorta aneurism, amputation of lower extremity, cardial or peripheral revascularisation, manifestation and progression of nephropathy, end stage renal disease, manifestation and progression of retinopathy, or retinal photocoagulation) adverse events, cancer, quality of life, costs of intervention, insulin dose, glycaemic control, weight, and blood pressure.15
Statistical analysis
We did statistical analysis using Review Manager16 according to our protocol.15 The medians reported in the included trials were assumed to be close to the arithmetic mean. If not reported, the standard deviation of the changes from baseline to the end of follow-up was calculated with a correlation coefficient from the largest and longest trial with all available data for each continuous variable in each intervention group.14 17 18 Reported standard errors and confidence intervals were converted to standard deviations.
We used both a random effects model and a fixed effect model.19 20 In case of discrepancy between the two models, we reported both results. We examined heterogeneity with the I2 statistic (I2 ≥50% indicated substantial heterogeneity).14 To clarify the influence of missing data, we conducted scenario analyses for the “worst best” case and “best worst” case for the primary outcomes.
We did subgroup analyses for primary and secondary outcomes if significant effect estimates were present using a test of interaction. These analyses were done according to risk of bias (low v high risk), study design (blinding v no blinding of participants and investigators), previous insulin treatment (insulin naive v previous insulin treatment), insulin regimen (fixed v variable regimens in intervention groups), body mass index at baseline (<30 v ≥30), duration of interventions (<two years v ≥two years), metformin use at trial entry (allowed v not allowed), and publication status (published v unpublished trials).
Trial sequential analysis
Trial sequential analysis of a meta-analysis is conceptually similar to interim analyses in a single trial, which use monitoring boundaries to decide whether the trial has obtained a sufficiently low P value to show a reliable effect.21 22 23 24 25 Cumulative meta-analyses of trials are at risk of producing random errors because of sparse data and repetitive testing on accumulating data.23 24 25 26 27 Trial sequential analysis depends on the quantification of the required information size.25
The trial sequential analysis was done to maintain an overall 5% risk of a type I error and 20% of the type II error. On the basis of criteria decided a priori, we calculated the required information size (adjusted for diversity) to detect or reject an intervention effect of a 10% relative risk reduction, considered as a clinically relevant effect corresponding to a numbers needed to treat of about 200.21 22 23 24 25 28 However, if the required information size was very large, we also performed post hoc trial sequential analysis, with a 30% relative risk reduction. For the continuous outcomes of glycated haemoglobin (HbA1c), weight gain, and insulin dose, we estimated the required information sizes to detect or reject a reduction of 0.5%, 1 kg, and 5 U/day, respectively. We used software Trial Sequential Analysis, version 0.8.27
Differences between planned protocol and review
The subgroup analysis conducted on the secondary outcomes showing significance was not defined in our protocol.15 The subgroup analyses for insulin regimen (fixed v variable) as well as metformin use at trial entry (allowed v not allowed) were not described in our protocol.15 We did not do subgroup analyses for mean age younger than 65 years compared with 65 years or older and for insulin type prescribed. We extracted data but did not report data for cancer, fasting blood glucose, and blood pressure. When the estimated required information size (to show or refute a 10% relative risk reduction) was very large, we did a trial sequential analysis for a 30% relative risk reduction. The estimated required information sizes based on small anticipated reductions in the surrogate outcomes of HbA1c, weight gain, and insulin dose of 0.5%, 1 kg, and 5 U/day, respectively, were chosen post hoc to substantially challenge the effect on these outcomes, in view of sparse data and repetitive testing.
Results
Results of the search and trial, participant, and intervention characteristics
We identified 7993 references through electronic and hand searches (fig 1⇓). After excluding the duplicate reports, we screened 5613 references. Most references did not identify relevant trial reports. Thirty publications describing 26 randomised clinical trials met our inclusion criteria, randomly assigning 2286 patients to metformin and insulin versus to insulin alone. Three trials could not provide data for the meta-analysis because they only described the total number of patients who underwent randomisation.29 30 Accordingly, 23 trials (2117 participants) provided data for our analyses. Schnack and colleagues did not report the total number of randomised patients, but only the number with available data at the time of publication of the abstract.31
Twenty five trials were published in English and one in Russian. One trial was only published as abstracts,29 32 33 one in a single abstract,31 and one in a letter.34 All trial authors were contacted, but only a few provided additional data. We included two crossover trials, and the authors were unable to provide data before the crossover.30 35 Tables 1 and 2⇓ ⇓ show baseline characteristics of the included trials.
Demographic characteristics of the included trials
Baseline variables of the included trials
‡Data are participants with hypertension at baseline.
Twelve trials included insulin naive participants (table 3⇓).3 4 29 31 36 37 38 39 40 41 42 43 Fifteen trials allowed metformin at trial entry either as monotherapy or in combination with other antidiabetic drugs (table 3).4 6 29 30 35 36 37 38 39 40 41 42 44 45 46 We were unable to retrieve information about the duration of metformin intervention before randomisation. The total daily dose of metformin in the intervention groups varied between 1000 mg and 2550 mg. Insulin regimens differed between the trials, and also varied between the intervention groups within some trials (table 3).3 18 36 39 40 42 43 45 46 47 Three trials prescribed a fixed and identical insulin regimen in both intervention groups.48 49 50
Interventions in the included trials
Altuntas and colleagues reported three intervention groups: insulin lispro and metformin, insulin lispro and neutral protamine Hagedorn insulin, and human regular insulin and neutral protamine Hagedorn insulin.43 In our analysis, we merged the data from the two insulin only groups into one dataset.43 The South Danish Diabetes Study reported two different kinds of insulin treatments (neutral protamine Hagedorn insulin and insulin aspart) in combination with different oral antidiabetic drugs. For this study,44 we reported the two types of insulin preparations in combination with metformin or placebo separately: neutral protamine Hagedorn insulin in combination with metformin or placebo (SDDSa), and insulin aspart in combination with metformin or placebo (SDDSb).
Bias risk assessment
Five trials had low risk of bias regarding both sequence generation and allocation concealment (table 4⇓).6 38 39 44 47 Healthcare providers and participants were blinded in 10 trials,4 6 30 34 35 44 48 49 50 and not blinded in 16.3 18 29 31 36 37 38 39 40 41 42 43 45 46 47 51 Only two trials6 44 described adequate sequence generation, allocation concealment, and blinding of participants and investigators, which our protocol had prespecified as trials with lower risk of bias.15 The trials did not report the funding source, or report funding from the pharmaceutical industry. Based on all the domains assessed, none of the included trials had a low risk of bias.
Risk of bias assessment of the included trials
All cause mortality
Sixteen trials with 1627 participants reported all cause mortality, of which five reported 21 deaths (fig 2⇓). Metformin and insulin versus insulin alone did not significantly affect all cause mortality (relative risk 1.30, 95% confidence interval 0.57 to 2.99; heterogeneity I2=0%, P=0.77). Trial sequential analysis indicated that only 2.93% of the required information size was accrued to detect or reject a 30% reduction in relative risk.
Fig 2 Forest plots for trial outcomes in all cause mortality and cardiovascular mortality. M-H=Mantel-Haenszel; CI=confidence interval. Random effects model used.
The “best worst” case scenario for all cause mortality showed a significant difference in favour of metformin combined with insulin (relative risk 0.35, 95% confidence interval 0.13 to 0.95, P=0.04). However, the “worst best” case scenario showed a significant effect favouring insulin alone (4.27, 1.74 to 10.45, P=0.001). Test of interaction for subgroup differences did not show any significance regarding bias (P=0.90), blinding of investigators and participants (P=0.90), duration of interventions (P=0.90), body mass index (P=0.83), previous insulin treatment (P=0.89), or metformin use allowed at trial entry (P=0.56).
Subgroup analysis according to insulin regimen used was not possible because the three trials with fixed insulin regimens in intervention groups reported no fatal events.48 49 50 We also could not analyse publication status because all the included trials were published. A separate analysis of the trials using placebo control groups (the HOME trial6 and South Danish Diabetes Study44) did not show any significant effect of metformin and insulin (relative risk 1.27, 95% confidence interval 0.50 to 3.22).
Cardiovascular mortality
Fifteen trials with 1498 participants reported on cardiovascular mortality, of which three trials reported six deaths (fig 2). The effect of metformin and insulin versus insulin alone was non-significant (relative risk 1.70, 95% confidence interval 0.35 to 8.30; heterogeneity I2=0%, P=0.52). Trial sequential analysis indicated that only 0.65% of the required information size was accrued to detect or reject a 30% reduction in relative risk.
The “best worst” case scenario showed significant benefit for metformin and insulin compared with insulin alone (relative risk 0.25, 95% confidence interval 0.09 to 0.73, P=0.01). The “worst best” case scenario showed significant harm for metformin and insulin (7.45, 3.08 to 18.03, P<0.001). Test of interaction for subgroup differences did not show any significance regarding bias (P=0.48), blinding of investigators and participants (P=0.50), duration of intervention (P=0.50), body mass index (P=0.25), previous insulin treatment (P=0.99), or metformin use allowed at trial entry (P=0.51). The HOME trial was the only placebo controlled trial to report any deaths due to cardiovascular disease.6 We could not analyse the insulin regimen used because the three trials with fixed insulin regimens reported no fatal events.48 49 50 We also could not analyse publication status because all the included trials were published.
Macrovascular and microvascular complications
The reporting of macrovascular and microvascular complications was infrequent, and all the outcomes assessed showed non-significant effect estimates (data not shown). We also observed a non-significant effect for the composite macrovascular outcome (relative risk 0.98, 0.79 to 1.22; heterogeneity I2=0, P=0.44; three trials). Only one trial reported data for the composite microvascular outcome, and showed no significant effect of metformin and insulin versus insulin alone.6
Hypoglycaemia
Most trials reported hypoglycaemia data in a format that could not be included in a meta-analysis.3 6 29 36 38 40 43 47 48 Eleven trials with 1303 participants reported severe hypoglycaemia (fig 3⇓). Only three trials reported severe hypoglycaemia in 24 patients (metformin and insulin, 18; placebo and insulin, six). The remaining eight trials reported no serious hypoglycaemic events. Although the random effects model did not show a significant effect (relative risk 2.43, 95% confidence interval 0.54 to 10.85), the fixed effects model did (2.83, 1.17 to 6.86; heterogeneity I2=43%, P=0.17), suggesting that metformin and insulin was associated with an increased number of patients with severe hypoglycaemia. Separate analysis of the two trials providing data for severe hypoglycaemia using placebo did not show a significant effect in the random effects model (3.59, 0.75 to 17.33), but showed significance in favour of insulin alone in the fixed effects model (3.56, 1.34 to 9.48, P=0.01).
Fig 3 Forest plots for trial outcomes in severe hypoglycaemia and mild hypoglycaemia. M-H=Mantel-Haenszel; CI=confidence interval. Random effects model used. *Trial only reported hypoglycaemia and did not specify severity
As the largest and longest trial, the HOME trial did not report the number of participants with serious hypoglycaemia at the end of the intervention period. However, after 4.3 years of treatment, researchers saw no significant difference in severe hypoglycaemia between intervention groups (0.3 severe hypoglycaemic events per person per year, for each group).6
We extracted data for mild hypoglycaemia from six trials (869 participants; fig 3), which showed no significant effect of metformin and insulin versus insulin alone (relative risk 1.01, 95% confidence interval 0.85 to 1.20; heterogeneity I2=27%, P=0.23). Meta-analysis of the trials applying placebo did not substantially change this estimate (0.97, 0.83 to 1.14).
Adverse events
Only six trials reported adverse events, and showed no significant difference between intervention groups (relative risk 1.28, 95% confidence interval 0.69 to 2.37; heterogeneity I2=75%, P=0.003). Hermann and colleagues conducted the only placebo controlled trial reporting adverse events, and did not find any significant difference in effect between the interventions.50 The effect of dropouts owing to adverse events was close to significance in the random effects model when comparing metformin and insulin versus insulin alone (1.53, 0.99 to 2.36, P=0.05); this effect and was significant in the fixed effect model (1.69, 1.13 to 2.52, P=0.01; heterogeneity I2=1%, P=0.43). Meta-analysis of the trials using placebo did not substantially change the estimate (1.41, 0.72 to 2.76).
Six trials reported four serious adverse events. The definition of serious adverse events varied among trials. The effect estimate was non-significant (relative risk 1.92, 0.33 to 11.35; heterogeneity I2=0%, P=0.43). Hermann and colleagues conducted the only placebo controlled trial reporting any serious adverse events, and did not show any significant difference between the interventions.50
Quality of life
Three trials reported quality of life or wellbeing; all found no significant differences regarding these outcomes.4 40 41 Only Douek and colleagues reported quality of life assessments in a format that was suitable for a meta-analysis.4
Insulin dose
Twelve trials reported changes in insulin dose (fig 4⇓). Insulin dose was significantly reduced when metformin was combined with insulin, compared with insulin alone (mean difference −18.65 U/day, 95% confidence interval −22.70 to −14.60, P<0.001; heterogeneity I2=81%, P<0.001). Trial sequential analysis showed that sufficient evidence was established to show even a small reduction of 5 U/day, with crossing of the trial sequential alpha spending monitoring boundary (fig 5⇓).
Fig 4 Forest plot for changes in insulin dose (U/day) from baseline to end of follow-up. IV=inverse variance; CI=confidence interval. Random effects model used
Fig 5 Trial sequential analysis of effect of metformin and insulin versus insulin alone in type 2 diabetes on insulin dose, HbA1c, and weight. The required information size (and adjacent trial sequential alpha spending monitoring boundaries) for insulin dose was calculated based on a two sided α=5%; power of 80%; a minimal relevant difference of −5 U/day; a standard deviation of 17.6 U/day; and a diversity of 87% as estimated in a random effects model. The required information size (and the adjacent trial sequential alpha spending monitoring boundaries) for HbA1c was calculated based on a two sided α=5%; power of 80%; a minimal relevant difference of −0.5%; a standard deviation of 1.6%; and a diversity of 80% as estimated in a random effects model. The required information size (and the adjacent trial sequential alpha spending monitoring boundaries) for weight was calculated based on a two sided α=5%; power of 80%; a minimal relevant difference of −1 kg; a standard deviation of 7.96 kg; and a diversity of 48% as estimated in a random effects model. The solid blue cumulative Z curves indicate the cumulated Z score from the inverse variance model Z statistic, whenever a new trial is added. The solid blue cumulative Z curves all cross the dashed red trial sequential alpha spending monitoring boundaries. Horizontal dotted green lines illustrate traditional level of statistical significance (P=0.05)
Subgroup analysis of the trials according to risk of bias did not show any significant differences in the effect estimate for insulin dose (P=0.19, test of interaction). Separate analysis of trials using placebo according to blinding of participants and investigators suggested a more pronounced reduction of insulin use (mean difference −21.01 U/day, 95% confidence interval −23.88 to −18.15, P<0.001) compared with trials not using placebos (open label design) (−16.78 U/day, −22.07 to −11.49, P<0.001). However, tests of interaction did not show any significant differences between subgroups in relation to the blinding of investigators and participants (P=0.17), previous insulin treatment (P=0.15), insulin regimen (P=0.67), and duration of intervention (P=0.19; although only one trial with a duration of intervention of two years or more was included in the analysis).6 Trials with participants who had a body mass index of less than 30 at baseline showed a smaller reduction in daily insulin dose (−13.36 U/day, −18.52 to −8.20, P<0.001) than those with participants who had a body mass index of 30 or more (−21.76 U/day, −26.99 to −16.53, P<0.001). Test of interaction showed significance for the subgroup differences according to body mass index (P=0.03), but not significant according to metformin use at trial entry (P=0.88). Subgroup analysis of publication status was not possible.
Glycaemic control
Twenty trials reported changes in HbA1c. The achieved percentage of HbA1c decreased with metformin and insulin compared with insulin alone (mean difference −0.60%, 95% confidence interval −0.89 to −0.31, P<0.001; 20 trials; heterogeneity I2=82%, P<0.001) (fig 6⇓). Standard deviations of the changes had to be calculated for most trials. Trial sequential analysis showed that sufficient evidence was available to show a reduction of 0.5% in HbA1c, with crossing of the trial sequential monitoring boundary in favour of metformin and insulin (fig 5).
Fig 6 Forest plot for changes in HbA1c (%) from baseline to end of follow-up. IV=inverse variance; CI=confidence interval. Random effects model used
A test of interaction found no significant subgroup difference between the two trials with lower risk of bias and the remaining trials with high risk of bias (P=0.81). Trials designed to blind participants and investigators showed a reduction in HbA1c (mean difference −0.87%, 95% confidence interval −1.30 to −0.44, P<0.001) greater than that observed in trials without blinding (−0.30%, −0.62 to 0.01; P=0.06, test of interaction). Tests of interactions did not show significant subgroup differences according to previous insulin treatment (P=0.18), body mass index (P=0.07), and duration of intervention (P=0.72). Trials with variable insulin regimens in the intervention groups showed a smaller reduction in HbA1c (−0.46%, −0.72 to −0.20, P<0.001) than trials with fixed insulin regimens (−1.44%, −1.72 to −1.17, P<0.001; P<0.001, test of interaction). Subgroup analyses of metformin use at trial entry did not show any significant effect (P=0.38, test of interaction). Subgroup analysis of publication status was not possible.
Weight
Both body mass index and weight gain were significantly reduced by metformin and insulin compared with insulin alone (body mass index, mean difference −1.27, 95% confidence interval −2.07 to −0.47, P=0.002, six trials (heterogeneity I2=86%, P<0.001); weight gain, −1.68 kg, −2.22 to −1.13, P<0.001, 13 trials (I2=36%, P=0.09)) (fig 7⇓). Trial sequential analysis showed that sufficient evidence was available to show a reduction of 1 kg in weight, with crossing of the trial sequential monitoring boundary for less weight gain with metformin and insulin than insulin alone (fig 5).
Fig 7 Forest plot for changes in weight (kg) from baseline to end of follow-up. IV=inverse variance; CI=confidence interval. Random effects model used
Tests of interaction of weight changes did not find any significant subgroup differences according to risk of bias (P=0.33), previous insulin treatment (P=0.27), or blinding of investigators and participants (P=0.45), or insulin regimen (P=0.51). The change in weight for trials using placebo was significant (mean difference −1.97 kg, 95% confidence interval −2.59 to −1.35, P<0.001). Separate analysis of trials with a duration of intervention of two years or longer showed a weight loss (−2.07 kg, −2.22 to −1.13, P<0.001). Tests of interactions for subgroup differences did not show any significance according to trial duration (P=0.33) or body mass index (P=0.62). Trials allowing participants to receive metformin at entry showed a less pronounced weight loss (−1.79 kg, −2.40 to −1.18, P<0.001) than trials not allowing metformin use (−2.93 kg, −4.13 to −1.74, P<0.001; P=0.03, test of interaction). Subgroup analysis of publication status was not possible.
Discussion
We identified 26 randomised clinical trials comparing the effects of metformin and insulin with insulin alone. Of these trials, 23 (n=2117 participants) provided sufficient information to be included in one or more meta-analyses. All trials had a high risk of bias, and only two were considered to have lower risk of bias. This finding could lead to a systematic overestimation of beneficial effects and an underestimation of adverse effects.52 53 54 55 Nevertheless, metformin combined with insulin seem to be associated with a significant reduction in HbA1c, weight gain, and insulin dose, compared with insulin alone. Although the influence of bias cannot be excluded, trial sequential analysis suggested evidence was sufficient for the effect, found in a random effects model, of metformin and insulin versus insulin alone on these surrogate outcomes. However, duration of intervention in the included trials was relatively short, and we were unable to explore whether these metabolic effects disappear, persist, or became more pronounced with time. Meta-analyses of patient relevant outcomes were based on very sparse data and did not show significant results. The accrued cumulated sample sizes of the included trials for the primary outcomes only constituted a very small fraction of the required information size calculated to establish firm evidence for the presence or absence of effect.
The present systematic review contains substantially more data than previous meta-analyses relevant to the topic.11 12 Although our results seem to support the combination of metformin and insulin compared with insulin alone on HbA1c, weight, and insulin dose, these variables are, at best, unvalidated surrogate indicators of a potentially reduced risk of microvascular and macrovascular complications.56 Our results regarding patient relevant outcomes should be interpreted with caution. Several of these outcomes were rarely reported or not reported at all. Major drawbacks of the meta-analyses of patient relevant outcomes mirrored the weaknesses of the included trials, and highlighted the substantial lack of evidence on this topic. Most trials had a short duration (<two years) and we cannot exclude a potential legacy effect from the trials allowing metformin at baseline. However, we were unable to show any legacy effect apart from one on weight loss. These factors might have diluted a potential effect of metformin and insulin in two trials in the meta-analysis with a longer duration.
After combining all the evidence available from randomised clinical trials, we were unable to find any evidence or even a trend towards improved all cause mortality or cardiovascular mortality with metformin and insulin, compared with insulin alone. Point estimates of the risk ratios for all cause or cardiovascular mortality were greater than one (that is, favouring insulin alone); these risk ratios or the upper limits of their 95% confidence intervals spanned far beyond current safety limits such as 1.3 or 1.8, as used for evaluating drug safety by the US Food and Drug Administration.57 This lack of evidence means that possible harm cannot be excluded according to current criteria. However, several factors limited the confidence in the effect estimates and confidence intervals in our meta-analyses, owing to insufficient information and consequent high risk of random errors.
The risk of having one or more severe hypoglycaemic events was significantly increased with metformin and insulin when applying the fixed effect model. The combination of metformin and insulin seemed to decrease HbA1c, which might have explained the observed tendency of an increased risk of severe hypoglycaemia.58 59 Furthermore, the largest and longest of the included trials, the HOME trial, did not find any difference in the number of severe hypoglycaemic events per person per year, implying that the observed potential harm might not be present during a longer intervention period.6 We did not adjust the number of patients who had severe hypoglycaemia with the achieved HbA1c in trials. Since both the achieved glycaemic level and the number of hypoglycaemic events are results of the interventions, it is not possible in real life to have only one outcome without the other. Thus, any conclusions from statistically adjusting the risk of hypoglycaemia for results of achieved glycaemic control cannot be translated into clinical practice. Therefore, a possible signal of harm, when combining metformin and insulin could not be excluded from our meta-analysis, and should be investigated in future trials.
The risks of other severe and non-severe adverse events were not significant between the two interventions. However, the number of dropouts from adverse events was significantly higher for metformin and insulin than for insulin alone in the fixed effect model. When initiating metformin treatment, participants often have gastrointestinal disturbances.1 The observed differences of the dropouts due to adverse events might have represented the initial adverse effects experienced when initiating metformin treatment, due to the short duration of the included trials. Therefore, the observed difference might have disappeared after the titration period of metformin, although no data were available to investigate this.
Strengths and limitations
Our systematic review has several strengths. We based it on a published protocol with rigid inclusion criteria for randomised clinical trials.15 We applied a comprehensive search with no language limitations or restrictions on outcomes reported in the trials. Two authors independently extracted data. We contacted corresponding authors of all trials to clarify methodological details and patient relevant outcomes, but only a few authors responded. We tried to evaluate the strength of the available evidence with comprehensive analyses of the risk of bias using subgroup analyses with test for subgroup differences and trial sequential analysis on all our primary and statistically significant secondary outcomes.21 22 23 24 We evaluated the heterogeneity variance among trials.
The weaknesses of our analyses and conclusions mirror the weaknesses of the included trials. Our results should be interpreted with caution because almost all the trials had a high risk of bias.52 53 54 55 Data were sparse for patient relevant outcomes. Most trials had short duration of the intervention and assessed metabolic efficacy as their primary outcome. Only two trials had intervention duration longer than one year,6 44 and only one was designed to assess patient relevant outcomes.6
Subgroup analyses on the secondary outcomes showing significant results were post hoc. Nonetheless, the magnitude of HbA1c reduction with metformin and insulin seemed to be more pronounced in trials designed to blind investigators and participants than in non-blinded trials. The extent to which this finding might be due to less aggressive titration of insulin doses in patients receiving both metformin and insulin in blinded trials than in non-blinded trials is unknown. Likewise, HbA1c reductions were also more pronounced in trials using fixed insulin regimens than in those using variable regimens. The trials that used fixed regimens did not explain the exact meaning of this regimen; therefore, we cannot know if this regimen meant, for example, no changes in insulin type or dose. A fixed regimen strategy in terms of type or dose is probably unlikely to be found in clinical practice typically using unrestricted changes in insulin dose or type according to the individual needs of patients.
Despite these uncertainties and being a post hoc analysis, the data seem to raise a clinical dilemma: whether to reduce HbA1c or change the insulin regimen (that is, mean difference in HbA1c with variable regimen −0.46% v mean difference with fixed regimen −1.44%; P<0.001 for test of interaction). This choice can only be better guided by randomised trials assessing patient relevant outcomes as well. Also, our finding of the influence of obesity on the reduction in insulin dose reiterates the classic, but as yet unsolved, question of metformin being a drug that potentially benefits mainly obese patients.5 Post hoc subgroup analysis of previous metformin treatment showed significant differences in the effect estimate of weight (P=0.03), showing a more pronounced weight reduction in trials not allowing metformin treatment at entry.
Because we aimed to assess the effect of metformin and insulin versus insulin alone irrespective of previous interventions, we included a diverse group of trials—for example, the percentage of patients who were insulin or metformin naive varied among trials. Furthermore, the prescribed insulin regimens varied markedly among trials, and some also varied between the intervention groups within the trials.3 18 36 39 40 42 43 45 46 47 Some trials allowed participants to receive metformin at trial entry.4 6 29 35 36 37 38 39 40 41 42 44 45 46 We were unable to estimate for how long these participants received metformin, and only a few trials reported the percentage of participants receiving metformin at entry. Even though our subgroup analysis did not support a potential legacy effect of metformin, such an effect cannot be ruled out, because the absence of evidence is not evidence of absence.
Results in relation to other studies and reviews
A Cochrane review compared the effect of metformin alone with placebo or no intervention and found only a few trials providing data for mortality and morbidity.60 Accordingly, the review was inconclusive. A recent meta-analysis included a diverse group of trials of participants both with and without diabetes and showed a reduction of cardiovascular events with metformin (not necessarily alone) when compared with placebo, but, notably, not when compared with active comparators.7 Another meta-analysis including 10 trials showed that metformin alone reduced fasting blood glucose and HbA1c compared with placebo, but did not report any significant difference in weight change.61 Another Cochrane review of 20 randomised clinical trials compared insulin and oral hypoglycaemic agents with insulin alone, but only few trials compared metformin and insulin with insulin alone.12 As in our review, evidence in that Cochrane review was insufficient to make conclusions about long term complications and mortality. The previous meta-analyses also included trials with high risk of bias and of short duration, similar to our systematic review.
We found no significant effect on cardiovascular complications, which conflicts with the findings of the HOME trial. The HOME trial found that metformin and insulin compared with insulin alone significantly reduced the risk of a composite outcome of cardiovascular complications after a follow-up of four years and four months when adjusted for baseline confounders.6 The reason for this difference cannot fully be elucidated. However, some obvious factors could be the differences in duration of intervention between trials with the lack of time to event analysis in a meta-analysis such as ours (without access to data at the patient level). Also, the sparse and possibly non-systematic or non-adjudicated reporting of events from studies other than the HOME trial could have been a confounder.
Moreover, the HOME trial reported baseline imbalances for some potentially important confounders, which could have influenced the results. The participants assigned to metformin and insulin were older (on average, five years) and had a history of cardiovascular disease more often than did the participants assigned placebo and insulin. On the other hand, the control group had more smokers than did the metformin and insulin group. The HOME trial authors found that the favourable effect of metformin could be explained partly by the metformin associated changes in weight. The HOME trial did not report P values of the unadjusted events rates on macrovascular complications. Our analysis of macrovascular complications was mainly dominated by the results from the HOME trial reporting the unadjusted event rates.6
Observational studies comparing the effect of metformin and insulin with insulin monotherapy are sparse. We identified a Danish cohort study of patients with type 2 diabetes and heart failure (468 receiving metformin and insulin treatment, 3718 receiving insulin alone).62 The study showed reduced mortality in the combination group compared with insulin monotherapy, but did not report other potential benefits or harms.62
Clinical implementations
Many perceived disadvantages of insulin treatment in type 2 diabetes seem to be minimised by concomitant treatment with metformin. Metformin and insulin versus insulin alone seems to cause favourable reductions in weight, HbA1c, and insulin dose. However, we do not know of effects on patient relevant outcomes. The incomplete evidence on patient relevant outcomes is surprising, in view of current international consensus statements on diabetes clearly recommending the use of metformin and insulin in almost all patients with type 2 diabetes who initiate insulin treatment.2 63 Furthermore, as noted above, a recent meta-analysis 7 did not confirm (P=0.89) the favourable effect of metformin on cardiovascular outcomes compared with other glucose lowering drugs, as observed in the UK Prospective Diabetes Study5 and possible harm of additional metformin treatment in sulphonylurea treated patients was suggested.7 Moreover, unlike insulin or sulphonylureas, metformin has not yet been shown to significantly reduce microvascular outcomes.5 6 64
What is already known on this topic
-
Because of the progressive nature of type 2 diabetes, a substantial proportion of patients end up receiving insulin treatment
-
Current guidelines for diabetes treatment recommend combining metformin with insulin instead of using insulin alone
-
Previous meta-analyses have only included a few trials comparing metformin and insulin with insulin alone
What this study adds
-
The reporting of patient relevant outcomes was sparse
-
An influence of metformin and insulin versus insulin alone on all cause mortality or cardiovascular mortality could not be established, and more trials are needed to provide firm evidence for an effect or absence of an effect
-
Metformin and insulin treatment, compared with insulin alone, seems to be associated with a reduction in HbA1c, weight gain, and insulin dose
-
Metformin and insulin seems to increase the risk of severe hypoglycaemia compared with insulin alone
Notes
Cite this as: BMJ 2012;344:e1771
Footnotes
-
We thank Sarah Klingenberg, trials search coordinator of the Cochrane Hepato-Biliary Group, for her assistance in developing the search strategy; Dimitrinka Nikolova from the Cochrane Hepato-Biliary Group for translating the Russian article; and Suzanne Strowig and Udaya Kabadi for providing data.
-
Contributors: BH undertook the searches and data analysis. BH, LLC, and TA participated in the selection of trials, data extraction, and quality assessment of trials. JW advised on statistical methods and data analyses. CG advised on statistical methods and interpretation of data. All authors developed the protocol, read and approved the final manuscript, and were involved in the development of the final review. BH and TA are the guarantors.
-
Funding: This study received funding from the Copenhagen Trial Unit, Centre for Clinical Intervention Research, Rigshospitalet, Denmark (the Copenhagen Insulin and Metformin Therapy Trial Group). The funding source had no role in the design and conduct of the study; the extraction, management, analysis, or interpretation of the data; or the preparation, review, or approval of the manuscript.
-
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare that: the study received funding from the Copenhagen Insulin and Metformin Therapy Trial Group; LLC, SSL, AV, and TA have reported equity in Novo Nordisk A/S; SSL and AV have received fees from Novo Nordisk A/S for speech making; LLC was employed at Steno Diabetes Centre, Gentofte, Denmark, when the systematic review began; TA is employed at Steno Diabetes Center, which is an academic institution owned by Novo Nordisk A/S; BH, JW, and CG have no conflicts of interest to declare; after the initial draft of the present manuscript, SSL took up a position at Boehringer Ingelheim, Ingelheim, Germany.
-
Ethical approval: Not required.
-
Data sharing: No additional data available.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.