Incretin treatment and risk of pancreatitis in patients with type 2 diabetes mellitus: systematic review and meta-analysis of randomised and non-randomised studiesBMJ 2014; 348 doi: http://dx.doi.org/10.1136/bmj.g2366 (Published 15 April 2014) Cite this as: BMJ 2014;348:g2366
- Ling Li, research associate12,
- Jiantong Shen, lecturer3,
- Malgorzata M Bala, research fellow4,
- Jason W Busse, assistant professor567,
- Shanil Ebrahim, assistant professor5689,
- Per Olav Vandvik, associate professor1011,
- Lorena P Rios, endocrinologist12,
- German Malaga, associate professor13,
- Evelyn Wong, resident physician14,
- Zahra Sohani, PhD candidate515,
- Gordon H Guyatt, distinguished professor516,
- Xin Sun, senior scientist117
- 1Chinese Evidence-Based Medicine Centre, West China Hospital, Sichuan University, Chengdu 610041, Sichuan, China
- 2First Teaching Hospital of Tianjin University of Traditional Chinese Medicine, Tianjin 300193, China
- 3School of Medicine, Huzhou Teachers College, Huzhou 313000, Zhejiang, China
- 42nd Department of Internal Medicine, Jagiellonian University School of Medicine, Skawinska 8, 31-066 Krakow, Poland
- 5Department of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, ON, Canada L8S 4K1
- 6Department of Anesthesia, McMaster University, Hamilton, ON, Canada L8S 4K1
- 7Michael G DeGroote Institute for Pain Research and Care, McMaster University, Hamilton, ON, Canada L8S 4K1
- 8Stanford Prevention Research Centre, Department of Medicine, Stanford University, Stanford 94301, USA
- 9Department of Anaesthesia and Pain Medicine, Hospital for Sick Children, Toronto, ON, Canada M5G 1X8
- 10Norwegian Knowledge Centre for the Health Services, N-0130 Oslo, Norway
- 11Department of Medicine, Innlandet Hospital Trust, 2819 Gjøvik, Norway
- 12Internal Medicine Unit, Hospital Clinico FUSAT, Rancagua, Chile
- 13Department of Medicine, Universidad Peruana Cayetano Heredia, Lima, Peru
- 14Department of Medicine, University of British Columbia, Vancouver, BC, Canada V5Z 1M9
- 15Population Genomics Program, McMaster University, Hamilton, ON, Canada L8S 4K1
- 16Department of Medicine, McMaster University, Hamilton, ON, Canada L8S 4K1
- 17Centre for Evidence-Based Medicine and Clinical Research, Taihe Hospital, Hubei University of Medicine, Shiyan 44200, Hubei, China
- Correspondence to: X Sun, Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, 37 Guo Xue Xiang, Chengdu 610041, Sichuan, China
- Accepted 19 March 2014
Objective To investigate the risk of pancreatitis associated with the use of incretin-based treatments in patients with type 2 diabetes mellitus.
Design Systematic review and meta-analysis.
Data sources Medline, Embase, the Cochrane Central Register of Controlled Trials (CENTRAL), and ClinicalTrials.gov.
Eligibility criteria Randomised and non-randomised controlled clinical trials, prospective or retrospective cohort studies, and case-control studies of treatment with glucagon-like peptide-1 (GLP-1) receptor agonists or dipeptidyl peptidase-4 (DPP-4) inhibitors in adults with type 2 diabetes mellitus compared with placebo, lifestyle modification, or active anti-diabetic drugs.
Data collection and analysis Pairs of trained reviewers independently screened for eligible studies, assessed risk of bias, and extracted data. A modified Cochrane tool for randomised controlled trials and a modified version of the Newcastle-Ottawa scale for observational studies were used to assess bias. We pooled data from randomised controlled trials using Peto odds ratios, and conducted four prespecified subgroup analyses and a post hoc subgroup analysis. Because of variation in outcome measures and forms of data, we describe the results of observational studies without a pooled analysis.
Results 60 studies (n=353 639), consisting of 55 randomised controlled trials (n=33 350) and five observational studies (three retrospective cohort studies, and two case-control studies; n=320 289) were included. Pooled estimates of 55 randomised controlled trials (at low or moderate risk of bias involving 37 pancreatitis events, raw event rate 0.11%) did not suggest an increased risk of pancreatitis with incretins versus control (odds ratio 1.11, 95% confidence interval 0.57 to 2.17). Estimates by type of incretin suggested similar results (1.05 (0.37 to 2.94) for GLP-1 agonists v control; 1.06 (0.46 to 2.45) for DPP-4 inhibitors v control). Analyses according to the type of control, mode, duration of treatment, and individual incretin agents suggested no differential effect by subgroups, and sensitivity analyses by alternative statistical modelling and effect measures did not show important differences in effect estimates. Three retrospective cohort studies (moderate to high risk of bias, involving 1466 pancreatitis events, raw event rate 0.47%) also did not suggest an increased risk of pancreatitis associated with either exenatide (adjusted odds ratios 0.93 (0.63 to 1.36) in one study and 0.9 (0.6 to 1.5) in another) or sitagliptin (adjusted hazard ratio 1.0, 0.7 to 1.3); a case-control study at moderate risk of bias (1003 cases, 4012 controls) also suggested no significant association (adjusted odds ratio 0.98, 0.69 to 1.38). Another case-control study (1269 cases, 1269 controls) at moderate risk of bias, however, suggested that the use of either exenatide or sitagliptin was associated with significantly increased odds of acute pancreatitis (use within two years v no use, adjusted odds ratio 2.07, 1.36 to 3.13).
Conclusions The available evidence suggests that the incidence of pancreatitis among patients using incretins is low and that the drugs do not increase the risk of pancreatitis. Current evidence, however, is not definitive, and more carefully designed and conducted observational studies are warranted to definitively establish the extent, if any, of increased risk.
Acute pancreatitis is a serious condition that often leads to hospital admission and even death. Important risk factors for acute pancreatitis include gallstones, alcohol use, older age, black race, smoking, obesity, and type 2 diabetes.1 Exposure to certain drugs is also associated with acute pancreatitis.1 Glucagon-like peptide-1 (GLP-1) receptor agonists and dipeptidyl peptidase-4 (DPP-4) inhibitors are two classes of incretin based treatments for type 2 diabetes mellitus. Evidence from randomised controlled trials has shown that GLP-1 agonists effectively lower glycated haemoglobin (HbA1c) by about 1%,2 reduce body weight, and rarely cause hypoglycaemia when used as monotherapy3 4; DDP-4 inhibitors have intermediate efficacy regarding glucose control5 with no impact on body weight and a low risk of hypoglycaemia.3 6 The American Diabetes Association (ADA) and the European Association for the Study of Diabetes (EASD) recommends the consideration of DPP-4 inhibitors and GLP agonists as second line treatment options.6 7
In 2008, the US Food and Drug Administration (FDA) warned of a strong temporal association between exenatide and pancreatitis on the basis of 30 case reports of acute pancreatitis.8 In 2009, the FDA notified healthcare professionals and patients of revisions to the prescribing information for Januvia (sitagliptin) and Janumet (sitagliptin/metformin) after announcing the observation of 88 post-marketing cases of acute pancreatitis.9 In 2012, one consumer group in the United States called for the withdrawal of liraglutide10 and cautioned that liraglutide is associated with higher than expected rates of pancreatitis, thyroid cancer, and kidney failure based on the following statement from FDA reviewers: “in clinical trials patients taking liraglutide had a risk of pancreatitis that was 3.7 fold higher than the risk in patients taking other antidiabetes drugs.” In 2013, the concerns regarding the risk of pancreatitis and pancreatic cancer continued to grow, resulting in international debate.11 12 The BMJ has published several commentaries discussing the potential risk of pancreatitis and implications of using incretin based drugs.13 14 15 16 17 The FDA also has announced ongoing efforts to assess the risk of pancreatic associated with incretins.18 Yet the definitive recommendations regarding the risk are not available.
Findings from animal studies have been inconsistent. Some showed that exenatide seemed to increase inflammation of pancreatic acinar cells19 and formation of pancreatic intraepithelial neoplasia20; sitagliptin increased pancreatic ductal turnover and ductal metaplasia.21 Others suggested that exenatide improved chemically induced pancreatitis in normal and diabetic rodents22 and that liraglutide induced cytokines with anti-inflammatory effects.23 Another study found that liraglutide did not induce pancreatitis in mice, rats, or monkeys when it was given for up to two years and at exposure concentrations up to 60 times higher than in used in humans.24
Results from drug safety surveillance systems have been more concerning. The evidence to support a causal relation between incretin based drugs and pancreatitis is weak. Most safety data have been acquired through the FDA adverse event reporting system (AERS),8 9 25 by which an appropriate selection of control and collection of information regarding the exposure and confounding factors is challenging. Because of ongoing safety concerns, there is a clear need for a rigorous evaluation of the safety of GLP-1 agonists and DPP-4 inhibitors. We conducted a systematic review of randomised and non-randomised studies to provide a comprehensive assessment regarding the risk of pancreatitis associated with GLP-1 agonists and DPP-4 inhibitors relative to placebo or active drugs.
We included randomised and non-randomised controlled trials, prospective and retrospective cohort studies, and case-control studies that enrolled adult patients with type 2 diabetes mellitus; included an unconfounded comparison of GLP-1 agonists or DPP-4 inhibitors against placebo, lifestyle modification, or active antidiabetic drugs; followed up patients for at least 12 weeks (not applicable for case-control studies); and explicitly reported event data on pancreatitis.
To be classified as an unconfounded comparison, we required that planned interventions were identical between treatment and control groups except the GLP-1 agonists or DDP-4 inhibitors under consideration. We also required that authors clearly and explicitly reported numbers of pancreatitis events in all treatment groups under consideration.
We searched Medline, Embase, and the Cochrane Central Register of Controlled Trials (CENTRAL) up to March 2013 for published studies without language restrictions. We used both MeSH and free text terms to identify relevant articles. An information expert (DP) developed the search strategy (appendix 1). At the time of searching, we planned to investigate the effect of incretin treatments on people with and without on diabetes. We thus included search terms defining incretin drugs and study designs only.
We also searched ClinicalTrials.gov to identify additional eligible clinical trials. This trial registry documents all drug trials other than phase I studies as required by Section 801 of the US Food and Drug Administration Amendments Act (FDAAA 801)26 and typically includes extensive lists of adverse events.27 This provides important information regarding data on pancreatitis. We searched generic names of each individual drug to ensure high sensitivity. We undertook the search of ClinicalTrials.gov in August 2013 to ensure that data from previously published trials were updated on the registry. We limited our search to those trials labelled as “completed” and for which results were available.
We developed standardised pilot-tested forms together with detailed instructions for screening of abstracts and full text, risk of bias assessment, and data collection. Pairs of reviewers with training in research methods, independently and in duplicate, screened study reports for eligibility, assessed risk of bias, and collected data from each eligible study. Reviewers dealt with discrepancies through discussion or, if required, adjudication by a third reviewer (XS).
Risk of bias assessment
We used a modified version of Cochrane Collaboration’s tool28 to assess the risk of bias of randomised controlled trials. We considered random sequence generation; allocation concealment; blinding of participants, caregivers, and outcome (that is, pancreatitis) assessors; adjudication of pancreatitis events; prognostic balance between treatment groups; and selective outcome reporting. In assessing the risk of bias with blinding, our modified instrument removed the “unclear” option for the assessment of blinding, an approach we have previously validated.29
We used a modified version of the Newcastle-Ottawa quality assessment scale30 to assess the risk of bias in cohort and case-control studies. For cohort studies, we removed the item regarding representativeness of sample and the item “was the follow-up long enough?” as these items relate to applicability of results. For case-control studies, we also removed the item “representativeness of the cases.” For both types of studies, we added two items, one dealing with ascertainment of type 2 diabetes and another with ascertaining confounding variables. We did not assess publication bias because of the low power associated with studies of rare events.
From eligible randomised controlled trials we collected information on study characteristics (study design, sample size, number of treatment groups, length and design (such as variable or fixed) of follow-up, funding source, registry number, whether trials were international and, if so, countries involved, number of study sites, and study phase); patient characteristics (sex, age, duration of type 2 diabetes, baseline HbA1c concentrations, body mass index (BMI), and fasting plasma glucose); interventions (drugs commonly used across all groups (baseline treatment), incretin treatment, control group, dose, intensity, and duration of treatment); pancreatitis events in each of the treatment groups; and number of patients included for analyses in each of the treatment groups (that is, considered as a safety set).
For extension randomised controlled trials, in which treatment assignments were switched (for example, patients in placebo group started receiving incretins), we documented only the outcome data before that point. For multiple reports of the same trial, we collated all data into a single study.31 If outcome data for pancreatitis were reported at multiple follow-up points, we used data from the longest follow-up.
For observational studies, we documented information as for randomised controlled trials, when applicable. Additionally, we collected information regarding study design (such as retrospective cohort study), sources of data (such as claims data), method of ascertaining type 2 diabetes status (such as ICD (international classification of diseases) code), exposures (such as incretins, and such exposure variables as age), method of adjustment for confounding (such as adjustment or matching, and variables used for these techniques), and follow-up. We also documented unadjusted and adjusted results, in addition to raw event data and exposure time.
We analysed randomised controlled trials and observational studies separately. For randomised trials, we assessed heterogeneity between studies using a χ2 test and the I2 statistic. We pooled trials using Peto’s methods32 33 and reported pooled Peto odds ratios and their associated 95% confidence intervals. P<0.05 was considered significant. We explored sources of heterogeneity with four a priori subgroup hypotheses: type of incretin (GLP-1 agonists v control; DPP-4 inhibitors v control); type of control (incretin v placebo, incretin v active treatment); length of follow-up (incretin v control by subgroup of ≤26 weeks, 26-52 weeks, >52 weeks); and mode of treatment (incretin monotherapy v control, incretin add-on/combination treatment v control), and a post hoc subgroup analysis of different incretins. We undertook sensitivity analyses by using alternative effect measures (odds ratio v relative risk), pooling methods (Peto methods v Mantel-Haenszel method), and consideration on heterogeneity (random v fixed effect).
We qualitatively analysed the data from observational studies because of differences in outcome measures, exposures (that is, drug under consideration), and forms of outcome data (that is, adjusted v unadjusted data; hazard ratio v incidence rate ratio). We reported the results according to meta-analysis of observational studies in epidemiology (MOOSE)34 and preferred reporting items for systematic reviews and meta-analyses (PRISMA).35
Our search yielded 7432 potentially relevant reports. After screening titles and abstracts, we retrieved 468 reports for full text screening. Fifty nine studies, including 55 randomised controlled trials36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 (40 from journals and 15 from the trial registry) reported in 61 reports, three cohort studies,91 92 93 and one case-control study94 were eligible for inclusion (fig 1⇓). Eight months after our formal search (November 2013), however, an additional large case-control study95 was published. We therefore also included this study, resulting in inclusion of two case-control studies. These studies recruited 353 639 patients, including 33 350 from randomised controlled trials and 320 289 from observational studies. Three other retrospective cohort studies also examined risk of pancreatitis with incretin drugs96 97 98; they did not explicitly limit patients to those with type 2 diabetes mellitus and were therefore excluded (appendix 2).
Evidence from randomised controlled trials
The 55 randomised controlled trials—all industry funded—were conducted in 2-49 (median 11) countries and 3-268 (median 110) study sites; 45 (82%) were international and 44 (80%) were phase III studies. The length of follow-up ranged from 12 to 234 weeks. The trials enrolled 69 to 1615 patients (total 33 350), with a mean age range of 49.7-66.5, mean BMI range of 24.5-36.7, mean baseline HbA1c range of 7.3-9.8%, mean fasting plasma glucose range of 7.7-11.3 mmol/L, and mean duration of diabetes range of 1-16.7 years (table 1⇓). None of the studies explicitly mentioned their criteria for diagnosis of pancreatitis.
Twenty seven randomised controlled trials tested GLP-1 receptor agonists, 26 tested DDP-4 inhibitors, and two tested both agents; 17 tested incretin monotherapy, and 38 used incretin agents as add-on or combination treatment (table 2⇓). Duration of treatment ranged from 12-107 weeks (median 26; 22 trials longer than 26 weeks).
Thirty six randomised controlled trials (66%) adequately generated random sequence, 33 (60%) adequately concealed allocation (appendix 3); 47 (86%) blinded patients, caregivers, and outcome assessors. None of the trials adjudicated pancreatitis events.
Risk of pancreatitis in randomised trials
Of the 55 randomised controlled trials reporting pancreatitis, 27 explicitly stated that no events of pancreatitis occurred during the course of study. Eight studies mentioned pancreatic enzymes; none, however, reported usable data. Overall, 37 pancreatitis events occurred in 33 227 patients who used at least one drug (raw event rate 0.11%). Results did not show a significant difference between incretins versus control (odds ratio 1.11, 95% confidence interval 0.57 to 2.17; fig 2⇓).
When we explored the sources of heterogeneity, the risk did not differ by the type of incretin (GLP-1 agonists v DPP-4 inhibitors; interaction test P=0.99): 29 trials, involving 14 562 patients and 16 pancreatitis events (0.11%) compared GLP-1 agonists versus control (odds ratio 1.05, 95% confidence interval 0.37 to 2.94); 28 trials, involving 19 241 patients and 23 events (0.12%) compared DPP-4 inhibitors versus control (1.06, 0.46 to 2.45). Neither analysis suggested an increased risk of pancreatitis (fig A in appendix 4).
The subgroup analysis by type of control (that is, placebo v active drug) did not suggest apparent difference (odds ratio 1.27 in trials comparing with placebo, 1.00 in those comparing with active drug treatments; interaction P=0.72) (fig B in appendix 4). Exploration of the effect by the mode of treatment (monotherapy v add-on/combination treatment) also did not suggest significant difference (0.84 monotherapy v 1.22 add-on/combination treatment; interaction P=0.63) (fig C in appendix 4). Nor was there a difference by length of follow-up (interaction P=0.84; odds ratio 0.90 at 26 weeks or shorter v 1.44 at 26-52 weeks v 1.14 over 52 weeks) (fig D in appendix 4). The post hoc analysis of individual incretins did not show difference among those agents (fig E in appendix 4).
The sensitivity analysis using alternative effect measures (relative risk v odds ratio), statistical models (Mantel-Haenszel v Peto) and considerations on heterogeneity (random effect v fixed effect) did not show important change in the pooled effects (figs F-H in appendix 4).
Evidence from observational studies
Of the five observational studies, three retrospective cohort studies examined the risk of acute pancreatitis associated with the use of exenatide, sitagliptin, or both,91 92 93 and two case-control studies specifically assessed the risk of admission to hospital for acute pancreatitis in patients with type 2 diabetes taking incretins 94 95 (tables 3⇓ and 4⇓).
Of the three cohort studies, the first included 38 615 patients with diabetes (6545 exenatide, 15 826 sitagliptin, and 16 244 control) recruited in the US Medco National Integrated Database.91 Patients aged 18-63 were identified with ICD-9 code for drugs for type 2 diabetes and were followed up for a mean of 0.7 year (0.6 exenatide, 0.8 sitagliptin, 0.7 control). Exposure to incretins was probably identified from pharmacy claims. Study investigators computed a chronic disease score based on pharmacy claims data and identified risk factors for pancreatitis, including drugs and medical conditions by using pharmacy claims and ICD-9 codes. Acute pancreatitis was identified with ICD-9 codes; 154 pancreatitis events (0.4%) occurred (22 in the exenatide group (0.3%), 67 in the sitagliptin group (0.4%), 65 in the control group (0.4%)), with a corresponding incidence of 563.9 cases per 100 000 patient years (569.9 in the exenatide group, 554.4 in the sitagliptin group, and 571.9 in the control group). After adjustment for the influence of age, sex, history of pancreatic disease, alcohol intake, biliary stone disease, hypertriglyceridaemia, and chronic disease score, the risk of acute pancreatitis was similar between exenatide and control (adjusted hazard ratio 0.9, 95% confidence interval 0.6 to 1.5) and sitagliptin and control (1.0, 0.7 to 1.3).
The second study included 268 561 patients (530 574 patient years, 13 791 patient years in exenatide group, 516 783 non-exenatide) with type 2 diabetes from an employer-provided health insurance covering about 6.6 million employees in the US.92 Patients were aged 63.1 on average, with mean duration of diabetes of 3.1 years. Study investigators used ICD-9 codes to identify patients with type 2 diabetes and their pancreatic outcome (admission for acute pancreatitis, code 577.0). The information regarding exposure to exenatide was identified by National Drug Codes. They also used ICD-9 codes to identify information regarding a set of 19 co-morbid conditions (such as congestive heart failure, chronic obstructive pulmonary disease, and stroke) and traditional risk factors for pancreatitis. They identified 1312 (0.5%) admissions for acute pancreatitis events (27 in those taking exenatide, 1285 in those not taking exenatide), with corresponding incidence of 247.3 cases per 100 000 patient years (195.8 for exenatide, 248.7 for non-exenatide). The risk of admission for acute pancreatitis in patients who have used exenatide was not statistically different (0.20% v 0.25%; adjusted odds ratio 0.93, 95% confidence interval 0.63 to 1.36) after adjustment for age, sex, years since diagnosis of diabetes, year of observation, 19 co-morbid conditions, and traditional risk factors for pancreatitis.
The third study recruited 5560 patients from a diabetes specialty care centre in India.93 Of these patients, 2817 received sitagliptin and 2743 self injected insulin glargine. Information regarding ascertainment of other variables (confounders), however, was not reported. This study found no patient with either symptoms or signs of acute pancreatitis in the sitagliptin or insulin glargine group.
The first case-control study identified 1269 cases (admissions for acute pancreatitis) and 1269 controls from administrative claims of Blue Cross Blue Shield plan.94 All of these patients, aged 52 on average, had type 2 diabetes, as confirmed by ICD-9 codes or drug history for hyperglycaemia. Patients with type 1 diabetes or gestational diabetes were excluded. Cases were identified with a validated algorithm based on ICD-9 and current procedural terminology codes for acute pancreatitis, and occurrences of pancreatitis within three months of enrolment were excluded. Controls were selected, on a 1:1 ratio, for each case; they were matched for age within 10 years, sex, insurance plan site, diabetes complication severity index, and enrolment pattern or duration of follow-up. Information on drug exposure (exenatide or sitagliptin) was identified from the pharmacy database. No information was available regarding the ascertainment of risk factors for acute pancreatitis and use of other drugs. After we controlled for the influence of hypertriglyceridaemia, alcohol use, gallstones, tobacco abuse, obesity, biliary and pancreatic cancer, cystic fibrosis, an indicator of general morbidity level, and metformin exposure during the same period, we found that use of sitagliptin or exenatide within 30 days before pancreatitis versus non-use (that is, no use for more than two years before the index date of pancreatitis event; adjusted odds ratio 2.24, 95% confidence interval 1.36 to 3.68), recent use (30 days to two years before admission; 2.01, 1.37 to 3.18), and any use within two years (2.07, 1.36 to 3.13) were associated with significantly increased odds of acute pancreatitis.
The second case-control study, conducted in Italy, assessed the use of incretins (exenatide, liraglutide, sitagliptin, saxagliptin, and vildagliptin).95 This study identified 1003 cases (admission for acute pancreatitis) and 4012 controls matched for year of birth, sex, and year of first exposure to antidiabetic drugs from regional administrative data of the Italian national health system that allowed the linkage of drugs dispensed with hospital discharges. All the patients with type 2 diabetes, dispensed at least one dose of antidiabetic drugs and aged 72 on average, were identified according to the ICD-9 system. Patients coded for type 1 diabetes (250.x1, 250.x3) were excluded. Cases were identified through the ICD-9 code (577.0) at discharge. The exposure to incretins and other antidiabetic drugs (metformin or glibenclamide) was measured according to the anatomical therapeutic classification system. Potential confounders—history of chronic or acute pancreatitis, gallstones, alcohol misuses, biliary tract or pancreatic cancers, and admission for cardiovascular diseases and diabetic retinopathy—were measured with ICD-9 codes. After adjustment for those confounders and the use of other antidiabetic drugs, the adjusted analyses did not show a significant association between the exposure to incretins and the risk of admission for acute pancreatitis (adjusted odds ratio 0.98, 95% confidence interval 0.69 to 1.38).
Risk of bias in observational studies
All observational studies used either claims data or patients’ medical records for their analyses. Studies using claims data or medical records confirmed diagnosis of type 2 diabetes, drug exposures, confounding factors, and occurrence of pancreatitis based on ICD-9 codes and pharmacy claims data (tables 5 and 6⇓ ⇓). The approaches for ascertaining type 2 diabetes differed across those studies (the ICD-9 codes they used varied), and the accuracy of ascertaining type 2 diabetes remains unclear. Three studies described the method for ascertaining confounding factors and the use of drugs other than incretins.91 92 95 Though the four studies that used claims data adjusted for the association, they chose different variables, leaving the adequacy of adjustment questionable. All studies failed to report the extent to which the claims data were complete in the overall database. Because of these limitations the risk of bias associated with eligible observational data was moderate to high.
In this systematic review and analysis of 55 randomised trials (low to moderate risk of bias involving 37 cases of pancreatitis among 33 227 patients), three retrospective cohort studies (moderate to high risk of bias involving 1466 pancreatitis events among 312 736 patients), and one case-control study (moderate risk of bias involving 1003 patients admitted to hospital for acute pancreatitis) we found no evidence to suggest an increased risk of pancreatitis associated with the use of incretins in patients with type 2 diabetes. The other case-control study (1269 patients admitted for acute pancreatitis), at moderate risk of bias, reported increased risk of admission for pancreatitis associated with the use of sitagliptin or exenatide.
The incidence of pancreatitis was low. In randomised trials, pancreatitis occurred in 0.11% of patients (0.11% in those taking incretins; 0.11% in control patients). In cohort studies, the risk of acute pancreatitis and admission for pancreatitis was higher (0.47%) than the risk in randomised trials, potentially because of a higher incidence of risk factors such as gallstones and longer follow-up.
Our findings should be interpreted cautiously. Although we included a large number of randomised trials, those trials were typically designed for testing efficacy. Many had relatively small sample sizes and relatively short follow-up. Because pancreatitis is rare and the event rates low, the confidence intervals around relative effects are wide, leaving the possibility of an undetected increase in risk. Furthermore, these trials—mostly phase III studies—often recruited patients with less co-morbidity than patients seen in clinical practice. The risk in the non-exposed patient group is therefore lower than usual (as above 0.11% in trials v 0.47% in observational studies). This in part explains the wide confidence intervals and also limits generalisability of the results.
There are further potential limitations of the randomised trials. Trials could have failed to document pancreatitis events or, if documented, failed to report these events (that is, selective reporting bias). Pancreatitis, however, is usually considered a serious adverse event in trials of type 2 diabetes, and, according to FDA’s policy, the reporting of serious adverse event data is mandatory to ClinicalTrials.gov,27 limiting the risk of lack of monitoring and selective reporting. Even if pancreatitis events were monitored, however, they might not have been independently adjudicated, raising the possibility of inaccurate data.
A final issue is the possibility of failure to identify patients with subclinical minimally symptomatic pancreatitis. The increase of pancreatic enzyme activity (lipase and amylase), a surrogate measure, could represent supporting evidence in the assessment of the risk of pancreatitis; these data, however, were not readily usable.
The five observational studies, involving patients in real practice, had large sample sizes, but had limitations related to use of claims data or patients’ medical records. Because most studies relied on the ICD-9 coding system to identify study populations and outcomes, the ascertainment of type 2 diabetes, and particularly pancreatitis, was probably inadequate because of the variation of diagnosis criteria and lack of outcome adjudication. Similar to the situation with trials, subclinical and minimally symptomatic cases of pancreatitis were less likely to be identified in those studies. Additionally, the exposure to incretins and control drugs and the exposure to other confounding factors might not have been accurately documented. The completeness of data within each of those databases is also unclear; investigators might have excluded those without complete exposure and outcome data from analyses. Finally, the accurate measurement and adjustment for other prognostic factors was limited. Overall, the risk of bias was moderate to high in all observational studies.
Among those five observational studies, a single case-control study suggested an increased risk of admissions for acute pancreatitis; the four others, including three cohort studies and one case-control study, did not. Of the four studies suggesting no increased risk, three consistently reported the point estimates close to 1 and the confidence intervals were similar (0.6 to 1.5). The reasons for discrepancy between the single case-control study and the other studies are not clear: the selection of different study populations (that is, different age groups, thus differing baseline risk) and different choices of exposures and non-exposures are possible explanations. Varying risk of bias and inadequate control of confounders are other explanations.
In addition to those five eligible observational studies, three retrospective cohort studies (appendix 2), at moderate risk of bias and that failed to limit patients to those with type 2 diabetes (and were therefore excluded), reported the risk of acute pancreatitis associated with exenatide.96 97 98 These studies consistently suggested that exenatide was not associated with an increased risk of acute pancreatitis.
The FDA adverse drug event system has documented 2327 spontaneously reported cases of pancreatitis in patients taking exenatide, 888 case in those taking liraglutide, 718 cases in those taking sitagliptin, and 125 cases in those taking saxagliptin.12 The number of cases of pancreatitis seemed larger in those taking incretins than other active antidiabetic drugs, suggesting a potentially increased risk. The absence of data on number of patients exposed to those antidiabetic drugs, and the possibility of a lower threshold of reporting with new drugs, however, severely limits the usefulness of these data for making causal inferences.
Strengths and limitations
Our study has several strengths. Firstly, we systematically identified and included both randomised and non-randomised studies to examine the risk of pancreatitis associated with incretin treatment. Secondly, in addition to published reports, we searched ClinicalTrials.gov, which provided additional outcome information and eligible trials. Thirdly, we instituted a rigorous approach to ensure the data were accurate, in particular using the data on pancreatitis reported in ClincialTrials.gov and journal publications for consistency.
We did not assess the risk of pancreatic cancer associated with the use of incretins. Although studies have suggested a potentially increased risk, they have many limitations.99 The FDA adverse drug event system documented 258 cases of pancreatic cancer in patients taking exenatide, 63 cases in those taking liraglutide, 81 cases in those taking sitagliptin, and 18 cases in those taking saxagliptin.12 The number of cancer cases did not seem larger in patients taking incretins (except exenatide) than other drugs for diabetes. We also did not specifically assess the risk of chronic pancreatitis associated with the use of incretins; few data on this issue are available.
Comparison with other studies
Two other meta-analyses have assessed the risk of pancreatitis among patients using incretins, one examining GLP-1 agonists100 and another DPP-4 inhibitors.101 The first meta-analysis, involving 22 randomised controlled trials and three retrospective cohort studies, reported no significant association between pancreatitis events and the exposure to exenatide or liraglutide.100 This analysis pooled results of randomised trials and large observational studies, making the interpretation of estimates challenging: in 10 randomised controlled trials and three retrospective cohort studies the odds ratio for exenatide was 0.84 (95% confidence interval 0.58 to1.22) and in the combined results of 10 randomised controlled trials the odds ratio for liraglutide was 0.97 (0.21 to 4.39). Furthermore, this study included two cohort studies, in which patients might not be strictly limited to those with type 2 diabetes mellitus and were thus excluded from our review. The second study was a meta-analysis of exclusively randomised controlled trials, investigated risk of pancreatitis in DDP-4 inhibitors.101 It found that DPP-4 inhibitors were not associated with an increased risk of pancreatitis (odds ratio 0.93, 95% confidence interval 0.51 to 1.69).101 Both meta-analyses included trials that had no explicit information regarding pancreatitis; they might have assumed that no pancreatitis occurred in such trials. It is probably reasonable to assume no event in the absence of reporting in such situation. This approach, however, could artificially reduce the incidence of pancreatitis as more patients are added to the population whereas no events are added. In either of the approaches (ours and those of the two other published meta-analyses), however, the statistical model did not include zero event trials in meta-analyses, as they are statistically omitted in pooling relative effects. Compared with these two meta-analyses, our study included five observational studies that carry more important information regarding the risk of pancreatitis.
In summary, the available evidence suggests that the incidence of pancreatitis in patients taking incretins is low and that these drugs do not increase the risk of pancreatitis. The current body evidence, however, is not definitive, and more carefully designed and conducted observational studies are warranted to definitively establish the extent, if any, of increased risk. In addition, incretins, which are expensive, are no superior to widely used antidiabetic drugs (such as metformin) for glucose control. Given the uncertainty about the effect of incretins on important outcomes, including pancreatitis, the lack of apparent benefits in glucose control over other drugs, and the relatively high costs, the use of incretins might not be preferable to other available antidiabetic drugs.
Future demonstration of consistency of the putative association across studies is warranted. Trialists exploring the effect of incretins should report all adverse events affecting the pancreas. Presentation of associations both in class of agents (such as GLP-1 agonists) and individual incretins is important and informative to assess the potential risk. Reporting of results for the gradient of pancreatic outcomes—pancreatic enzymes, asymptomatic pancreatitis, symptomatic pancreatitis, and admission for acute pancreatitis—will also be helpful for informing risks associated with incretin treatment. Future randomised trials that specifically examine this issue, however, are unlikely. We need more carefully designed and conducted observational studies that clearly define study population, accurately collect information regarding length to follow exposure and confounding factors, completely collect outcome data, and adequately adjust for the influence of confounders. Currently, a European study is applying surveillance and observational study methods to assess vascular and pancreatic safety of diabetes drugs, including thiazolidinedones (TZDs), incretins, and amylin analogues in people with type 2 diabetes.102 The resulting findings might provide more definitive evidence.
What is already known on this topic
A number of cases of acute pancreatitis have been reported in patients with type 2 diabetes who were taking incretins
Concerns have arisen regarding the risk of pancreatitis associated with these agents, though findings from various studies are conflicting
What this study adds
Data from randomised controlled trials are not adequate to assess the risk of pancreatitis, but several large observational studies, with methodological limitations, provide relatively precise estimates
The available evidence suggests that the incidence of pancreatitis in patients with type 2 diabetes taking incretins is low and that incretins do not increase risk of pancreatitis
Cite this as: BMJ 2014;348:g2366
We thank Daphne Plaut for developing the search strategy and conducting literature search and Stephen D Walter for useful advice in data analysis.
Contributors: XS conceived the study and acquired the funding. XS and LL had full access to all of the data in the study, and take responsibility for the integrity of the data and the accuracy of the data analysis. XS, LL, GHG, SJT, MMB, POV, LPR, and GM designed the study. XS and LL developed and tested the data collection forms. LL, JTS, MMB, JWB, SE, POV, LPR, GM, EW, ZS and XS acquired the data. LL and XS conducted the analysis and interpreted the data. XS and LL drafted the manuscript. All authors critically revised the manuscript. XS is guarantor.
Funding: This study was funded by Young Investigator Award, Sichuan University (project No 2013SCU04A37). JWB is funded by a New Investigator Award from the Canadian Institutes of Health Research and Canadian Chiropractic Research Foundation. SE is funded by MITACS Elevate and Restracomp Postdoctoral Awards. The funders had no role in the study design, writing of the manuscript, or decision to submit this or future manuscripts for publication.
Competing interests: All authors have completed the ICMJE uniform disclosure form at http://www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Not required.
Transparency: The lead author (the manuscript’s guarantor) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned have been explained.
Data sharing: No additional data available.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 3.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/3.0/.