Intended for healthcare professionals

CCBYNC Open access
Research

Serum uric acid levels and multiple health outcomes: umbrella review of evidence from observational studies, randomised controlled trials, and Mendelian randomisation studies

BMJ 2017; 357 doi: https://doi.org/10.1136/bmj.j2376 (Published 07 June 2017) Cite this as: BMJ 2017;357:j2376
  1. Xue Li, PhD student1,
  2. Xiangrui Meng, PhD student1,
  3. Maria Timofeeva, statistical geneticist2,
  4. Ioanna Tzoulaki, senior lecturer3,
  5. Konstantinos K Tsilidis, assistant professor3 4,
  6. John PA Ioannidis, professor5 6 7,
  7. Harry Campbell, professor1,
  8. Evropi Theodoratou, chancellor’s fellow1 2
  1. 1Centre for Global Health Research, Usher Institute of Population Health Sciences and Informatics, University of Edinburgh, Edinburgh EH8 9AG, UK
  2. 2Colon Cancer Genetics Group, Medical Research Council Human Genetics Unit, Medical Research Council Institute of Genetics & Molecular Medicine, University of Edinburgh, Edinburgh, UK
  3. 3Department of Epidemiology and Biostatistics, School of Public Health, Imperial College London, London, UK
  4. 4Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece
  5. 5Stanford Prevention Research Center, Stanford School of Medicine, Stanford, CA, USA
  6. 6Department of Health Research and Policy, Stanford School of Medicine, Stanford, CA, USA
  7. 7Department of Statistics, Stanford University, Stanford, CA, USA
  1. Correspondence to: E Theodoratou E.Theodoratou{at}ed.ac.uk
  • Accepted 10 May 2017

Abstract

Objective To map the diverse health outcomes associated with serum uric acid (SUA) levels.

Design Umbrella review.

Data sources Medline, Embase, Cochrane Database of Systematic Reviews, and screening of citations and references.

Eligibility criteria Systematic reviews and meta-analyses of observational studies that examined associations between SUA level and health outcomes, meta-analyses of randomised controlled trials that investigated health outcomes related to SUA lowering treatment, and Mendelian randomisation studies that explored the causal associations of SUA level with health outcomes.

Results 57 articles reporting 15 systematic reviews and144 meta-analyses of observational studies (76 unique outcomes), 8 articles reporting 31 meta-analyses of randomised controlled trials (20 unique outcomes), and 36 articles reporting 107 Mendelian randomisation studies (56 unique outcomes) met the eligibility criteria. Across all three study types, 136 unique health outcomes were reported. 16 unique outcomes in meta-analyses of observational studies had P<10-6, 8 unique outcomes in meta-analyses of randomised controlled trials had P<0.001, and 4 unique outcomes in Mendelian randomisation studies had P<0.01. Large between study heterogeneity was common (80% and 45% in meta-analyses of observational studies and of randomised controlled trials, respectively). 42 (55%) meta-analyses of observational studies and 7 (35%) meta-analyses of randomised controlled trials showed evidence of small study effects or excess significance bias. No associations from meta-analyses of observational studies were classified as convincing; five associations were classified as highly suggestive (increased risk of heart failure, hypertension, impaired fasting glucose or diabetes, chronic kidney disease, coronary heart disease mortality with high SUA levels). Only one outcome from randomised controlled trials (decreased risk of nephrolithiasis recurrence with SUA lowering treatment) had P<0.001, a 95% prediction interval excluding the null, and no large heterogeneity or bias. Only one outcome from Mendelian randomisation studies (increased risk of gout with high SUA levels) presented convincing evidence. Hypertension and chronic kidney disease showed concordant evidence in meta-analyses of observational studies, and in some (but not all) meta-analyses of randomised controlled trials with respective intermediate or surrogate outcomes, but they were not statistically significant in Mendelian randomisation studies.

Conclusion Despite a few hundred systematic reviews, meta-analyses, and Mendelian randomisation studies exploring 136 unique health outcomes, convincing evidence of a clear role of SUA level only exists for gout and nephrolithiasis.

Introduction

Uric acid was thought to be a biologically inert waste product from purine metabolism, until in the early 1800s it was discovered that an increased serum uric acid (SUA) level was the cause of gout.1 Subsequently, associations of uric acid concentration with cardiovascular and renal disorders were also observed.2 These associations were explored in several prospective studies but yielded conflicting results, and therefore the causal role of uric acid in these diseases was widely questioned.3 4 5 6 It was argued that these associations are either confounded by other risk factors, such as obesity and hypertension, or are representative of reverse causality.4 7 These inconclusive findings led to a shift of interest away from uric acid, and asymptomatic hyperuricemia was not considered as an indication for SUA lowering treatment in patients with cardiovascular and renal diseases.8 9

New findings have fuelled enthusiasm to address this longstanding controversy.10 Recent epidemiological studies have explored associations of uric acid with a wide range of conditions (cardiovascular diseases, metabolic syndrome, diabetes, and cancer) and some intermediate phenotypes or biomarkers.11 In an attempt to understand the possible underlying mechanisms, laboratory studies have been carried out and found that uric acid is potentially involved in multiple biological processes, including oxidative stress, systemic inflammation, and intrahepatic fructose metabolism, all mechanisms that could be linked to the development of cardiovascular disease and metabolic syndrome.12 13 14 Alternatively, uric acid level may only present a marker of high oxidative stress associated with increased xanthine oxidase activity, instead of being an active agent in the pathogenic processes.15 Finally, taking into account the antioxidant properties of uric acid (acting as a free radical scavenger), its potential mechanistic roles in these disorders may be complex.16

In view of the potential importance of uric acid, assessing the credibility of the observed evidence may have implications both for clinical practice and public health. It is recognised that different types of studies have specific strengths and weaknesses that can be complementary (see box 1). An umbrella review, which collects and evaluates evidence from multiple resources systematically, might therefore help clarify the composite literature. We carried out an umbrella review of meta-analyses of observational studies, meta-analyses of randomised controlled trials, and Mendelian randomisation studies on associations between SUA level and multiple health outcomes. In particular, we summarised the range of related health outcomes, presented the magnitude, direction, and significance of the reported associations and effects, assessed the potential biases, and identified which associations and effects have the most convincing evidence.

Box 1: Strengths and limitations of study types

  • Although none of the following study types are infallible, all are able to provide useful information about causal inference and can complement each other to achieve increasing certainty about causality

Observational studies
  • Aim to examine the association between an exposure and an outcome and to test whether the association is caused by chance, bias, or confounding

  • Typically are affected by residual confounding, undetected bias, or reverse causality, which may generate associations that are not reliable indicators of causality

Randomised controlled trials
  • An approach to obtain evidence of a causal effect of a treatment or intervention on a disease process

  • Eliminates many of the biases and confounding factors that are present in observational studies

  • Limitations include non-adherence to the assigned intervention, limited external validity, short term intervention effects, and non-retention, which can all render the results invalid or questionable

  • High costs and ethical concerns can also limit the application of the trials in scientific research

Mendelian randomisation studies
  • Provide a cost effective analogy to a randomised controlled trial by using genetic variants as proxies to test the causality of an association between exposure and outcome

  • Is not influenced by the confounding inherent in observational studies and not seriously affected by reverse causality, but does rely on several assumptions (the genetic instruments should be associated with the exposure of interest, they should not be associated with known confounders, and they should affect the outcome solely through the exposure) that can be hard to identify and control

  • May lack power when the proportion of trait variance explained by the genetic instruments is small

Methods

Literature search and selection criteria

We systematically searched Medline, Embase, and the Cochrane Database of Systematic Reviews from inception to 17 July 2016 using a comprehensive search strategy (see table S1 in the web appendix) to identify systematic reviews and meta-analyses of observational studies, meta-analyses of randomised controlled trials, and Mendelian randomisation studies. All identified publications went through a three step parallel review of title, abstract, and full text (performed by XL and XM) based on predefined inclusion and exclusion criteria.

We included systematic reviews and meta-analyses of observational studies that examined associations between serum uric acid (SUA) levels (or hyperuricemia) and health outcomes; meta-analyses of randomised controlled trials that investigated health outcomes related to SUA lowering treatment (intervention with one or a combination of two or more SUA lowering drugs versus placebo or no treatment), including xanthine oxidase inhibitors (allopurinol, febuxostat, or oxypurinol), uricosuric agents (probenecid, benzbromarone, thiazides, or citrates), and uricase analogues (pegloticase or rasburicase); and Mendelian randomisation studies that explored SUA (or hyperuricemia) associations in relation to health outcomes by using genetic instruments influencing SUA levels. The identified health outcomes included a wide range of diseases, intermediate phenotypes, and biomarkers. We excluded studies investigating associations between gout and health outcomes and meta-analyses of randomised controlled trials that used non-drug interventions, such as dietary or lifestyle interventions. We further excluded animal and laboratory studies, meta-analyses on the prevalence of gout and hyperuricemia, and meta-analyses of randomised controlled trials that focused on drug variables, safety, and effects of reducing SUA levels without investigating other health effects.

Data extraction

One investigator (XL) extracted data, which were checked by a second investigator (XM). For each eligible study, we extracted the PubMed identification number, lead author’s name, journal name, publication year, study population, number of studies included, and outcomes investigated. For meta-analyses investigating more than one health outcome, we recorded each outcome separately. For meta-analyses of observational studies and of randomised controlled trials, we extracted the reported summary risk estimates (risk ratio, odds ratio, hazard ratio, or mean difference) with the 95% confidence intervals and the corresponding number of case and control participants. Furthermore, for each unique outcome we extracted data from the individual component studies that were included in the meta-analyses for further analysis. This second level extraction included data on study design, number of cases, total number of participants, relative risk estimates, and 95% confidence intervals for each component study. When more than one meta-analysis existed for the same outcome in the same population, we extracted individual component data from the most recent and largest meta-analysis. In a few exceptions where the most recent was not also the largest meta-analysis, we explored the reason for this discrepancy. If the most recent included prospective studies and the largest one had fewer prospective studies plus some retrospective data, we kept the one with the largest amount of prospective data; otherwise we kept the largest meta-analysis. For Mendelian randomisation studies, we extracted data on study population, sample size, genetic instruments, the variance of SUA level explained by the genetic instruments (R2) and Mendelian randomisation effect estimates (odds ratio, hazard ratio, mean difference, or regression coefficient β), standard deviation of SUA levels, and standard deviation of continuous outcomes.

Data analysis

For systematic reviews we performed descriptive analyses and presented the authors’ conclusions. For each unique meta-analysis of observational studies and of randomised controlled trials, we estimated several metrics, including the summary effect and 95% confidence intervals using a random effect model (DerSimonian Laird method)17; the heterogeneity among studies (Q statistic and I2 metric with 95% confidence intervals); the 95% prediction interval to predict the range of effect size that would be expected in a new original study, after accounting for both the heterogeneity among individual studies and the uncertainty of the summary effect estimated in the random effect model (the calculation of 95% prediction interval is based on the predicted distribution derived from a function of the degree of heterogeneity, number of studies included, and within study standard errors)18 19; the presence of small study effects by using the Egger’s regression asymmetry test to investigate if small studies tend to give larger estimates of effect size than large studies (significance threshold P<0.10)20; and the excess significance test to assess if the observed number (O) of studies with significant results was greater than the expected number (E) using the χ2 test: A=[(O−E)2/E+(O−E)2/(n−E)] (significance threshold P<0.10).21 22 For the excess significance test, we calculated the expected number (E) of studies with significant findings by using the sum of statistical power estimated for each component study. The statistical power of each component study was calculated with an algorithm that uses a non-central t distribution, by assuming the true effect size to be the same as that of the largest component study (with smallest variance) in the meta-analysis.23 If the type of metric in a meta-analysis was mean difference, we firstly calculated Cohen’s d by weighing the pooled standard deviation based on the sample size of individual studies. We then transformed Cohen’s d, Hedges g, and other standardised mean difference metrics to odds ratios.24 We compared the results reported in overlapping meta-analyses to evaluate their concordance in terms of the direction and statistical significance of the observed associations. All statistical analyses were conducted in Stata (StataCorp) version 14.0.

Owing to the extensive differences in genetic instruments used in the Mendelian randomisation studies we did not conduct quantitative syntheses. Instead, we performed and present here a descriptive analysis of the individual studies. When more than one Mendelian randomisation study was conducted for the same outcome, we compared the concordance of the findings for the direction and statistical significance of the reported association and retained the study with the largest number of cases and participants for further analysis and comparison. If all of the information required for calculation was provided (ie, sample size, number of cases, R2, estimates of association, standard deviation of continuous outcomes, and standard deviation of SUA levels), we performed a power calculation for the largest Mendelian randomisation studies by using the non-centrality parameter based approach.25 For Mendelian randomisation studies with missing R2 values, we performed a crude power estimation by using the R2 values from other Mendelian randomisation studies that used the same genetic variants as instruments.

Credibility assessment

As previously proposed,26 we classified evidence from meta-analyses of observational studies with nominally statistically significant summary results (P<0.05) into four categories (class I, II, III, and IV). Convincing (class I) evidence was assigned to associations with a statistical significance of P<10−6, included more than 1000 cases (or more than 20 000 participants for continuous outcomes), had the largest component study reporting a significant result (P<0.05), had a 95% prediction interval that excluded the null, did not have large heterogeneity (I2 <50%), and showed no evidence of small study effects (P>0.10) and of excess significance bias (P>0.10). Highly suggestive (class II) evidence was assigned to associations that reported a significance of P<0.001, included more than 1000 cases (or more than 20 000 participants for continuous outcomes), and had the largest component study reporting a statistically significant result (P<0.05). Suggestive (class III) evidence was assigned to associations that reported a significance of P<0.01 with more than 1000 cases (or more than 20 000 participants for continuous outcomes). Weak (class IV) evidence was assigned to the remaining significant associations with P<0.05. For each association in the convincing or highly suggestive categories we reassessed the evidence after excluding the retrospective and case-control studies in an attempt to address reverse causality. Finally, for each association in the convincing category we reassessed the evidence after we examined each meta-analysis in depth by assessing the eligibility of the included studies as well as verifying the data used in the meta-analysis.

Evidence from meta-analyses of randomised controlled trials was assessed in terms of the significance of the summary effect (P<0.01, 0.01≤ P<0.05, P≥0.05), 95% prediction interval (excluding the null or not), and presence of large heterogeneity (I2 >50%), small study effects (P>0.10), and excess significance (P>0.10). We also noted the conclusions from any evidence classification (GRADE27 or equivalent system) applied by the original meta-analyses. Finally, we assessed the evidence from individual Mendelian randomisation studies for statistical significance of the effect estimate (P<0.01) and of the statistical power (>80%).28

For overlapping outcomes that were investigated in meta-analyses of observational studies and/or meta-analyses of randomised controlled trials and/or individual Mendelian randomisation studies, we examined if the direction and statistical significance of the associations were reported concordantly across the different study types. We noted the overlapping outcomes that were graded as class I or II in meta-analyses of observational studies and had a 95% prediction interval excluding the null in meta-analyses of randomised controlled trials. For these outcomes we also presented the evidence from Mendelian randomisation studies if available.

Patient involvement

No patients were involved in setting the research question or the outcome measures, nor were they involved in developing plans for design or implementation of the study. No patients were asked to advise on interpretation or writing up of results. There are no plans to disseminate the results of the research to study participants or the relevant patient community.

Results

Literature review

Overall, the parallel reviews identified 4608 publications across three databases. After applying the inclusion or exclusion criteria, 101 publications were selected for inclusion (fig 1). Specifically, 15 systematic reviews and 144 meta-analyses of observational studies were reported in 57 articles29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85; 31 meta-analyses of randomised controlled trials were reported in 8 articles86 87 88 89 90 91 92 93; and 107 Mendelian randomisation studies were reported in 36 articles (see tables S2 to S5, respectively, in web appendix).94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 Across all three study types, 136 unique outcomes were reported.

Meta-analyses of observational studies

Overall, 144 meta-analyses of observational studies were identified (see table S3in web appendix). The median number of studies included in meta-analyses was 5 (range 2-31), the median number of participants was 7932 (129-1 017 810), and the median number of cases was 1176 (49-34 370). More than one meta-analysis was conducted for 16 outcomes (see table S3 in web appendix). The direction and statistical significance of the reported associations in overlapping meta-analyses were concordant for 14 (88%) outcomes: atrial fibrillation incidence (n=3),39 52 82 coronary heart disease (n=4),41 72 76 83 hypertension incidence (n=3),44 74 85 stroke incidence (n=2),48 75 diabetes (n=3),49 50 79 chronic kidney disease (n=3),54 55 77 mild cognitive impairment (n=2),58 80 Parkinson’s disease (n=3),58 59 81 multiple sclerosis (n=2),60 78 coronary heart disease mortality (n=3),41 72 76 cardiovascular disease mortality (n=2),65 84 stroke mortality (n=2),48 75 all cause mortality in patients with heart failure (n=2),43 67 and all cause mortality in the general population (n=2).65 84 Discordance in the statistical significance was present for two outcomes: diabetic neuropathy (n=2)51 53 and Alzheimer’s disease (n=4).57 58 73 80

After removing the overlapping meta-analyses (which were conducted in the same population for the same outcome), 76 unique meta-analyses were retained. The meta-analyses reported a wide range of outcomes (table 1): cardiovascular outcomes (n=13), diabetes related outcomes (n=9), kidney disorders (n=7), neurocognitive disorders (n=11), cancer outcomes (n=6), all cause or cause specific mortality (n=22), and other outcomes (n=8). Overall, 58 (76%) of the 76 non-overlapping meta-analyses reported nominally significant summary results (P<0.05). Figures 1 and 2 in the web appendix show the summary effects of the unique meta-analyses of observational studies. Of these, 12 (92%) meta-analyses in cardiovascular outcomes, 8 (89%) in diabetes related outcomes, all 7 (100%) in kidney disorders, 1 (9%) in neurocognitive disorders, 1 (17%) in cancer outcomes, 15 (68%) in all cause and cause specific mortality, and 6 (75%) in other outcomes reported summary estimates with P<0.05 and suggested that high levels of SUA were associated with an increased risk of disease. In addition, 7 (64%) meta-analyses in neurocognitive disorders and 1 (12%) in other outcomes (composite of adverse outcomes (death or major adverse cardiovascular event) in patients with acute ischaemic stroke) reported summary estimates with P<0.05 and suggested inverse associations with SUA level.

Table 1

Health outcomes and evidence class reported in meta-analyses (MA) of observational studies

View this table:

We then applied our evidence classification criteria. Sixteen (21%) meta-analyses had P<10−6, 10 (13%) had a 95% prediction interval that excluded the null, 27 (36%) had more than 1000 cases (or more than 20 000 participants for continuous outcomes), 15 (20%) had no large heterogeneity (I2<50%), and 34 (45%) had neither small study effects nor excess significant bias. Based on these metrics, only one of 76 (1%) outcomes presented convincing evidence (class I: stroke mortality in general population), 7 (9%) outcomes presented highly suggestive evidence (class II: heart failure incidence, hypertension incidence, impaired fasting glucose or diabetes, chronic kidney disease incidence, coronary heart disease mortality, all cause mortality in patients with heart failure, and non-alcoholic fatty liver disease), and 9 (12%) outcomes presented suggestive evidence (class III: atrial fibrillation, coronary heart disease incidence, cardiovascular disease, prehypertension, medium term major adverse cardiac event, type 2 diabetes, cardiovascular disease mortality, chronic kidney disease mortality, death, or cardiac events). The remaining 41 (54%) statistically significant outcomes presented weak evidence (class IV).

We performed a thorough examination and reassessed the meta-analyses of stroke mortality48 (class I) and found that data from the largest study were incorrect (the events represented stroke incidence cases rather than stroke deaths and the included study had not published data on stroke mortality).130 Furthermore, the data from two individual studies reported comparisons of SUA categories that differed from other studies (the highest sextile versus the second or third sextile rather than the lowest),131 132 and a fourth study had been using only data on ischaemic stroke deaths but missing the data on haemorrhagic stroke deaths.133 When we excluded the stroke incidence study, used the proper comparison for the other two studies, and added the missing data in the fourth study, the association with stroke mortality was not statistically significant (table 2). For the highly suggestive outcomes (class II), when we limited the data to prospective cohort studies, all associations retained their ranking, except for all cause mortality in patients with heart failure and non-alcoholic fatty liver disease, which were downgraded to class III (table X in the web appendix).

Table 2

Reassessing the credibility of associations with class I and II evidence reported in meta-analyses (MA) of observational studies

View this table:

Meta-analyses of randomised controlled trials

We identified 31 meta-analyses of randomised controlled trials on SUA lowering treatment from eight publications (see table S4 in web appendix). The median number of studies included in the meta-analyses was 5 (range 2-10) and the median number of participants was 216 (41-738). More than one meta-analysis was found for five outcomes (see table S4 in web appendix). The direction and statistical significance of the effects in overlapping meta-analyses were in concordance only for one (20%) outcome: serum creatinine level (n=2).88 89 Discordance in either the direction and/or the statistical significance was found for the remaining four outcomes: glomerular filtration rate (n=2),88 89 end stage kidney disease (n=2),88 89 systolic blood pressure (n=2),89 93 and diastolic blood pressure (n=2).89 93

Twenty unique meta-analyses (table 3) were identified for the outcomes in relation to kidney disorders (n=10), endothelial function (n=2), all cause and cause specific mortality (n=4), and other outcomes (n=4). Figure 3 in the web appendix shows the summary effects of the unique meta-analyses of randomised controlled trials. Overall, 12 (60%) reported a nominally significant summary result at P<0.05 (8 had P<0.001). Only three (15%) meta-analyses had a 95% prediction interval that excluded the null (two nephrolithiasis outcomes (with thiazide and citrate treatment) and one renal function outcome), 11 (55%) meta-analyses showed no large heterogeneity (I2<50%), and 13 (65%) meta-analyses showed neither small study effects nor excess significant bias.

Table 3

Health outcomes reported in meta-analyses of randomised controlled trials

View this table:

Only one outcome (recurrence of nephrolithiasis with citrates treatment) reported a P<0.001, had a 95% prediction interval excluding the null, and had no evidence of large heterogeneity or bias. In the original meta-analyses, the strength of evidence was graded collectively for three nephrolithiasis outcomes (thiazide, citrate, or allopurinol treatment) by using an approach conceptually similar to the GRADE ranking system,134 and evidence for these three nephrolithiasis outcomes was graded as moderate.

Mendelian randomisation studies

A total of 107 Mendelian randomisation analyses were identified from 36 publications (see table S5 in web appendix). The median number of participants was 7158 (range 343-206 822) and median number of cases was 2225 (19-65 877). The proportion of variance in SUA level (R2) explained by genetic instruments was 2-6%. More than one Mendelian randomisation study was identified for 14 outcomes (see table S5 in web appendix). Discordance in either the direction and/or the statistical significance of association among overlapping Mendelian randomisation existed for all the identified outcomes: body mass index (n=7),95 96 101 102 110 115 121 bone mineral density in femoral neck (n=2),97 98 coronary heart disease (n=5),96 100 106 118 126 diastolic blood pressure (n=7),96 101 106 110 119 121 124 systolic blood pressure (n=7),96 101 106 110 119 121 124 metabolic syndrome (n=2),107 120 glucose level (n=3),96 106 121 triglyceride level (n=3),96 121 123 diabetes (n=6),96 99 105 100 122 127 serum creatinine level (n=2),110 129 estimated glomerular filtration rate (n=5),106 110 121 128 129 Parkinson’s disease (n=5),111 112 116 117 125 memory performance (n=2),114 and gout (n=3).99 100 106

The 56 unique outcomes (table 4) investigated in individual Mendelian randomisation studies belonged to the following categories: anthropometric variables (n=9), cardiovascular outcomes (n=15), kidney disorders (n=6), metabolic disorders (n=5), neurocognitive disorders (n=5), metabolites (n=11), all cause and cause specific mortality (n=3), and other outcomes (n=2). Only nine (16%) outcomes (diabetic macrovascular disease, arterial stiffness (internal diameter of carotid artery), adverse renal events, Parkinson’s disease, lifetime anxiety disorders, memory performance, cardiovascular disease mortality, sudden cardiac death, and gout) presented significant associations of P<0.05. Three Mendelian randomisation studies (on memory performance, Parkinson’s disease, and gout) reported discordant results in the direction and/or statistical significance in other Mendelian randomisation studies. Of note, only four outcomes (diabetic macrovascular disease, arterial stiffness (internal diameter of carotid artery), renal events, and gout) reported a P<0.01, and only that for gout was based on convincing evidence (P=3.55E-40, n=71 501, power >99%).

Table 4

Health outcomes reported in Mendelian randomisation studies

View this table:

Comparison of findings from meta-analyses

Table 5 summarises the outcomes reported in meta-analyses of observational studies with highly suggestive evidence or meta-analyses of randomised controlled trials with 95% prediction intervals excluding the null. Among these outcomes, hypertension and chronic kidney disease showed concordant evidence between meta-analyses of observational studies and the selected (largest) meta-analyses of randomised controlled trials on their corresponding intermediate traits or surrogate outcomes (eg, systolic blood pressure, diastolic blood pressure, serum creatinine level, estimated glomerular filtration rate, and end stage renal disease) but had discordant evidence from Mendelian randomisation studies. Moreover, even for these outcomes there were additional meta-analyses of randomised controlled trials that had found discordant effects in terms of direction and/or statistical significance for all these intermediate traits or surrogate outcomes, with the exception of serum creatinine level. Heart failure, impaired fasting glucose or diabetes, and coronary heart disease mortality showed no evidence from meta-analyses of randomised controlled trials, and Mendelian randomisation studies reported discordant evidence on the corresponding outcomes, the intermediate traits, or the surrogate outcomes. Recurrence of nephrolithiasis was only reported in meta-analysis of randomised controlled trials, and no evidence was found from meta-analyses of observational studies or Mendelian randomisation studies.

Table 5

Summary of evidence grading and comparison of multiple evidence

View this table:

Discussion

In this study, we provide a comprehensive overview of reported associations between serum uric acid (SUA) levels and a wide range of health outcomes by incorporating evidence from systematic reviews andmeta-analyses of observational studies, meta-analyses of randomised controlled trials, and Mendelian randomisation studies. We also further evaluated the reported evidence by following criteria that we have previously applied to appraise the epidemiological credibility in several research specialties.26 135 136 Our study comprised 76 unique meta-analyses of observational studies, 20 unique meta-analyses of randomised controlled trials, and 56 unique individual Mendelian randomisation studies, which overall covered 136 unique health outcomes.

Main findings and possible explanations

Most health outcomes that were reported to be associated with SUA level were identified from meta-analyses of observational studies, but after the application of our criteria none of them were classified as convincing (class I). Highly suggestive evidence (class II) existed for five health outcomes, including heart failure, hypertension, impaired fasting glucose or diabetes, chronic kidney disease, and coronary heart disease mortality in the general population. Notably, a large proportion (80%) of the examined meta-analyses displayed substantial heterogeneity (I2>50%), indicating that these associations should be interpreted with caution. Possible sources of the observed heterogeneity include the mixture of prospective, retrospective, or case-control studies and the mixture of different comparison groups, since some meta-analyses synthesised individual studies with diverse contrasted categories of SUA levels (eg, various choices of tertiles, quartiles, quintiles, or sextiles of SUA levels). Likewise, although the outcomes with class I or II evidence fulfilled the criteria of credibility assessment for meta-analyses of observational studies, it would be inadvisable to conclude causation on this basis alone, owing to the inherent limitations of unmeasured confounding, undetected bias, or reverse causality in observational studies. In relation to reverse causality for example, some of the associations that were initially classified as class II (eg, all cause mortality in patients with heart failure and non-alcoholic fatty liver disease), were no longer highly suggestive (and were downgraded to class III) when focusing on prospective observational data and excluding the retrospective studies.

Current evidence from meta-analyses of randomised controlled trials was limited to the beneficial effects of SUA lowering treatment on some intermediate traits or biomarkers related to cardiovascular and renal disorders (eg, blood pressure, endothelial functions, and renal function). However, when multiple meta-analyses of randomised controlled trials existed for traits or markers, often the results were not concordant in direction of effect and/or statistical significance. Although 12 health outcomes had P<0.05, only recurrence of nephrolithiasis with citrate treatment achieved P<0.001, with 95% prediction interval excluding the null. Two additional health outcomes (recurrence of nephrolithiasis using thiazides and end stage renal disease in patients with coronary heart disease using allopurinol) also had a 95% prediction interval excluding the null. Large heterogeneity and evidence of bias were common even in meta-analyses of randomised controlled trials (in 45% of meta-analyses and 35% of randomised controlled trials). When incorporating evidence from meta-analyses of randomised controlled trials with that from meta-analyses of observational studies, there was a notable gap, as health outcomes that were investigated in meta-analyses of observational studies and classified as class I or II have generally not been evaluated in meta-analyses of randomised controlled trials. In a few cases, data from randomised controlled trials on surrogate outcomes (eg, systolic blood pressure, diastolic blood pressure, and renal function tests) that corresponded to disease outcomes in observational studies (hypertension, chronic kidney disease) were available, but conclusions from extrapolation of surrogate outcomes, which were evaluated in short term trials, to long term clinical outcomes should be treated with caution.

As an alternative to randomised controlled trials, the Mendelian randomisation design has been developed for exploring the causal effect of biomarkers on health outcomes. Fifty six Mendelian randomisation studies were identified that explored the causal role of SUA in cardiovascular, metabolic, neurocognitive, and renal disorders or related traits and biomarkers. In contrast with the meta-analyses of observational studies where most of the results (76%) were significant at P<0.05, most (84%) health outcomes investigated in Mendelian randomisation studies were not statistically significant. The generally negative results across so many health outcomes suggest that the large effects have probably not been missed, but most of the included Mendelian randomisation studies could have been underpowered to detect modest effects. When retaining the largest Mendelian randomisation study for each health outcome, significant results with P<0.05 were only reported for nine health outcomes, and only four of these health outcomes (diabetic macrovascular disease, arterial stiffness (internal diameter of carotid artery), renal events, and gout) had P<0.01, whereas only the gout outcome was based on evidence from a Mendelian randomisation study with adequate power. Of the other five health outcomes with P<0.05, Parkinson’s disease and memory performance had at least one other Mendelian randomisation study that was not significant or had an association in the opposite direction.

Several instrumental variable assumptions need to be fulfilled for the results of a Mendelian randomisation analysis to be valid. The first assumption states that the genetic instrument should be strongly associated with the intermediate phenotype. SUA level has an evident heritable component with an overall heritability of 40-60%,137 but the strength of genetic instruments used in Mendelian randomisation studies was small or moderate, accounting for only 2-6% of SUA variance. Currently, the proportion of SUA variance explained by all common genetic variants identified by a genome wide association study remains relatively small (7%).138 This limits the power of genetic instruments to detect causal associations with SUA level. The second and third assumptions (the instrument is associated with the outcome through the studied exposure only and the genotype is independent of other factors that affect the outcome) are more difficult to evaluate given the largely unknown complexity and interconnectedness of biological pathways underlying the genetic variants related to SUA level. The included Mendelian randomisation studies tried to validate these assumptions either by excluding single nucleotide polymorphisms related to other known confounding factors, by excluding single nucleotide polymorphisms that had potential pleiotropic effects, or by applying new Mendelian randomisation methods to account for pleiotropic effects (eg, Egger Mendelian randomisation analysis or network Mendelian randomisation).

Clinical implications and future research

Current recommendations on the drug treatment of hyperuricemia are related to gout or nephrolithiasis.8 Since a wide range of health outcomes has been identified to be associated with SUA level, a renewed interest in whether individuals with asymptomatic hyperuricemia should be treated with SUA lowering drugs for the prevention or treatment of associated cardiovascular and metabolic diseases. In this study we raised large uncertainty about the potential therapeutic benefits of an expansion of SUA lowering treatment. Although we identified some highly suggestive associations from observational studies, there was a lack of concordance with clinically relevant endpoints from randomised controlled trials or surrogate endpoints from Mendelian randomisation studies, and therefore evidence is insufficient to support any SUA lowering drug intervention for these outcomes. Furthermore, the adverse effects of SUA lowering drugs should be taken into consideration (eg, an estimated 0.1% of patients treated with allopurinol, the first line SUA lowering drug, develop allopurinol hypersensitivity syndrome, which can be life threatening).9

Our study does not support one of the recommendations in the recently updated European League Against Rheumatism gout treatment guidelines, which suggest that SUA level <3.0 mg/dL is not recommended for gout management in the long term.139 This recommendation is based on several observational studies in which low SUA levels were associated with increased risk of multiple neurological diseases, including Alzheimer’s disease and Parkinson’s disease.140 141 142 However, in our umbrella review a number of meta-analyses reported nominally statistically significant associations of low SUA levels with increased risk of multiple neurological diseases, but several other meta-analyses (9 out of 28) did not support these findings. Moreover, our credibility assessment showed that the nominally significant associations were consistent with class IV evidence, and a causal effect has not consistently been established for any neurological disease in Mendelian randomisation studies. Therefore, there is no adequate evidence against lowering SUA levels in patients with gout because of an increased risk of neurological diseases.

For future research, efforts to address the limitations and caveats in current evidence will be beneficial. In particular, as the current clinical trials of SUA lowering treatment largely focus on the effect of allopurinol on some intermediate traits or biomarkers, the effect of SUA reduction on clinically relevant endpoints of the convincing and highly suggestive associations might be worth further investigation. In addition, efforts to evaluate whether other SUA lowering agents have the same effect as xanthine oxidase inhibitors will help to determine if these effects are truly due to the SUA reduction itself rather than the mechanisms of xanthine oxidase inhibition. Finally, noting the largely discordant evidence in Mendelian randomisation studies, better designed such studies with collaboration of large international consortiums might assist in deciding whether the lack of replication of highly suggestive findings of observational studies is owing to low power to detect moderate or small effects, or owing to truly negative effects.

Strengths and weaknesses of this review

The strengths of umbrella reviews have been described in detail.26 135 136 Here we summarised and presented the evidence of the associations between SUA level and a wide spectrum of health related outcomes systematically and thoroughly by incorporating information from meta-analyses of observational studies, meta-analyses of randomised controlled trials, and Mendelian randomisation studies. We then calculated a number of additional metrics and applied well defined criteria to assess the credibility of the observed associations.

In relation to study weaknesses, umbrella reviews focus on existing meta-analyses and therefore outcomes that were not assessed in a meta-analysis are not included in the review. For example, we found no formal meta-analysis of observational studies on SUA level and urolithiasis or gout, even though these associations are well established. Although there are some differences in SUA levels between men and women, there is not sufficient evidence at a meta-analysis level and therefore we did not attempt to perform subgroup analyses by sex. To avoid subjectivity, we did not include reviews without explicit systematic literature searches, but this could limit the breadth of the results to some extent, if some non-systematic reviews cover questions that have not been addressed by systematic reviews.143 144 Furthermore, we did not appraise the quality of the individual studies, since this should be the responsibility of the authors of the original meta-analysis and it was beyond the scope of the current umbrella review.

We adopted credibility assessment criteria, which were based on established tools for observational evidence, and their individual limitations have been summarised previously.26 135 136 None of the components of these criteria provides firm proof of lack of reliability, but they cumulatively map the possibility that the results are susceptible to bias and uncertainty. Given the wide variety of study designs and populations considered in several of the meta-analyses, one might claim that large heterogeneity in particular may not necessarily be worrisome. However, considering it is difficult to differentiate the real heterogeneity from the heterogeneity that reflects some forms of bias or uncertainty, we applied I2<50% as one of the criteria for class I evidence (convincing) for meta-analyses of observational studies, so as to assign the top evidence grade only to associations that are most robust and without hints of bias. In most cases I2>50% indicates the presence of component studies with opposite effects or of component studies with and without statistically significant associations. However, nine meta-analyses of observational studies classified as class II, III, or IV had an I2>50%, with all component studies reporting a statistically significant association of the same direction. Only one of these nine meta-analyses (heart failure incidence) would be upgraded from class II to class I if we did not consider the heterogeneity criterion, since the other eight also failed additional class I criteria. No meta-analyses of randomised controlled trials had an I2>50% with all component studies reporting a statistically significant association with the same direction.

Finally, another limitation of the umbrella review approach is the use of existing meta-analyses taking their results at face value. Meta-analyses are known to have common flaws145 and their results may also depend on choices made about what estimates to select from each primary study and how to represent them in the meta-analysis (eg, in what contrast of exposure levels). This may be a common problem when the factor of interest is continuous, as in the case of SUA level, and where different comparisons of levels of the risk factor may be selected to express risk.146 We therefore decided to investigate any meta-analyses with seemingly convincing evidence in more detail. In this process, the only meta-analysis that seemed to achieve convincing evidence (class I: stroke mortality) was found to actually have major flaws. Recalculation of the results showed that the evidence was downgraded to not statistically significant. It is possible that similar thorough evaluations might have downgraded the credibility of some additional meta-analyses. In addition, we noted that many primary studies are represented in the calculations of meta-analyses by using only a small subset of the data of extreme groups (eg, as the risk ratio for an event in extreme quintiles of SUA levels). In these cases, the number of events pertinent to these extreme groups may be much fewer than the total number of events used in calculating the amount of evidence criteria. Therefore, some meta-analyses that seemingly include studies with more than 1000 cases may actually capture fewer than 1000 cases in the main calculations and thus their grading appraisal should have been weaker. These flaws and deficiencies are difficult to decipher without a thorough reconstruction of all observational meta-analyses, and they may explain why observational evidence for SUA associations generally did not show good concordance with evidence from randomised controlled trials and Mendelian randomisation studies in our umbrella evaluation.

Meta-analyses of observational data for SUA level and other risk factors need to be strengthened. For continuous putative risk factors such as SUA concentration, a consensus on the categorisation of levels of interest would be useful. This might be achieved by careful meta-analyses of individual level data in inclusive consortiums. This approach would allow a more accurate and reliable exploration of both linear and non-linear associations (eg, the possibility of U-shaped associations with increased risk at both very high and very low levels). Currently available data from meta-analyses do not allow for consistent handling and assessment of such non-linear relations. Conversely, data dredging using different categorisations of SUA levels for comparison is likely to fuel a literature with spurious associations.147

Conclusion

This comprehensive umbrella review will help investigators to judge the relative priority of health outcomes related to SUA level for future research and clinical management of disease. In summary, despite a few hundred systematic reviews, meta-analyses, and Mendelian randomisation studies exploring 136 unique health outcomes, convincing evidence of a clear role of SUA level only exists for gout and nephrolithiasis. Concordant evidence between observational studies and randomised controlled trials existed for hypertension and chronic kidney disease, but a potential causal role of SUA level for these outcomes has not been verified by current Mendelian randomisation studies and even for these two outcomes not all meta-analyses of randomised controlled trials are concordant among themselves and with observational evidence. Therefore, the available evidence does not support any change in the existing clinical recommendations in relation to hyperuricemia.

What is already known on this topic

  • Observational studies suggest that high serum uric acid (SUA) levels are associated with multiple health outcomes, including cardiovascular and metabolic diseases (increased risk) or neurological diseases (decreased risk), yet it remains to be determined whether these observed associations are causal

  • Clinical trials of SUA lowering have shown that xanthine oxidase inhibition decreases blood pressure and improves renal function

  • There is still debate as to whether SUA level is simply a marker of xanthine oxidase activity or a causal factor involved in systemic inflammation

What this study adds

  • Of the 136 health outcomes related to SUA level that were examined in meta-analyses of observational studies, meta-analyses of randomised controlled trials, and Mendelian randomisation studies, convincing evidence of a clear association exists only for gout and nephrolithiasis

  • The available evidence does not support any change in the existing clinical recommendations in relation to hyperuricemia

Footnotes

  • Contributors: ET and HC conceived the study and JPAI contributed to the design. XL and XM performed the systematic review and data extraction. XL performed the statistical analysis. XL and ET wrote the manuscript. HC, JPAI, KKT, MT, and IT critically reviewed the manuscript and contributed important intellectual content. All authors have read and approved the final manuscript as submitted. ET is the guarantor.

  • Funding: XL and XM are supported by the China Scholarship Council. ET is supported by a CRUK Career Development Fellowship.

  • Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.

  • Ethical approval: Not required.

  • Data sharing: No additional data available.

  • Transparency: The manuscript’s guarantor (ET) affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.

This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

References