Article Text

Download PDFPDF

The placebo effect and its determinants in osteoarthritis: meta-analysis of randomised controlled trials
  1. W Zhang1,
  2. J Robertson1,
  3. A C Jones2,
  4. P A Dieppe3,
  5. M Doherty1
  1. 1
    Academic Rheumatology, University of Nottingham, Nottingham, UK
  2. 2
    Rheumatology Unit, Nottingham University Hospitals, Nottingham, UK
  3. 3
    Nuffield Department of Orthopaedic Surgery, University of Oxford, Oxford, UK
  1. Dr W Zhang, Academic Rheumatology, University of Nottingham, Clinical Sciences Building, City Hospital, Nottingham NG5 1PB, UK; weiya.zhang{at}nottingham.ac.uk

Abstract

Objective: To examine the placebo effect and its potential determinants in the treatment of osteoarthritis (OA) via a systematic literature search of Medline, EMBASE, Scientific Citation Index, Cumulative Index to Nursing and Allied Health Literature (CINAHL) and Cochrane Library.

Methods: Randomised placebo controlled trials in OA were included. The placebo effect was defined as the overall change from baseline in the placebo group. It was estimated as the effect size (ES; the standard mean difference between baseline and endpoint) and this was compared with the ES obtained from untreated control. ES for pain was the primary outcome. Statistical pooling was undertaken as appropriate and 95% CIs were used for comparison. Quality of trials was assessed and potential determinants of placebo effect were examined using multiple regression analysis. The partial regression coefficient (β) was used to present the adjusted size of the association.

Results: We identified 198 trials with 193 placebo groups (16 364 patients) and 14 untreated control groups (1167 patients) that met our inclusion criteria. These included a range of therapies (non-pharmacological, pharmacological and surgical treatments). Placebo was effective at relieving pain (ES 0.51, 95% CI 0.46 to 0.55 for the placebo group and 0.03, 95% CI –0.13 to 0.18 for untreated control). Placebo was also effective at improving function and stiffness. The pain-relieving effect increased when the active treatment effect (β = 0.38, p<0.001), baseline pain (0.006, p = 0.014) and sample size (0.001, p = 0.004) increased, and when placebo was given through injections/needles (0.144, p = 0.020).

Conclusion: Placebo is effective in the treatment of OA, especially for pain, stiffness and self-reported function. The size of this effect is influenced by the strength of the active treatment, the baseline disease severity, the route of delivery and the sample size of the study.

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Clinical evidence of placebo effect has been documented in a wide range of conditions including depression,1 pain,2 migraine,3 chronic fatigue syndrome,4 asthma,5 hypertension,6 irritable bowel syndrome7 and Parkinson disease.8 However, whether the placebo effect exists at all is still a topic of debate. This is mainly because the placebo effect in most studies is defined as the change from baseline and it is difficult to distinguish this change from natural disease remission and chance regression to the mean.2 9 10 When compared to untreated controls in a randomised control trial setting, placebo appears to be effective in only a few subjective outcomes such as pain.2 However, this claim is not supported by a reanalysis of the same dataset when heterogeneity across the trials was adequately controlled.11 Placebo effect is robust and approaches the treatment effect when conditions are amenable to placebo, participants are properly blinded,11 or placebo is given as an analgesic.12

Osteoarthritis (OA) is a prevalent condition in people aged over 40.13 14 Pain due to OA often requires long-term treatment. Despite availability of a large number of therapeutic options, including non-pharmacological, pharmacological and surgical therapies,1517 effective treatments for OA are limited since many have only limited symptom-relieving effects.18 It is still unclear whether placebo is effective for OA and which factors may determine the size of such an effect. This is a common discussion point when a randomised controlled trial (RCT) fails to demonstrate superiority of active treatment over placebo.1921 However, apart from speculation22 23 a systematic review of placebo effect in RCTs in OA has yet to be undertaken.

The aims of this study were: (a) to determine whether placebo has clinical effects in the treatment of OA, by comparing outcomes at baseline and endpoint and by comparing placebo with untreated control; and (b) to examine possible determinants of the placebo effect in OA, by quantitatively analysing study variables such as trial quality (eg, randomisation, blinding and withdrawal), types of treatment, source of patients and baseline severity of the disease.

METHODS

Literature search

A systematic literature search was carried out during January and February 2007 using Medline (1950–), Web of Science (1960–), EMBASE (1980–), Cumulative Index to Nursing and Allied Health Literature (CINAHL) (1982–), and Allied and Complementary Medicine (1985–). The Health Management Information Consortium (HMIC) and Cochrane databases (1998–) were also searched.

The search strategies included (a) OA of the knee, hip or hand; and (b) randomised, placebo controlled trials. Any terms with regard to these two strategies were included, such as knee OA or gonarthrosis, hip OA or coxarthrosis; double-blind, single-blind trials. There were no language restrictions for this search.

Citations and abstracts retrieved from this search were downloaded to Reference Manager V. 10 (Thomson Reuters, Philadelphia, Pennsylvania, USA) and duplications were removed. RCTs used to develop OA treatment recommendations for the European League Against Rheumatism (EULAR) and Osteoarthritis Research Society International (OARSI) 1518 were also searched for placebo-controlled trials.

Inclusion and exclusion criteria

Abstracts were read first to select the studies. Paper copies of the selected studies were then collected and examined to ratify study eligibility. Only placebo-controlled trials in OA of the hands, hips and knees were included. Trials including untreated control were also included as a comparator. Trials for other types of arthritis or for OA at other joints such as spine and foot were excluded. Studies of non-clinical outcomes, such as biomarkers, and animal models were excluded.

Data extraction

A customised data extraction form was used to extract data. The following information was collected from each paper: study design (parallel or crossover); sample size (treatment, placebo and untreated control); mean age and SD; gender (female/male); mean body mass index (BMI) and SD; length of study (weeks); pain score at baseline and endpoint; target joint (hip, knee, hand); active treatment modalities (eg, paracetamol, non-steroidal anti-inflammatory drugs (NSAIDs), topicals, etc); study setting (e.g. hospital inpatient, hospital outpatient, doctor’s surgery or community); study sponsors (industry, charity or academic).

Quality assessment and data validation

Trial quality was assessed using the Jadad method. Randomisation, blinding and withdrawal were scored separately and an overall score was calculated.24

Data were fully extracted and assessed by an investigator (JR) and a random sample of 10 were extracted and assessed by a second investigator (ACJ). Discrepancies were discussed and ratified by a third assessor (WZ).

Statistical analysis

The placebo effect was defined as the overall change from baseline in the placebo group. It was a non-specific treatment effect, estimated as the effect size (ES; the standard mean difference between baseline and endpoint) and this was compared with the ES obtained from untreated control using the same method. Unbiased ES and standard error (SE) was calculated using the Hedges method.25 An ES of 1 indicates that the mean at endpoint is 1 SD below the mean at baseline. Clinically, an ES of 0.2 suggests a small effect, 0.5 means a moderate effect and 0.8 and over indicates a large effect.26

ES for pain was the primary outcome for this study, since this is used as the primary outcome in most RCTs in OA. We used the primary pain outcome reported in each study. This was most commonly a composite pain score (usually Western Ontario and McMaster Universities (WOMAC) Osteoarthritis Index pain score), but in some cases was an individual pain outcome (eg, activity pain). If the WOMAC pain was not available, we used the primary pain measure reported. ES for other measures such as function, stiffness, doctor’s global assessment (DGA), walking time/distance, quadriceps strength, knee circumference, range of joint motion and radiographic joint space width were secondary outcomes. The ES in the placebo group was compared with the ES in the untreated control within (direct comparison) and between (indirect comparison) the trials to confirm the marginal effect due to placebo. Statistical pooling of ES was undertaken as appropriate according to different outcomes, as well as type of placebo according to active treatment, target joints (hand, hip or knee), route of delivery (oral, topical, injection or surgery) and study blinding. A random effects model was used to pool ES if they were heterogeneous.27 Comparison between groups was undertaken using 95% CIs. The linear trend among groups was determined using analysis of variance (ANOVA). Furthermore, we plotted ES against the inverse of its SE to produce a funnel plot. The Egger test was used to examine the asymmetry of the funnel plot for publication bias.28

Potential variables were analysed against placebo ES using a multiple linear regression model. These included type of placebo (invasive = 1, non-invasive = 0), mean baseline pain score (0–100%), mean age (years), gender ratio (female/male), mean BMI (kg/m2) and number of patients in the placebo group. In addition, ES of active treatment, intention to treat (yes = 1, no = 0), source of patients (community = 1, hospital = 0), patient blindness (yes = 1, no = 0) and funding body (industry funded = 1, non-industry funded = 0) were included. The partial regression coefficient (β) was used to present the contribution of each variable. Results are reported with 95% CIs. A two-sided p value of ⩽0.05 was considered significant. StatsDirect V. 2.6.1 (StatsDirect, Altringham, UK) was used for meta-analysis and SPSS V. 14 (SPSS, Chicago, Illinois, USA) was used for regression analysis.

RESULTS

Selection and characteristics of studies

In total, 4141 citations were retrieved from the systematic literature search. After removing duplications, 3791 citations remained; from these we identified 642 potentially eligible studies through reading the abstracts. After reading the full papers we subsequently excluded 444 studies (fig 1) and selected 198 trials that met the inclusion criteria for the analysis. These included 184 trials with placebo (6 trials with 2 different placebo controls), 3 trials with placebo and untreated control and 11 trials with untreated control. In total, 193 placebo groups (16 364 patients) and 14 untreated controls (1167 patients) were available for analysis (table 1).

Figure 1 Flow diagram for study selection.
Table 1 Characteristics between placebo and untreated controls

The quality of trials was similar apart from blinding since this was inapplicable for trials with untreated control. Of 193 placebo-controlled trials, placebo was compared with a wide range of active treatments in patients with a mean age of 62 years, gender ratio (female/male) of 2.6, BMI of 29 and baseline pain of 55% (table 2).

Table 2 Characteristics of subjects taking placebo in the randomised placebo controlled trials of osteoarthristis (OA), grouped according to active treatments

Efficacy of placebo

The funnel plot of the ES for pain in the placebo group showed an asymmetric distribution (p = 0.008), suggesting that the trials with smaller placebo effect were more likely to be published (fig 2). The overall estimate of the ES for pain was 0.51 (95% CI 0.46 to 0.55) for all trials (n = 193). The ES was 0.71 (95% CI 0.64 to 0.78) for trials that did not allow rescue medications (n = 15). This effect was significantly superior to the effect observed in all 14 untreated controls (ES 0.03, 95% CI −0.13 to 0.18). The results were supported by the head to head comparison within the three trials that included placebo and untreated control (fig 3). The ES for pain was 0.77 (95% CI 0.65 to 0.89) for the placebo group and −0.08 (95% CI −0.65 to 0.48) for the untreated control (fig 3). Of these three trials, one used intention to treat analysis. The ES for pain was 0.84 (95% CI 0.69 to 0.99) for the placebo group and 0.26 (95% CI 0.10 to 0.46) for the untreated control.

Figure 2 Funnel plot of the placebo effect for pain. SE, standard error.
Figure 3 Effect size between placebo and untreated control. In three-arm trials: direct comparison between placebo and untreated control within the three trials that included placebo and untreated control, In all trials: indirect comparison between all placebo (n = 193) and all untreated control (n = 14) from different trials.

Determinants of the placebo effect

The ES of the placebo group varied between treatments. Apart from placebos to laser and intramuscular (IM) glycosaminoglycan peptide, all had significant ES above zero. Placebos of acupuncture and intra-articular (IA) hyaluronan had effects above the average value of 0.51, whereas placebos of laser, magnets, food supplements (vitamins, milk, fish oil, etc), herbal remedies and bisphosphonates had effects below the average (fig 4). Most of the treatments involved multiple doses. However, of seven trials for IA steroid injection, six were single-dose studies with observational periods ranging from 1 week to 26 weeks,2934 whereas one was a multiple dose study with one injection every 3 months for 26 months.35 The ES was 0.34 (0.11 to 0.56) for the single-dose placebo injection and 0.63 (95% CI 0.15 to 1.12) for the multiple-dose placebo injections.

Figure 4 Placebo effect for pain categorised according to active treatment. IA, intra-articular; IM, intramuscular; NSAID, non-steroidal anti-inflammatory drug; TENS, transcutaneous electrical nerve stimulator.

While 174 trials (14 782 patients) appeared successful in blinding patients from placebo (patients did not know whether they were given placebo or active treatment), 6 trials (194 patients) failed to blind patients (patients knew they were given placebo). Blinded placebo had a greater effect (ES 0.52, 95% CI 0.47 to 0.57) than open placebo (ES 0.30, 95% CI 0.10 to 0.50) though this difference was not statistically significant.

Placebo was more effective in studies of hand OA than in hip and/or knee OA (fig 5). The ES decreased consistently from hand OA studies, to knee OA studies, to combined hip OA and knee OA studies and then to hip OA studies (p = 0.007) (fig 5). Analysis of studies that examined the same treatment (coxibs, cyclo-oxygenase 2 inhibitors (coxibs)) at different joint sites showed a similar trend with ES of 0.96 (95% CI 0.75 to 1.17) for hand OA (1 trial with 196 patients), 0.66 (95% CI 0.56 to 0.76) for knee OA (14 trials with 2456 patients), 0.57 (95% CI 0.28 to 0.86) for combined knee and hip OA populations (9 trials with 963 patients) and 0.36 (95% CI 0.21 to 0.52) for hip OA (2 trials with 336 patients) (p = 0.048).

Figure 5 Placebo effect for pain for different sites of osteoarthritis (OA).

Multiple regression analysis demonstrated that the placebo effect increased significantly with increase in the active treatment effect, baseline pain severity, invasive route of delivery (acupuncture, injection and surgery) and sample size (table 3).

Table 3 Predictors of placebo effect size for pain

Placebo effect for different outcomes

Placebo appeared to be effective for all patient-related subjective outcomes such as pain, stiffness and self-reported function, with moderate ES (0.43 to 0.51) (table 4). A greater ES (0.66) was seen for subjective observer-related doctor’s global assessment. By contrast, placebo was not effective for the more objective outcomes, except for timed specified walking distance, for which placebo showed a small ES (0.22, 95% CI 0.08 to 0.35) that was significantly inferior to placebo ES for pain in the same studies (ES 0.51, 95% CI 0.36 to 0.65). In studies of pain plus structural modification, although placebo significantly reduced pain from baseline to endpoint (ES 0.44, 95% CI 11.0 to 0.46), it did not stop joint space narrowing from baseline to endpoint (ES 0.32, 95% CI 0.17 to 0.46 for joint space width).

Table 4 Placebo effect for different outcomes

DISCUSSION

Although there is a large amount of literature on placebo effects, this is the first study to systematically review the placebo effect in OA. There are multiple treatment options for OA (non-pharmacological, pharmacological and surgical therapies)1518 and a range of outcomes that include subjective (eg, pain) and objective (eg, radiographic joint space width) measures. The majority of OA treatments have been tested formally in randomised placebo controlled trials. This allows an excellent opportunity to explore the placebo effect and its determinants in OA and to compare the magnitude of the placebo effect relative to active or no-treatment comparators. This meta-analysis has yielded three key findings: (a) placebo is effective for OA; (b) the effect is superior to non-treatment and is most effective for subjective outcomes; and (c) the major determinants of the placebo effect in OA are the effect size of the active treatment, the baseline symptom severity, the route of delivery and the sample size.

Since Beecher’s claim of “The powerful placebo”36 there has been considerable debate as to whether the placebo effect exists at all. One key issue is that the definition of placebo is often based on the change consequent upon placebo treatment rather than the marginal difference between placebo and untreated control. Natural remission of the disease and regression to the mean are suggested often as possible alternative explanations of the beneficial effects observed.2 9 10 In the present study, the important comparison between placebo treatment and non-treatment (observation only) in those RCTs that included active, placebo and untreated groups showed that placebo (ES 0.51, 95% CI 0.46 to 0.55) was superior to untreated control (0.03, 95% CI −13.0 to 0.18), thus supporting a true positive effect from placebo. This result was supported by the study by Hrobjartsson et al,37 where the ES for pain relief between placebo and untreated control was 0.25 (95% CI 0.16 to 0.35).37 The slightly greater effect (0.51–0.03 = 0.48) in our study suggests that the placebo effect for pain varies between conditions. Combining data from different conditions to examine the placebo effect for the same outcome (eg, pain) must therefore be undertaken with caution. Furthermore, in 14 non-treatment control groups 7 in fact did receive some minor intervention, such as education and lifestyle advice, and 7 had “usual care” or no intervention (truly untreated); in these 2 groupings the ES was 0.03 (−0.23 to 0.29) and 0.06 (−0.09 to 0.21) respectively. This suggests that the non-treatment controls included in this analysis reflect the situation of no intervention in real life practice and it is less likely underestimated.

The degree of blinding is another challenge to studying the placebo effect. Even when a non-treatment control group is included, it is suggested that any additional effect of placebo over the non-treatment group cannot necessarily be attributed to placebo because of the difference in blinding between treated and only observed groups.9 The placebo effect may be overestimated, especially in a three-arm trial when patients receiving placebo do not know whether they are treated by active treatment or placebo. To test whether blinding affects the placebo effect we compared the blinded placebo (ie, patients did not know whether they were given active treatment or placebo) with the open placebo (ie, patients knew they were taking placebo). The ES was 0.52 (95% CI 0.47 to 0.57) for the blinded placebo and 0.30 (95% CI 0.10 to 0.50) for the open placebo, indicating that blinding may affect the placebo effect. However, further studies directly comparing these two scenarios with formal assessment of the degree of blinding are needed.

Whether placebo is only effective for subjective outcomes remains controversial.5 38 Cross-disease comparison is problematic because of different pathologies and outcomes but in this study we examined subjective and objective outcomes in the same condition. We found placebo to be effective in all subjective outcomes (not just patient-centred (eg pain, stiffness, self-reported function) but also observer-centred (doctor global opinion)), but ineffective for almost all objective outcomes (eg quadriceps strength, knee circumference, range of movement, radiographic narrowing). However, care must be taken when interpreting these results. For example, for joint space narrowing, the studies were placebo controlled trials for glucosamine sulphate (knee OA, 3 years),39 40 chondroitin sulphate (knee OA, 1 or 2 years)41 42 and avocado soybean unsponifiables (hip OA, 2 years).43 The primary outcome of these trials was structural change (joint space narrowing) and secondary outcomes included pain and function. All trials apart from one43 showed significant joint space narrowing during the study period with placebo, but not with glucosamine sulphate or chondroitin sulphate. Unfortunately, there were no observation groups (ie, untreated controls) in these RCTs to know whether narrowing of joint space on placebo was slower than expected.

The effect size of placebo increased in line with the effect size of the active treatment. This supports the theory of “placebo analgesia”; that is, placebo is effective as an analgesic and the magnitude of the effect is determined largely by the expectation of the patient.12 We found that the placebo effect for drugs was greater than that for non-drug therapies, and this became even larger when the placebo for drugs was given by injection (fig 4). Furthermore, the placebo for opioids was superior to the placebo for herbals, and the placebo for new treatments (eg, coxibs) or topical treatments tended to be more effective (fig 4). All these results suggest that the placebo effect is strongly influenced by what the patient is told about the treatment; the greater the expected strength of treatment the greater the placebo effect.

Baseline pain has been considered as a predictor for placebo response. Either low or high baseline pain may reduce this response.44 In our analysis, we found a positive relationship between baseline pain and the placebo effect. In part this may be due to the fact that baseline pain levels in this group of RCTs were moderate, ranging from 35% to 70% on a 0–100-mm visual analogue scale (VAS) (table 2): an ideal therapeutic window for the dose–response effect of minor analgesics and placebo analgesia.

One recent RCT found that sham acupuncture (needle placebo) is superior to an oral tablet placebo in patients with arm pain.45 Our analysis for OA supports this observation in that sham acupuncture produced a greater effect size than the average placebo effect. In addition, we found a similar placebo effect for intra-articular hyaluronan injection (fig 4). Although topical placebos (topical herbals or NSAIDs) had numerically greater ES than oral placebos (oral herbals or NSAIDs) this difference was not statistically significant (fig 4).

It is not surprising that sample size relates positively to the placebo effect. The benefit from a treatment relates to a combination of active effect and patient expectation (placebo) and if there is a large placebo effect a larger study is required to statistically separate active treatment from isolated placebo effect. Conversely, with a smaller placebo effect separation from treatment is possible with a smaller sample size. This is supported by the funnel plot (fig 1), which showed asymmetric distribution for placebo but not for active treatment (data not shown), suggesting that the publication bias may be more dependant on the placebo than the active treatment. The smaller the placebo effect in a trial, the greater the opportunity to publish a positive treatment effect.

A relationship between the magnitude of placebo effect and the target joint was detected in descending order of hand, knee, combined knee and hip and hip only (fig 5). This relationship was confirmed in a subgroup analysis with the same drug treatment (ie, coxibs), but was not confirmed in the meta-regression analysis taking into account other possible covariables (table 3). Therefore, whether the placebo effect varies according to the target joint remains uncertain, although the hierarchy generally mirrors disease “severity”, the prognosis of OA and the ability to obtain successful treatment benefits. Further study of this possible differential response to treatment and placebo is warranted.

There are several limitations to this analysis. Firstly, the placebo effect was largely determined as the difference between baseline and endpoint, rather than the difference in benefit between placebo and non-treatment (ie observation only) groups. However, although only three trials had placebo and non-treatment groups these did confirm the effect of placebo but not of observation only, thus supporting the placebo effect and justifying the subsequent analyses of placebo based on improvement from baseline. Secondly, like many other meta-analyses, we used study-level variables for the regression analysis so the sensitivity of the analysis may be lower than it should be. Consequently we may have missed some significant determinants. Thirdly, some categorisations such as degree of blinding and concealment may not have been undertaken accurately because of limited information provided in published reports. Clearly, we could only take data at face value as reported by the authors, even though this may not always have reflected the true circumstances of the study. Finally, heterogeneity occurred in most of the groups. Although we explored the reasons for this before we pooled data, most analyses still used a random effects model and the reasons for heterogeneity remain unknown.

In conclusion, this study confirms that placebo is effective for OA, especially for subjective outcomes such as pain, stiffness, self-reported function and doctor’s global assessment. Important determinants of the magnitude of effect appear to be the baseline severity, the expected strength of the treatment, the route of delivery and the sample size.

Acknowledgments

We would like to thank IDEA AG Munich for an unrestricted grant to undertake this work; the Arthritis Research Campaign UK for infrastructure support (ICAC grant 17696); and the European League Against Rheumatism (EULAR) and Osteoarthritis Research Society International (OARSI) for financial support to undertake literature searches used in this study.

REFERENCES

Footnotes

  • Competing interests: None declared.

  • Funding: This work was funded by an unrestricted grant from IDEA AG Munich, the Arthritis Research Campaign UK funded infrastructure support (ICAC grant 17696) and the European League Against Rheumatism (EULAR) and Osteoarthritis Research Society International (OARSI) provided financial support to undertake the literature searches.

  • The full reference set of 198 trials used in this study can be provided upon request to the authors.

  • See Editorial, p 1653

Linked Articles