Clinical effectiveness of collaborative care for depression in UK primary care (CADET): cluster randomised controlled trialBMJ 2013; 347 doi: https://doi.org/10.1136/bmj.f4913 (Published 19 August 2013) Cite this as: BMJ 2013;347:f4913
- David A Richards, professor1,
- Jacqueline J Hill, PhD student2,
- Linda Gask, professor3,
- Karina Lovell, professor4,
- Carolyn Chew-Graham, professor5,
- Peter Bower, professor6,
- John Cape, head of psychology7,
- Stephen Pilling, professor7,
- Ricardo Araya, professor8,
- David Kessler, consultant senior lecturer8,
- J Martin Bland, professor9,
- Colin Green, professor10,
- Simon Gilbody, professor11,
- Glyn Lewis, professor12,
- Chris Manning, public and patient advocate13,
- Adwoa Hughes-Morley, research fellow3,
- Michael Barkham, professor14
- 1Institute of Health Research, University of Exeter Medical School, Exeter EX1 2LU, UK
- 2School of Psychology, University of Exeter, Exeter, UK
- 3Centre for Primary Care, Institute of Population Health, Manchester Academic Health Science Centre, Williamson building, University of Manchester, Manchester, UK
- 4University of Manchester, School of Nursing, Midwifery & Social Work, Jean McFarlane Building, Manchester, UK
- 5Arthritis Research UK Primary Care Centre, Primary Care Sciences, Keele University, Keele, UK
- 6NIHR School for Primary Care Research, Centre for Primary Care, Institute of Population Health, Manchester Academic Health Science Centre, University of Manchester, UK
- 7Research Department of Clinical, Educational and Health Psychology, University College London, London, UK
- 8School of Social and Community Medicine, University of Bristol, Bristol, UK
- 9Department of Health Sciences, University of York, York, UK
- 10Institute of Health Research, University of Exeter Medical School, University of Exeter, UK
- 11Mental Health Research Group, Department of Health Sciences and Hull York Medical School, University of York, UK
- 12Mental Health Sciences Unit, University College London, UK
- 13Upstream Healthcare, Teddington, UK
- 14Centre for Psychological Services Research, Department of Psychology, University of Sheffield, Sheffield, UK
- Correspondence to: D A Richards
- Accepted 26 July 2013
Objective To compare the clinical effectiveness of collaborative care with usual care in the management of patients with moderate to severe depression.
Design Cluster randomised controlled trial.
Setting 51 primary care practices in three primary care districts in the United Kingdom.
Participants 581 adults aged 18 years and older who met ICD-10 (international classification of diseases, 10th revision) criteria for a depressive episode on the revised Clinical Interview Schedule. We excluded acutely suicidal patients and those with psychosis, or with type I or type II bipolar disorder; patients whose low mood was associated with bereavement or whose primary presenting problem was alcohol or drug abuse; and patients receiving psychological treatment for their depression by specialist mental health services. We identified potentially eligible participants by searching computerised case records in general practices for patients with depression.
Interventions Collaborative care, including depression education, drug management, behavioural activation, relapse prevention, and primary care liaison, was delivered by care managers. Collaborative care involved six to 12 contacts with participants over 14 weeks, supervised by mental health specialists. Usual care was family doctors’ standard clinical practice.
Main outcome measures Depression symptoms (patient health questionnaire 9; PHQ-9), anxiety (generalised anxiety disorder 7; GAD-7), and quality of life (short form 36 questionnaire; SF-36) at four and 12 months; satisfaction with service quality (client satisfaction questionnaire; CSQ-8) at four months.
Results 276 participants were allocated to collaborative care and 305 allocated to usual care. At four months, mean depression score was 11.1 (standard deviation 7.3) for the collaborative care group and 12.7 (6.8) for the usual care group. After adjustment for baseline depression, mean depression score was 1.33 PHQ-9 points lower (95% confidence interval 0.35 to 2.31, P=0.009) in participants receiving collaborative care than in those receiving usual care at four months, and 1.36 points lower (0.07 to 2.64, P=0.04) at 12 months. Quality of mental health but not physical health was significantly better for collaborative care than for usual care at four months, but not 12 months. Anxiety did not differ between groups. Participants receiving collaborative care were significantly more satisfied with treatment than those receiving usual care. The number needed to treat for one patient to drop below the accepted diagnostic threshold for depression on the PHQ-9 was 8.4 immediately after treatment, and 6.5 at 12 months.
Conclusions Collaborative care has persistent positive effects up to 12 months after initiation of the intervention and is preferred by patients over usual care.
Trial registration number ISRCTN32829227.
Depression is a long term and relapsing condition, and is set to become the second largest cause of global disability by 2020.1 The responsibility for treatment in 90-95% of cases rests with primary care,2 but the organisation of care in this setting is not optimal for managing depression, with barriers between generalist and specialist professionals in mental health, poor patient adherence to pharmacological treatment,3 and limited specialist support for patients.4 Evidence is developing on the role of organisational interventions in improving the management of a range of chronic conditions. Their application to the management of depression includes “collaborative care,” a complex intervention developed in the United States incorporating a multiprofessional approach to patient care; a structured management plan; scheduled patient follow-ups; and enhanced interprofessional communication.5 In practice, this approach is achieved by the introduction of a care manager into primary care, responsible for delivering care to patients with depression under the supervision of a specialist, and for liaising between primary care doctors and mental health specialists.
Systematic reviews have shown that collaborative care improves depression outcomes, with some studies showing benefit for up to five years.6 7 Previously, our 2006 systematic review of 28 collaborative care studies showed it to be effective (standardised mean difference −0.24, 95% confidence interval −0.17 to −0.32).7
However, most studies have been conducted in the US. In other areas of mental healthcare, organisational interventions developed in the US have not generalised outside the original healthcare context.8 For collaborative care, there is some supportive evidence from other contexts, including the developing world,9 10 but uncertainty around the standardised effect size in trials in the United Kingdom (standardised mean difference 0.24, 95% confidence interval −0.060 to 0.547) and elsewhere.7 Owing to these limited non-US data and the relatively small effect size in trials of patients with depression alone, the UK National Institute for Health and Care Excellence (formerly the National Institute for Health and Clinical Excellence)11 issued a research recommendation for a fully powered UK evaluation of collaborative care.
There is considerable variation between study heterogeneity in terms of the duration and intensity of collaborative care, and in the training and background of care managers used in the reported studies. Therefore, we carefully developed our collaborative care intervention to apply outside the US, in healthcare systems with a well developed primary care sector.12 13 14 In our development work,12 we designed a care management intervention after systematic review,7 15 in-depth qualitative interviews with patients, general practitioners, and mental health workers, and through consultations with the intervention originators in the US. In our phase II testing of this intervention,13 we found preliminary evidence indicating that collaborative care adapted to the UK was acceptable to patients and doctors, and could be effective outside the US, but that a cluster randomised controlled trial was needed to guard against potential contamination between trial arms.13 Consequently, we undertook a pragmatic cluster randomised trial to determine whether collaborative care is more clinically effective than usual care in the management of patients with moderate to severe depression.
The Clinical and Cost Effectiveness of Collaborative Care for Depression in UK Primary Care Trial (CADET) was a multicentre, two group, cluster randomised controlled trial.
Setting and participants
We recruited participants between June 2009 and January 2011 from the electronic case records of primary care general practices in three UK sites: Bristol, London, and greater Manchester. Eligible participants were adults aged 18 years and older who met ICD-10 (international classification of diseases, 10th revision) criteria for a depressive episode when interviewed by research personnel using the revised Clinical Interview Schedule.16 We excluded acutely suicidal patients; those with psychosis, type I or type II bipolar disorder; those whose low mood was associated with bereavement or whose primary presenting problem was alcohol or drug abuse; and those receiving psychological treatment for their depression by specialist mental health services.
Randomisation, concealment of allocation, and blinding
We randomly allocated primary care practices as they were recruited into the trial, minimised within sites by Index of Multiple Deprivation rank,17 number of general practitioners, and practice size. The allocation sequence was concealed from researchers recruiting practices and administered centrally using Minim.18 The Peninsula Clinical Trials Unit remotely managed participant identification and data collection. Research workers blind to allocation, assessed for eligibility and collected outcome measures using patients’ self report questionnaires to minimise the effect of potential unblinding. Owing to the nature of the intervention, it was not possible to blind participants, care managers, or general practitioners to allocations.
We searched computerised case records from general practices for patients with at least one identification code in their electronic records. Several of such codes are widely used by general practitioners to classify patients as depressed. Practices contacted identified patients by letter or telephone to seek permission for researchers to contact them. Research staff interviewed potential participants that responded, to take consent and confirm eligibility via the revised Clinical Interview Schedule.
Intervention and comparator groups
Intervention: collaborative care
Collaborative care, developed in our previous studies, was delivered by a team of care managers, supervised by mental health specialists. In addition to usual care from their general practitioners, care managers were to have six to 12 contacts with participants over 14 weeks: 30-40 minutes for an initial appointment face to face, followed by telephone contacts of 15-20 minutes thereafter.
Collaborative care consisted of antidepressant drug management, behavioural activation,19 symptom assessment, and communication between primary care physicians and the care managers. Care managers advised participants on their drug adherence and alerted primary care physicians to participant adherence or tolerance problems so that dose or agent could be amended. Behavioural activation19 is an effective form of brief cognitive behavioural therapy, which aims to disrupt depressive avoidance cycles and increase participants’ activity to provide more opportunity for exposure to positive mood reinforcing situations. Care managers assessed symptoms at each contact using the Hospital Anxiety and Depression Scale20 and discussed these with participants. Care managers also provided participants with relapse prevention advice.21 Finally, care managers provided general practitioners with regular updates and participant management advice at least monthly and more often if clinically indicated.
We recruited existing mental health workers in primary care with minimal or paraprofessional education as care managers, treating CADET participants alongside those patients being seen as part of their usual NHS role. We provided care managers with an additional five days’ training in collaborative care and weekly supervision by specialist professionals in mental health, including clinical psychologists, psychiatrists, academic general practitioners with special interest in mental health, or a senior nurse psychotherapist. Individual participants were discussed in supervision at least monthly, facilitated through a bespoke computerised system for patient management (www.pc-mis.co.uk), which automatically alerted supervisors and care managers of the need to discuss all participants monthly, and alerted supervisors to participants not responding to treatment.
Participants received care from their general practitioner according to usual clinical practice for these patients, including treatment by antidepressants and referral for other treatments. We recorded every aspect of usual care but did not specify a treatment programme in line with the pragmatic nature of this trial.
Our primary outcome was individual participant depression severity measured by the patient health questionnaire 9 (PHQ-9)22 at four months. Secondary outcomes were the PHQ-9 at 12 months; quality of life (short form 36 questionnaire; SF-36) at baseline, four months, and 12 months23; worry and anxiety (generalised anxiety disorder; GAD-7)24 at four and 12 months; and patient satisfaction (client satisfaction questionnaire 8; CSQ-8)25 at four months.
We powered the trial at 90% (α=0.05) to detect an effect size of 0.4, which we regarded as reasonable for determining clinically meaningful differences between interventions.26 This figure was within the 95% confidence intervals of the effect predicted from data collected during our pilot work (effect size 0.63; 95% confidence interval 0.18 to 1.07).13 However, the figure was greater than the findings from a meta-analysis of existing trials available at the time we initiated CADET (0.25; 0.18 to 0.32).7 We would have required 132 participants per group in a two armed, patient randomised trial. For our cluster trial, with 12 patients per primary care cluster and an intracluster correlation of 0.06 from our pilot trial,13 the design effect was 1.65, leading to a sample size of 440. To follow up 440 participants, we aimed to randomise 550 participants (anticipating 20% attrition). Because recruitment would not be uniform between practices, we aimed to recruit 48 practices with up to 14 participants per practice.
We undertook intention to treat analyses for all outcomes, reported in accordance with CONSORT guidelines.27 All analyses were undertaken in Stata 10.1, after a predefined analysis plan agreed with the trial steering committee. We analysed available data at four and 12 months by ordinary least squares or logistic regression. This approach allowed for clustering by use of robust standard errors, adjusted at the cluster level for minimisation variables and site; at the individual level for age; and, where appropriate, the baseline measurement of the variable. We analysed the effect of missing primary and secondary outcome data as a sensitivity analysis, estimated by multiple imputation by chained regression equations28 using all available scale clinical scores, age, sex, practice variables, site, and treatment group. To ease interpretation and allow comparison with published studies, we estimated standard effect sizes using the baseline standard deviation for all participants and calculated rates of “recovery” (proportions of participants with PHQ-9 scores ≤9) and “response” (50% reduction in scores from baseline). We calculated numbers needed to treat from the inverse of the absolute risk reduction adjusted for clustering by practice.
Participant flow and retention
We allocated 53 practices, two of which dropped out after allocation (fig⇓). These practices were removed from the minimisation schedule and their data did not influence later allocations. During recruitment, we found that the cut-off adopted for the Index of Multiple Deprivation had been set far too high—with all practices so far recruited being below it. We changed this cut-off to one close to the median of practices so far recruited, retaining allocations so far. One practice was found to have been mistakenly recorded in the wrong geographical area; it was moved to the correct group, retaining its allocation. Table 1⇓ shows the final balance achieved. Of the remaining 51 practices, two did not recruit any participants. The mean number of participants recruited for the remaining 49 practice clusters was 11.9 (standard deviation 3.9, range 4-20). We recruited 581 participants in total and followed up 505 (87%) and 498 (86%) at four and 12 months, respectively.
Baseline characteristics of participants
More than half (56%) of participants fulfilled ICD-10 criteria for a moderately severe depressive episode, with a further 30% meeting criteria for severe depression, 14% mild depression, and 73% having had depression in the past (table 1). Fewer than half (44%) of participants were in full or part time paid employment, the mean age was 44.8 years (standard deviation 13.3), and 72% were women. Almost all (98%) participants had a secondary diagnosis of an anxiety disorder, the most common being generalised anxiety disorder. Almost two thirds of participants (64%) reported a longstanding physical illness (for example, diabetes, asthma, heart disease). At baseline, 83% of participants had been prescribed antidepressant drugs by their primary care doctor.
Delivery and receipt of the intervention
Ten care managers provided collaborative care for a mean of 27.6 participants each (standard deviation 16.42, range 4-46). Patients received a mean number of 5.6 sessions (4.01, 0-15). Forty two (15.2%) participants did not attend any sessions with their care manager, 213 (77.2%) had two or more contacts, and 171 (62.2%) had four or more contacts. The mean total time in collaborative care was 3.03 hours (standard deviation 2.18) over a period of 12 weeks (7.75). For those participants who attended at least one session, the mean duration of sessions was 34.5 minutes (8.2). Most participants in both collaborative care and usual care groups remained on antidepressant prescriptions (74.8% v 73.8% at four months; 69.7% v 69.2% at 12 months).
The mean depression score at four months was 1.33 PHQ-9 points lower (95% confidence interval 0.35 to 2.31, P=0.009) in participants receiving collaborative care than those receiving usual care (table 2⇓) after adjustment for baseline depression. This difference equated to a standardised effect size of 0.26 (0.07 to 0.46). More participants receiving collaborative care than those receiving usual care met criteria for recovery (odds ratio 1.67 (95% confidence interval 1.22 to 2.29); number needed to treat=8.4) and response (1.77 (1.22 to 2.58); 7.8; table 3⇓).
At 12 month follow-up, mean PHQ-9 score was 1.36 points lower (95% confidence interval 0.07 to 2.64, P=0.04) in participants receiving collaborative care than in those receiving usual care (standardised effect size 0.28 (95% confidence interval 0.01 to 0.52)). More participants in collaborative care than those in usual care met criteria for recovery (odds ratio 1.88 (95% confidence interval 1.28 to 2.75); number needed to treat=6.5) and response (1.73 (1.22 to 2.44); 7.3; tables 2 and 3).
Collaborative care produced better outcomes than usual care on the mental component scale of the SF-36 at four but not 12 months, had little effect on anxiety and the physical component scale of the SF-36, and participants receiving collaborative care were more satisfied with their treatment than those in usual care (table 2).
Multiple imputation data using least squares regression and 100 multiple datasets for the primary outcome produced an imputed estimate that was similar to the available data (PHQ-9 coefficient −1.31 (95% confidence interval −2.37 to −0.26), P=0.02). We also found very little difference between the results of our analyses of available data and imputed data on any secondary outcomes at four and 12 month follow-up. This similarity showed that all analyses were not substantively affected by missing data or differential rates of follow-up between trial arms.
We found that collaborative care improves depression immediately after treatment compared to usual care, which has effects that persist to 12 month follow-up and is preferred by patients over usual care. Our observed effect size (0.26) was less than that used to power the study, although the 95% confidence intervals around it (0.07 to 0.46) encompassed our original target effect size (0.4). Our result was also within the 95% confidence interval of the standardised mean difference found in the 2012 Cochrane meta-analysis of 79 randomised controlled trials (overall standardised mean difference 0.29, 95% confidence interval 0.23 to 0.36).6 This analysis included our results, and was no different from trials in the US (0.28, 0.21 to 0.35), non-US regions excluding the UK (0.36, 0.13 to 0.59), and the UK (0.32, 0.07 to 0.57). Collaborative care is as effective in the UK healthcare system—an example of an integrated health system with a well developed primary care sector—as in the US. Our study adds to the emerging international literature from countries such as Chile9 and India10 indicating that collaborative care is a model that reliably generalises outside the US.
Strengths and limitations of the study
To our knowledge, CADET is the one of the largest studies of collaborative care. Less than 50% of published collaborative care trials have followed up participants for 12 or more months, and our levels of attrition at four and 12 months are comparable with 70% of collaborative care trials and better than other trials of brief interventions in this area.29 There was no evidence that missing follow-up data biased findings. Although our cluster design protected against contamination of the usual care arm by changes in behaviour being tested in the collaborative care arm, cluster trials are prone to selection bias. We minimised this bias by recruiting participants through electronic case note searches rather than doctor referral.
Owing to the nature of the intervention and comparator, we could not blind general practitioners, patients, or care managers to treatment allocation. However, we used self reported outcome measures to minimise the effect of detection bias. We relied on self reported records of care manager contacts, and thus have no means to assess record accuracy. Care managers were already employed by organisations providing primary care services for mental health in the UK’s health service. However, supervisors were senior members of the investigator group, so it is unclear how much their—albeit minimal—supervision can be generalised beyond the trial.
Our intervention was brief, so a more intensive intervention might have improved outcomes further, particularly for the more complex cases. We could have chosen a different psychological intervention such as cognitive behavioural therapy,30 but reviews19 and controlled trials31 have shown behavioural activation to be as effective as cognitive behavioural therapy—potentially more so for severe cases32—and can be delivered effectively by junior healthcare personnel.31 We are currently conducting a process evaluation including analysis of any dose response, to determine the effect on outcomes of intervention content, process mediators, and participant characteristics.
Implications for practice and directions for future research
During the time we undertook CADET, the number of international trials of collaborative care more than doubled, albeit many of them still conducted in the US. While the portability of a US collaborative care model to the UK had been suggested by previous small scale studies, CADET has provided definitive confirmation of that portability. The CADET trial findings answered a specific need highlighted in the NICE guidelines for depression and provided critical evidence for further service delivery.
Although our results sit within the expected effect range of collaborative care reported in the latest meta-analysis of international collaborative care trials,6 the clinical implications of our results are more difficult to interpret. The average difference in treatment response was less than what we had expected (effect size 0.26 v 0.4), and these more modest differences were sustained over the longer term. Between group differences can obscure response rates in individual patients. We have, therefore, presented the data on meaningful clinical differences (table 3) using numbers needed to treat and two criteria commonly applied in the depression literature and regarded as clinically meaningful. These criteria were recovery (falling below a recognised point on the PHQ-9 symptom scale); and response (a 50% reduction in symptoms of depression).
Using these metrics, it is particularly noteworthy that at 12 months, 56% of participants receiving collaborative care “recovered”—15% more than in usual care. Health services would, therefore, need to treat 6.5 patients using collaborative care to produce one additional patient with a sustained recovery compared with usual care. Studies achieving higher effects have been undertaken in countries with less developed services in primary care than in the UK,9 10 or have used more highly qualified workers such as nurses or social workers.33 Such workers are in acute short supply in the UK and hence this model would not have been translatable for its health system. A full economic evaluation of CADET is forthcoming, since the relative magnitude of clinical effects can only be properly understood in the context of a proper understanding of cost data relative to effectiveness. The persistence of our treatment effect at 12 months, however, is noteworthy and unusual in primary care depression trials.29 We are now conducting a three year follow-up of our participants to assess further long term effects, given that only two trials of collaborative care have reported outcomes beyond 24 months.6
Our results represent a slightly higher recovery rate than that reported by the UK Improving Access to Psychological Therapies (IAPT) programme, which has been described in a Nature editorial as “a world-beating standard.”34 Recovery rates of about 45% have been achieved in IAPT, after an investment of £700m (€812m; $1085m) over six years.35 We suggest that integration of our CADET protocol into IAPT services might enhance outcomes for patients receiving treatment for depression and provide guidance to international mental health services that this model can be applicable outside the US.
Although collaborative care is an organisational intervention that improves outcomes, much remains to be done to improve the effectiveness of treatments for depression. Even intensive psychological treatments for depression have been shown to achieve only modest gains (effect size of 0.42 in 51 studies).36 Our careful selection of intervention ingredients, directed by our identification of components present in the better performing trials from our previous meta-regression,15 did not succeed in achieving the larger effects we had hoped for. In CADET, 44% of participants receiving collaborative care had scores that remained above the PHQ-9 depression threshold at 12 month follow-up. Future trials should test enhancements of the basic collaborative care model by developing, testing, and delivering better treatments within the effective collaborative care organisational framework, rather than test collaborative care itself, given that the effects of collaborative care are now firmly established.
What is already known on this topic
Although systematic reviews have shown that collaborative care improves depression outcomes, most studies have been conducted in the US
In other areas of mental healthcare, the positive effects of organisational interventions developed in the US have not generalised outside the original healthcare context
Despite some preliminary evidence in non-US regions, there is uncertainty in meta-analyses around the true effect of collaborative care outside the US
What this study adds
Collaborative care improves depression immediately after treatment compared with usual care, which has effects persisting up to 12 month follow-up and is preferred by patients over usual care
The portability of a model of collaborative care in the US had been suggested by small scale studies; the CADET trial has provided a definitive confirmation of that portability
Although collaborative care is an organisational intervention that improves outcomes, better treatments are still needed to increase recovery rates in depression above the current 50-55%
Cite this as: BMJ 2013;347:f4913
Contributors: DAR, LG, KL, CC-G, PB, JC, SP, RA, DK, JMB, CG, SG, GL, CM, and MB designed the study and were responsible for its conduct. JJH and AH-M were responsible for study management and data collection; JMB, CG, DAR, and JJH undertook data analysis. All authors had full access to all of the data (including statistical reports and tables) in the study and can take responsibility for the integrity of the data and the accuracy of the data analysis. All authors contributed to the writing and editing of the manuscript. DAR is guarantor.
Funding: This report is independent research funded by the UK Medical Research Council (MRC; reference G0701013), managed by the National Institute for Health Research (NIHR) on behalf of the MRC-NIHR partnership.
Competing interests: all authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: all authors had financial support from the NIHR for the submitted work; DAR receives funding support from NIHR Collaborations for Leadership in Applied Health Research and Care; no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Ethical approval for the study was given by the NHS Health Research Authority, NRES Committee South West (NRES/07/H1208/60). All participants gave informed consent before taking part in the study.
Data sharing: patient level data is available from the corresponding author. Consent for data sharing was not obtained but the presented data are anonymised and risk of identification is low.
The lead author affirms that this manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 3.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/3.0/.