- Diana Rose, senior researcher (, )
- Pete Fleischmann, researcher,
- Til Wykes, professor,
- Morven Leese, statistician,
- Jonathan Bindman, senior lecturer
- Service User Research Enterprise, PO34, Institute of Psychiatry, De Crespigny Park, London SE5 8AF
- Department of Psychology, Institute of Psychiatry
- Health Services Research Department, Institute of Psychiatry
- Correspondence to: D Rose
- Accepted 15 May 2003
Objective To ascertain patients' views on the benefits of and possible memory loss from electroconvulsive therapy.
Design Descriptive systematic review.
Data sources Psychinfo, Medline, Web of Science, and Social Science Citation Index databases, and bibliographies.
Study selection Articles with patients' views after treatment with electroconvulsive therapy.
Data extraction 26 studies carried out by clinicians and nine reports of work undertaken by patients or with the collaboration of patients were identified; 16 studies investigated the perceived benefit of electroconvulsive therapy and seven met criteria for investigating memory loss.
Data synthesis The studies showed heterogeneity. The methods used were associated with levels of perceived benefit. At least one third of patients reported persistent memory loss.
Conclusions The current statement for patients from the Royal College of Psychiatrists that over 80% of patients are satisfied with electroconvulsive therapy and that memory loss is not clinically important is unfounded.
Electroconvulsive therapy is generally indicated for depression that is resistant to treatment. The procedure, which involves the application of electrodes to the head to induce a convulsion, is carried out under general anaesthetic. Although electroconvulsive therapy is less commonly used today than in the past, over 11 000 patients receive it in England annually.1 Nearly one fifth of patients receive treatment under a special section of the Mental Health Act 1983.
The Royal College of Psychiatrists' fact sheet states that more than eight out of 10 depressed patients who receive electroconvulsive therapy respond well.2 “Electroconvulsive therapy is the most effective treatment for severe depression and people… report that it makes them feel ‘like themselves again’ or that ‘life is worth living.’”2 Although reviews on attitudes to electroconvulsive therapy in the 1980s concluded that patients found treatment beneficial and that they were satisfied with it, this is currently opposed by individual patients and groups.3 4 We aimed to examine the sources of this controversy and to assess the debated distinctions between efficacy, effectiveness, and satisfaction.5 Efficacy is restricted to what can be measured in a controlled clinical trial, often over a short period. It will not necessarily predict the effectiveness of a treatment in a real life situation, still less will it predict satisfaction. For instance, a systematic review of randomised controlled trials investigated evidence of the efficacy of electroconvulsive therapy as measured by symptom scales completed by a mental health professional.6 But these ratings may not be the same as perceptions of relief of symptoms by patients themselves. For example, in one study similar numbers of patients were regarded as improved by themselves and by health professionals, but in 20% (n=13) of cases these were different individuals.7
Patients' perceptions of benefit are likely to be based on broader considerations than just the relief of symptoms. They may take into account the amount and length of time symptoms are relieved (clinical benefit) as well as any side effects. One side effect is memory loss. The Royal College of Psychiatrists' fact sheet states that while memory of recent events may be affected by electroconvulsive therapy, “in most cases this memory loss goes away within a few days or weeks although some patients continue to experience memory problems for several months. As far as we know, electroconvulsive therapy does not have any long term effects on your memory or intelligence.”2 Some patients, however, report severe and longlasting memory losses after electroconvulsive therapy, and these will influence decisions on the risks and benefits of treatment.
Despite these disagreements there has been little systematic study of patients' views about the effectiveness and safety of electroconvulsive therapy. We aimed to ascertain patients' attitudes on the perceived benefit of treatment, as distinct from clinically rated outcome, and reported memory loss after treatment.
We searched the databases Psychinfo, Medline, Web of Science, and the Social Science Citation Index for papers and reports of patients' views on treatment with electroconvulsive therapy (see bmj.com for search terms). Bibliographies were also hand searched. Articles were excluded that concerned lay or professional opinion, children or adolescents, or where not all the patients had received treatment.
Of the 27 papers identified, 26 were authored by academics or researchers and conducted in psychiatric facilities. A reference group enabled us to identify nine reports written either by patients or in collaboration with them. The work of Communicate, the user group at the Maudsley hospital, is awaiting publication, but we had access to its raw data. Although our searches included global sources, articles written by patients were confined to the United Kingdom in all but one case.
We calculated the proportion of patients with positive responses to questions on effectiveness of treatment and the 95% confidence intervals. Positive responses were defined as an affirmative response to the statements “electroconvulsive therapy is helpful” or “I would have electroconvulsive therapy again.” A Forrest plot was produced on the raw (proportion) scale as to whether electroconvulsive therapy was considered helpful, with normal approximation standard errors.
The research studies were rated on four methodological variables. These were selected from either previous research (setting and interviewer), preliminary analysis of the data (interval between treatment and interview), or the social science literature.8
Interval between treatment and interview
We considered the interval between treatment and interview because the benefits of treatment may be short lived and side effects only apparent later. The scores were: 0 for during course of treatment or maintenance treatment; 1 for within four weeks or predischarge; 2 for 1–6 months; and 3 for more than six months.
Number of questions
As a few brief questions are likely to produce less engagement than a more exploratory list of questions, we scored: 1 for five or less questions; 2 for 6–14 questions; and 3 for 15 or more questions.
Complexity of interview
With simple response options there was less scope for patients to express their opinions whereas multiple choice questions or semistructured interviews allowed more complex opinions to be recorded. The scoring system was: 1 for dichotomous responses; 2 for simple Likert scales; 3 for complex Likert scales or multiple choice; and 4 for a semistructured interview.
Setting of interview and status of interviewer
Conducting an interview has been shown to influence the willingness of patients to be critical about services.9 They are more likely to be critical when interviewed by a fellow patient in a neutral setting. Because the setting and status are always highly correlated, we amalgamated them into one category. The scoring system was: 1 for inpatients; 2 for same hospital or treating doctor; 3 for non-treating doctor or at home; 4 for day care or voluntary sector; and 5 for source independent of health services, and choice of setting.
Logit models were fitted to assess associations between positive responses and methodological characteristics and the distinction between clinical and patient studies. SPSS version 10 and Stata version 7 were used for the analyses.
In 16 studies patients were asked if they found electroconvulsive therapy helpful and in 12 studies they were asked if they would have the treatment again (table 1). The level of positive responses varied widely between studies (tests for heterogeneity: χ2=370, P < 0.001, for treatment helpful, χ2=256, P < 0.001 for would have treatment again). The Forrest plot for “helpful” shows that the patient led and collaborative studies report the lowest levels of positive responses; there was, however, an overlap in the confidence intervals (figure and table 1).
A funnel plot showed no evidence of publication bias among the clinical studies. No systematic relation was found between perceived benefit and the country, or region of the United Kingdom, where the research was undertaken.
The number of questions, complexity of the interviews, and the interval before interview were intercorrelated (between number of questions and both the other two variables r=0.54, between interval and complexity r=0.75). The clinical studies tended to use fewer questions, less complex schedules, and a shorter interval, although the difference in complexity was not significant (see table 1).
Studies where the interviews were conducted soon after treatment, in hospital settings, by the treating doctor, were more likely to report positive views of electroconvulsive therapy (table 2). Studies with low complexity schedules, few questions, and a short interval were also associated with high perceived benefit. In the case of treatment considered helpful there was a clear hierarchy in setting, as coded from studies of inpatients (coded 1) to studies based in the community (coded 5).
When the analyses were repeated for the clinical studies alone, the effects were in the same direction and of a similar magnitude. Because of reduced sample sizes, fewer associations were significant. Within clinical studies, the number of questions remained significantly associated with treatment considered helpful, and complexity and interval were associated with whether the patient would have treatment again. In multivariate models, only setting remained significant.
Persistent memory loss
Of the 35 studies, 20 considered memory loss as a consequence of electroconvulsive therapy. Thirteen were excluded because data were not given or the interval between treatment and questions about memory loss was less than six months. In four of the remaining studies, respondents were asked specifically whether they had experienced persistent or permanent memory loss, and in four studies any reported memory problem was sought (one study reported on both; table 3).
The rate of reported persistent memory loss varied between 29% and 55%, but, unlike levels of perceived benefit, the rate did not seem to depend on whether studies were clinical or patient based, with relatively high levels being reported by both types of study.
The methods used to elicit patients' views on electroconvulsive therapy influence the reporting of perceived benefit and willingness to repeat treatment. Variation in levels of perceived benefit was also related to the source of the research. Patient led studies reported lower rates of perceived benefit than clinical studies. This might be attributed to a selection bias, with patient studies only selecting people who were antagonistic to treatment. The study by Communicate, the user group at the Maudsley Hospital, is, however, a prospective one, where the interview schedule was clearly stated to come from a patient group. This study still reports lower rates of satisfaction than any of the clinical studies, indicating that even with a prospective design, patient led or collaborative research finds lower rates of satisfaction with treatment. Our findings suggest the difference may be attributed to a tendency for clinical studies to take place soon after treatment, to use medical assessors in clinical settings, and to use brief questionnaires with low complexity for responses.
Qualitative data collected as part of a wider review supports the above conclusions but show, in addition, how patients' views on electroconvulsive therapy are often complex. These data illuminate the way in which patients make decisions about electroconvulsive therapy by weighing the risks and benefits of treatment. Most of the studies we reviewed used simple response categories that did not allow this complex trade-off and other attitudes to be described. One hypothesis is that many patients are not simply for or against the treatment or even are neutral about it. The concept of satisfaction and its measurement are also subject to these criticisms of oversimplification. Future research should include qualitative measures with representative samples of patients who have received electroconvulsive therapy.
Electroconvulsive therapy is a complex intervention comprising many stages and the involvement of many staff. Patients may have varying views about these different stages. As the literature we reviewed relied on global ratings, however, it was not possible to investigate each stage independently. The exception was the information and consent stage, which will be reported later.
Although the studies did not use consistent definitions or standardised ratings for memory loss, levels were between 29% and 79%. The levels were not determined by whether studies were clinician led or patient led, but the two types of study did differ in their analyses and interpretation of findings. Patient led research typically presents numerical results and illustrates these with quotations to show what the data mean in terms of patients' lives, whereas clinical researchers tend to undertake further statistical analysis of the data, sometimes ignoring the original data. For example, one study asked participants to assess the statement that “electroconvulsive therapy permanently wipes out large parts of memory.”11 The study then reported that people who had never received treatment were more likely to endorse this statement than those who had received it. It did not, however, comment on the finding that one third of those who had received treatment agreed with the strongly worded statement.
Another study controlled for depression in the analyses and found that memory loss continued to be significant.27 Nonetheless, the authors concluded that long term memory loss was an important problem for only a small group of people and were doubtful about the causative role of electroconvulsive therapy.
The findings relate to the experience of persistent memory loss. Routine neuropsychological tests have been used in studies of electroconvulsive therapy to establish objective measures of memory loss and concluded that there was no evidence of persistent memory loss. It would seem that these are the studies on which the Royal College of Psychiatrists based its findings. The studies, however, typically measure the ability to form new memories after treatment (antero-grade memory). Reports by patients of memory loss are of the erasing of autobiographical memories or retrograde amnesia. Thus the risks reported by patients do not appear in clinical assessments.
What is already known on this topic
Around 11 000 people receive electroconvulsive therapy in England annually
Controversy exists as to whether treatment is beneficial and whether patients are satisfied with it
Patients' views have never been systematically reviewed
What this study adds
At least one third of patients report significant memory loss after treatment
Routine neuropsychological tests to assess memory do not address the types of memory loss reported by patients
Reported patient satisfaction with electroconvulsive therapy depends on the methods used to elicit a response
Controversy between medical opinion and patient organisations
We found possible sources of controversy between professional bodies and some patients and patient organisations. The levels of perceived benefit differed between patient led and clinician led studies because different methods were used and because in many cases these methods did not allow an adequate description of the complexity of subjective experience. Even where findings, such as persistent memory loss, did not differ between patient led and clinician led studies, the interpretations may have differed radically. It is therefore not surprising that disputes can arise between professionals and patients and that organisations should emerge that provide support and a forum for those who feel their treatment has not been beneficial.
Although clinical trials concluded that electroconvulsive therapy is an effective treatment,6 measures of efficacy did not take into account all the factors that may lead patients to perceive it as beneficial or otherwise. Studies of treatment are needed that are able to investigate a range of outcomes valued by patients. Important among these are factors that impact on effectiveness and satisfaction. Also important is loss of autobiographical memory, which is widely described but insufficiently systematically investigated.
Search terms appear on bmj.com
Editorial by Geddes and Carney
Contributors All authors contributed to the design of the study and the interpretation of the findings and were involved in writing the paper. The data were collected by DR and PF andanalysed by DR, TW, and ML. DR and PF have been recipients of electroconvulsive therapy. DR will act as guarantor for the paper.
Competing interests This paper is based on a report funded by a grant from the Department of Health, England. The Department of Health has given permission for publication but does not necessarily endorse the views contained in the paper.