Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
BMJ 2003;326:1363 (21 June), doi:10.1136/bmj.326.7403.1363
Diana Rose, senior researcher1, Pete Fleischmann, researcher1, Til Wykes, professor2, Morven Leese, statistician3, Jonathan Bindman, senior lecturer3
1 Service User Research Enterprise, PO34, Institute of Psychiatry, De Crespigny Park, London SE5 8AF, 2 Department of Psychology, Institute of Psychiatry, 3 Health Services Research Department, Institute of Psychiatry
Correspondence to: D Rose d.rose{at}iop.kcl.ac.uk
Design Descriptive systematic review.
Data sources Psychinfo, Medline, Web of Science, and Social Science Citation Index databases, and bibliographies.
Study selection Articles with patients' views after treatment with electroconvulsive therapy.
Data extraction 26 studies carried out by clinicians and nine reports of work undertaken by patients or with the collaboration of patients were identified; 16 studies investigated the perceived benefit of electroconvulsive therapy and seven met criteria for investigating memory loss.
Data synthesis The studies showed heterogeneity. The methods used were associated with levels of perceived benefit. At least one third of patients reported persistent memory loss.
Conclusions The current statement for patients from the Royal College of Psychiatrists that over 80% of patients are satisfied with electroconvulsive therapy and that memory loss is not clinically important is unfounded.
The Royal College of Psychiatrists' fact sheet states that more than eight out of 10 depressed patients who receive electroconvulsive therapy respond well.2 "Electroconvulsive therapy is the most effective treatment for severe depression and people... report that it makes them feel `like themselves again' or that `life is worth living.'"2 Although reviews on attitudes to electroconvulsive therapy in the 1980s concluded that patients found treatment beneficial and that they were satisfied with it, this is currently opposed by individual patients and groups.3 4 We aimed to examine the sources of this controversy and to assess the debated distinctions between efficacy, effectiveness, and satisfaction.5 Efficacy is restricted to what can be measured in a controlled clinical trial, often over a short period. It will not necessarily predict the effectiveness of a treatment in a real life situation, still less will it predict satisfaction. For instance, a systematic review of randomised controlled trials investigated evidence of the efficacy of electroconvulsive therapy as measured by symptom scales completed by a mental health professional.6 But these ratings may not be the same as perceptions of relief of symptoms by patients themselves. For example, in one study similar numbers of patients were regarded as improved by themselves and by health professionals, but in 20% (n=13) of cases these were different individuals.7
Patients' perceptions of benefit are likely to be based on broader considerations than just the relief of symptoms. They may take into account the amount and length of time symptoms are relieved (clinical benefit) as well as any side effects. One side effect is memory loss. The Royal College of Psychiatrists' fact sheet states that while memory of recent events may be affected by electroconvulsive therapy, "in most cases this memory loss goes away within a few days or weeks although some patients continue to experience memory problems for several months. As far as we know, electroconvulsive therapy does not have any long term effects on your memory or intelligence."2 Some patients, however, report severe and longlasting memory losses after electroconvulsive therapy, and these will influence decisions on the risks and benefits of treatment.
Despite these disagreements there has been little systematic study of patients' views about the effectiveness and safety of electroconvulsive therapy. We aimed to ascertain patients' attitudes on the perceived benefit of treatment, as distinct from clinically rated outcome, and reported memory loss after treatment.
Of the 27 papers identified, 26 were authored by academics or researchers and conducted in psychiatric facilities. A reference group enabled us to identify nine reports written either by patients or in collaboration with them. The work of Communicate, the user group at the Maudsley hospital, is awaiting publication, but we had access to its raw data. Although our searches included global sources, articles written by patients were confined to the United Kingdom in all but one case.
Analysis
We calculated the proportion of patients with positive responses to
questions on effectiveness of treatment and the 95% confidence intervals.
Positive responses were defined as an affirmative response to the statements
"electroconvulsive therapy is helpful" or "I would have
electroconvulsive therapy again." A Forrest plot was produced on the raw
(proportion) scale as to whether electroconvulsive therapy was considered
helpful, with normal approximation standard errors.
The research studies were rated on four methodological variables. These were selected from either previous research (setting and interviewer), preliminary analysis of the data (interval between treatment and interview), or the social science literature.8
Interval between treatment and interview
We considered the interval between treatment and interview because the
benefits of treatment may be short lived and side effects only apparent later.
The scores were: 0 for during course of treatment or maintenance treatment; 1
for within four weeks or predischarge; 2 for 1-6 months; and 3 for more than
six months.
Number of questions
As a few brief questions are likely to produce less engagement than a more
exploratory list of questions, we scored: 1 for five or less questions; 2 for
6-14 questions; and 3 for 15 or more questions.
Complexity of interview
With simple response options there was less scope for patients to express
their opinions whereas multiple choice questions or semistructured interviews
allowed more complex opinions to be recorded. The scoring system was: 1 for
dichotomous responses; 2 for simple Likert scales; 3 for complex Likert scales
or multiple choice; and 4 for a semistructured interview.
Setting of interview and status of interviewer
Conducting an interview has been shown to influence the willingness of
patients to be critical about
services.9 They are
more likely to be critical when interviewed by a fellow patient in a neutral
setting. Because the setting and status are always highly correlated, we
amalgamated them into one category. The scoring system was: 1 for inpatients;
2 for same hospital or treating doctor; 3 for non-treating doctor or at home;
4 for day care or voluntary sector; and 5 for source independent of health
services, and choice of setting.
Logit models were fitted to assess associations between positive responses and methodological characteristics and the distinction between clinical and patient studies. SPSS version 10 and Stata version 7 were used for the analyses.
2=370, P < 0.001, for treatment helpful,
2=256, P < 0.001 for would have treatment again). The
Forrest plot for "helpful" shows that the patient led and
collaborative studies report the lowest levels of positive responses; there
was, however, an overlap in the confidence intervals
(figure and
table 1).
|
|
A funnel plot showed no evidence of publication bias among the clinical studies. No systematic relation was found between perceived benefit and the country, or region of the United Kingdom, where the research was undertaken.
Methodological variables
The number of questions, complexity of the interviews, and the interval
before interview were intercorrelated (between number of questions and both
the other two variables r=0.54, between interval and complexity r=0.75). The
clinical studies tended to use fewer questions, less complex schedules, and a
shorter interval, although the difference in complexity was not significant
(see table 1).
Studies where the interviews were conducted soon after treatment, in hospital settings, by the treating doctor, were more likely to report positive views of electroconvulsive therapy (table 2). Studies with low complexity schedules, few questions, and a short interval were also associated with high perceived benefit. In the case of treatment considered helpful there was a clear hierarchy in setting, as coded from studies of inpatients (coded 1) to studies based in the community (coded 5).
|
When the analyses were repeated for the clinical studies alone, the effects were in the same direction and of a similar magnitude. Because of reduced sample sizes, fewer associations were significant. Within clinical studies, the number of questions remained significantly associated with treatment considered helpful, and complexity and interval were associated with whether the patient would have treatment again. In multivariate models, only setting remained significant.
Persistent memory loss
Of the 35 studies, 20 considered memory loss as a consequence of
electroconvulsive therapy. Thirteen were excluded because data were not given
or the interval between treatment and questions about memory loss was less
than six months. In four of the remaining studies, respondents were asked
specifically whether they had experienced persistent or permanent memory loss,
and in four studies any reported memory problem was sought (one study reported
on both; table 3).
|
The rate of reported persistent memory loss varied between 29% and 55%, but, unlike levels of perceived benefit, the rate did not seem to depend on whether studies were clinical or patient based, with relatively high levels being reported by both types of study.
Qualitative data collected as part of a wider review supports the above conclusions but show, in addition, how patients' views on electroconvulsive therapy are often complex. These data illuminate the way in which patients make decisions about electroconvulsive therapy by weighing the risks and benefits of treatment. Most of the studies we reviewed used simple response categories that did not allow this complex trade-off and other attitudes to be described. One hypothesis is that many patients are not simply for or against the treatment or even are neutral about it. The concept of satisfaction and its measurement are also subject to these criticisms of oversimplification. Future research should include qualitative measures with representative samples of patients who have received electroconvulsive therapy.
Electroconvulsive therapy is a complex intervention comprising many stages and the involvement of many staff. Patients may have varying views about these different stages. As the literature we reviewed relied on global ratings, however, it was not possible to investigate each stage independently. The exception was the information and consent stage, which will be reported later.
Memory loss
Although the studies did not use consistent definitions or standardised
ratings for memory loss, levels were between 29% and 79%. The levels were not
determined by whether studies were clinician led or patient led, but the two
types of study did differ in their analyses and interpretation of findings.
Patient led research typically presents numerical results and illustrates
these with quotations to show what the data mean in terms of patients' lives,
whereas clinical researchers tend to undertake further statistical analysis of
the data, sometimes ignoring the original data. For example, one study asked
participants to assess the statement that "electroconvulsive therapy
permanently wipes out large parts of
memory."11
The study then reported that people who had never received treatment were more
likely to endorse this statement than those who had received it. It did not,
however, comment on the finding that one third of those who had received
treatment agreed with the strongly worded statement.
Another study controlled for depression in the analyses and found that memory loss continued to be significant.27 Nonetheless, the authors concluded that long term memory loss was an important problem for only a small group of people and were doubtful about the causative role of electroconvulsive therapy.
The findings relate to the experience of persistent memory loss. Routine neuropsychological tests have been used in studies of electroconvulsive therapy to establish objective measures of memory loss and concluded that there was no evidence of persistent memory loss. It would seem that these are the studies on which the Royal College of Psychiatrists based its findings. The studies, however, typically measure the ability to form new memories after treatment (antero-grade memory). Reports by patients of memory loss are of the erasing of autobiographical memories or retrograde amnesia. Thus the risks reported by patients do not appear in clinical assessments.
|
Controversy between medical opinion and patient organisations
We found possible sources of controversy between professional bodies and
some patients and patient organisations. The levels of perceived benefit
differed between patient led and clinician led studies because different
methods were used and because in many cases these methods did not allow an
adequate description of the complexity of subjective experience. Even where
findings, such as persistent memory loss, did not differ between patient led
and clinician led studies, the interpretations may have differed radically. It
is therefore not surprising that disputes can arise between professionals and
patients and that organisations should emerge that provide support and a forum
for those who feel their treatment has not been beneficial.
Conclusion
Although clinical trials concluded that electroconvulsive therapy is an
effective
treatment,6 measures
of efficacy did not take into account all the factors that may lead patients
to perceive it as beneficial or otherwise. Studies of treatment are needed
that are able to investigate a range of outcomes valued by patients. Important
among these are factors that impact on effectiveness and satisfaction. Also
important is loss of autobiographical memory, which is widely described but
insufficiently systematically investigated.
Editorial by Geddes and Carney
Contributors: All authors contributed to the design of the study and the interpretation of the findings and were involved in writing the paper. The data were collected by DR and PF andanalysed by DR, TW, and ML. DR and PF have been recipients of electroconvulsive therapy. DR will act as guarantor for the paper.
Competing interests: This paper is based on a report funded by a grant from the Department of Health, England. The Department of Health has given permission for publication but does not necessarily endorse the views contained in the paper.
![]()
CiteULike
Complore
Connotea
Del.icio.us
Digg
Reddit
StumbleUpon
Technorati What's this?
Read all Rapid Responses