Ethics review roulette: what can we learn?

BMJ 2004; 328 doi: http://dx.doi.org/10.1136/bmj.328.7432.121 (Published 15 January 2004)
Cite this as: BMJ 2004;328:121

Recent rapid responses

Rapid responses are electronic letters to the editor. They enable our users to debate issues raised in articles published on bmj.com. Although a selection of rapid responses will be included as edited readers' letters in the weekly print issue of the BMJ, their first appearance online means that they are published articles. If you need the url (web address) of an individual response, perhaps for citation purposes, simply click on the response headline and copy the url from the browser window.

Displaying 1-7 out of 7 published

24 September 2004

European researchers are not alone in this problem. As an economist, I find it particularly distressing that ethics review boards do not appear to understand that delay imposes costs, and therefore must be balanced against the possible benefits from review (which are related to the risks created by the research).

I teach in a Masters in Public Administration program where our MPA students must engage in evaluative/review reports to management. Most are required to treat every employee they talk to as a research subject, apply for ethical review, and offer a consent process, even when management has ordered the review and instructed employees to participate as part of their jobs. Many students have seen their ethics review process drag on for months, resulting in delays to degree completion and requiring extra fee payments for every additional term! Increasingly, students instead limit their work to review of literature and existing agency documents, which inherently reduces the quality and usefulness of both the work experience and the resulting report.

It is surely the right of any organization to review its performance with an eye to improvement, and to require employees to participate in such reviews, as long as the review concerns work responsibilities (not personal information). Offering a consent process, when refusal will not be accepted by management, actually creates risk (of management disapproval) for employees -- yet this flawed procedure is often insisted on by ethics review boards.

In my own research, which investigates the costs and effects of patient safety improvements in the local health authority, I find myself having to apply for two ethical reviews; one at the University and one at the health region! Despite efforts to integrate these two processes, over the past three years, they remain separate and distinct, with different forms, signatures, and information required, even though there is actually overlap (intentional) in the membership of the committees. The health region closely scrutinizes the research purpose and rationale, and no amount of prior review (by funding agencies) is taken into account; the committee will not read existing materials (such as research proposals) - everything must be rewritten and entered into cumbersome forms. The university is preoccupied with consent procedures and confidentiality provisions. Weeks of my time have vanished into ethical reviews, as I have yet to find a research assistant who can actually navigate the process and gain approval.

I'm not sure what the solution is, but we need to find one. We all want to protect research subjects, and treat them fairly. We also want to gain new knowledge as soon as possible! This means scaling the level and complexity of ethical review in relation to the risk posed by each study and the prior review that has occurred, rather than blindly putting all studies under the electron microscope.

Competing interests: None declared

Competing interests: None declared

Rebecca N Warburton, Assistant Professor

University of Victoria, V8S 4X2, Canada

Click to like:

Dear Sir,

Re. Lack of Indemnity for Research in Primary Care

We are writing to highlight a serious and important gap in the indemnity arrangements for research in primary care. All researchers are required to hold adequate indemnity as part of obtaining ethical approval for research. Most general practitioners and practice nurses are not direct employees of the NHS and are therefore outside the cover of the NHS litigation authority. Although most primary care trusts have issued honorary contracts to researchers, the NHS litigation authority has stated that these are not sufficient to provide indemnity. Projects where general practitioners or practice nurses are the grant-holders – i.e. most of the research taking place through Primary Care Research Networks - is therefore inadequately covered. Most researchers are unaware of their vulnerability.

Our research network has repeatedly asked the Department of Health for clarification and resolution of this matter but has not received a reply.

Research led by primary care is being compromised. Our practice was awarded a grant by the NHS R&D to carry out a randomised trial. After protracted discussions about indemnity and failure to establilsh cover, we are arranging to relinquish our status as the principal investigators and transfer this to our local academic unit. Another local practice will withdraw from research this year as a direct result of this problem.

This situation would be easily resolved by the NHS litigation authority to extend cover to NHS researchers in primary care. We ask them to do this.

Yours sincerely,

Chris Griffiths, General Practitioner
Meg McDonald, Practice Nurse

Competing interests: None declared

Competing interests: None declared

Chris J Griffiths, General Practitioner, Professor of Primary Care

Meg McDonald

Lower Clapton Group Practice, 36 Lower CLapton Road, London E5 OPD

Click to like:

Glasziou and Chalmers highlight eloquently the pitfalls of variations in ethics review procedures.

As they mention, part of the problem is the potential for ethical review of research to be reduced to a tick box exercise, where researchers and ethics committees must go through exactly the same processes in reviewing potential projects.This results in a frustrating one size fits all approach which negates the spirit of the entire process.

In developing countries, this tick box approach to ethics committee review and informed consent,ignores fundamental local contexts and questions of power, again defeating the purpose of the process.

Greater discussion of these issues, and more in depth training of all those involved in the ethics review process should empower decision- makers, increase their flexibility and make them ultimately less risk- averse.

Competing interests: MSc student whose choice of dissertation has been limited by the complexities of ethical review

Competing interests: None declared

Ike Anya, Specialist Registrar Public Health

Bristol North Primary Care Trust, King Square, Bristol BS2 8EE

Click to like:

Dear Sir

The paper by Hearnshaw1 and your editorial comment2 are timely, coming as they do only a few weeks before the introduction of new governance arrangements for research ethics committees3. While those applying for review of conventional medical interventions may face time- consuming and arduous form-filling, they do at least usually have their proposals reviewed by experts in conventional scientific method. The same cannot be said for applications involving unfamiliar methodologies, such as qualitative research, or interventions using complementary or alternative treatments which are not currently accepted within the western medical system.

There is a least one ethics committee which refuses all qualitative proposals at first review (personal communication), and anecdotally there are many which regularly review CAM proposals without training or expertise in this area, and suggest unrealistic or inappropriate changes to study design.

Given the increasing number of unconventional submissions, and the new governance requirements for ethics committees to include expertise in these areas, we are currently preparing a project to investigate the current practices and attitudes of ethics committees in the United Kingdom.

Gay Walker,
Researcher,
Supportive Oncology Research Team, Lynda Jackson Macmillan Centre (LJMC), Mount Vernon Cancer Centre, Northwood, Middx, HA6 2RN

Dr Jane Maher,
Consultant Clinical Oncologist,
Medical Director, LJMC, Mount Vernon Cancer Centre, Northwood, Middx HA6 2RN

Dr George Lewith,
Senior Research Fellow, University of Southampton,
Visiting Professor, University of Westminster,
Complementary Medicine Research Unit, Aldermoor Health Centre, Aldermoor Close, Southampton, SO16 5ST

Competing interests: None

1 Hearnshaw H. Comparison of requirement of research ethics committees in 11 European countries for non-invasive interventional study. BMJ 2004;328:140-1

2 Glasziou P, Chalmers I. Ethics review roulette: what can we learn? BMJ 2004;328:121-2

3 Governance arrangements for NHS Research Ethics Committees London: DoH 2001

Competing interests: None declared

Competing interests: None declared

Gay Walker, Researcher

Jane Maher, George Lewith

Lynda Jackson Macmillan Centre, Mount Vernon Cancer Centre, Northwood, Middlesex, HA6 2RN

Click to like:

EDITOR - Glasziou and Chalmers recent article, was timely and welcome. We would endorse the notion that ethics review may "delay or inhibit research beneficial to those same patients". In this letter we outline an example of a related process, research governance, designed to ensure that 'health and social care research is conducted to high scientific and ethical standards'. Our aim is to detail the reason for the research governance process being applied, and how it was applied, but more importantly, to describe the impact of this process, both on the researchers and on the research itself.

What we did

Our project, funded on a small project grant, explored the impact of a number of variables on outcome in a day therapy service for eating disorders. As a result of advice from our project steering group (a necessary requirement for such projects) we introduced a simple qualitative measure. This was an interview, based on a standard questionnaire, but adapted to form a semi-structured interview. Our "deviation", involving the research governance process, was to continue our project with this new improvement to protocol, without informing the Assistant R&D Director or the Local Ethics Committee. This could be described as an oversight, if we were aware of this requirement. We had not been alerted to the necessity of this.

What happened

Immediately we were asked to stop all our research activities whilst our protocol deviation was subjected to the research governance procedures. This involved 3 months of formal meetings with the assistant R & D director, and resubmission of the protocol and associated forms and amendments to ethics and other governing bodies. A very time consuming process with other competing and pressing clinical demands. Moreover, all other projects in the unit were subjected to a lengthy audit process.

The after effects

The impact of this process was two fold. Firstly, it had a major impact on the research process itself. In practice the research was frozen for three months during which time large amounts of data could not be obtained, thus affecting the validity of our overall results. Vital efforts of patients and researchers time was also wasted as a result of this 'freeze', causing further financial implications. The impact on the researchers was considerable. Both felt under a lot of stress and de-motivated. The process itself felt arbitrary and punitive, but also bore no obvious relation to the simple, creative idea that had instigated it. Both researchers felt demoralised and angry about the process and less inclined to undertake further research in addition to the requirements of a demanding clinical job in the future.

Reflections and Recommendations

This paper is not written with a view to denying the importance and relevance of the research governance process, but to reflect on the effects it can and did have. Firstly, it was an overreaction to a very small, technical infringement of the procedures. Its impact was to destroy the very thing it was designed to protect - the quality of the research. Our view is that the research governance process itself carries with it ethical implications. Is it ethical to waste patient and staff time, and tax payers money? Is it ethical to destroy the results of a sound research project? We would argue that the research governance process needs to be governed more closely, so that it is only correctly applied where research requires it, and the process modified accordingly to the "deviation" identified, as Glasziou and Chalmers write, regarding ethics review, we need to challenge the 'one size fits all' approach.

References

1. Glasziou P, Chalmers I. Ethics review roulette: What can we learn?

BMJ; 2004; 328: 121 -2

2. MRC. Policy and procedure for inquiring into Allegations of Scientific Misconduct (Medical Records Council 1997)

Competing interests: None declared

Competing interests: None declared

Alysun M. Jones, consultant clinical psychologist

Bryony H. Bamford

Southmead Hospital, Bristol, BS105NB

Click to like:

Thankyou to Hearnshaw1 ,Glasziou and Chalmers2 for making points I would have made myself had my time not been taken with writing ethics applications. I am currently coordinating a qualitative investigation into the attitudes of Asian families to child and adolescent mental health problems and services. Because the research involves service users, non- patient members of the community, children and adults I have been required to make full submissions to three ethics committees – one University and two NHS. Despite the fact that the research had received very positive peer review from one of the top medical sociologists in the UK, each committee criticised the design or quality of the methodology and required fairly substantial clarifications and alterations to patient information. For example, one committee required that I lengthen the children’s information sheet to bring it into line with COREC guidelines, while another said it was “too wordy” and required me to shorten it. Meanwhile, our local Health Board is carrying out a similar focus group study without need for ethical approval because it is seen as “user involvement”, is not hypothesis driven and will not be published in the research literature.

While I can see the need for a Research Governance Framework, the current guidelines seem to have produced a climate of risk aversion without any weighing of possible benefits to patients. I my area, research by busy clinicians and by students on time-limited MSc programmes is all but grinding to a halt because the ethics barrier is seen as insurmountable. This is yet another example of clinical academia being strangled at its roots.

1. Hearnshaw, H. (2004) Comparison of requirements of research ethics committees in 11 European countries for a non-invasive interventional study. BMJ, 328, 140.

2. Glasziou, P., Chalmers, I., (2004) Ethics review roulette: what can we learn?

Competing interests: None declared

Competing interests: None declared

Helen J Minnis, Senior Lecturer in Child and Adolescent Psychiatry

Child Psychiatry, Section of Psychological Medicine, University of Glasgow, G3 8SJ

Click to like:

16 January 2004

Glasziou and Chalmers are to be congratulated for their stand on this important issue. For many years our MSc students undertook projects addressing policy questions facing local trusts and health authorities. These typically involved a literature review and interviews with managers, clinicians and other relevant stakeholders. These interviewees are now deemed research subjects, thus requiring each student to obtain ethical approval. The lengthy process of getting approval has forced us to advise students to abandon this model, concentrating instead on desk-based studies. The links forged with the key stakeholders meant that many of these projects led to improvements in the care provided and it is far from clear, at least to me, that this development has increased the total sum of human welfare.

Competing interests: None declared

Competing interests: None declared

Martin McKee, Professor of European Public Health

London School of Hygiene and Tropical Medicine

Click to like:

THIS WEEK'S POLL