- Kevork Hopayian, general practitioner (k.hopayian@btinternet.com)
- Seahills, Leiston Road, Aldeburgh IP15 5PL
- Accepted 25 June 2001
The emergence of systematic reviews raised hopes of a new era for the objective appraisal of evidence available on a given topic. Such reviews promised a synthesis of trial results, which could be conflicting, and an escape from the personal bias inherent in traditional reviews and expert opinion.1 As the discipline of systematic reviews has evolved, however, two new problems have arisen: the quality of reviews is variable 2 3; and two or more systematic reviews on the same topic may arrive at different conclusions, raising questions on the validity4-7 or the relevance8 of the conclusions. Moreover, adherence to a “checklist” system when appraising trials may overlook important clinical details in the original trials and so reduce the validity of the review. I uncovered this last shortcoming when I recently conducted a study of three systematic reviews; the study is reported here.
Summary points
The discipline of systematic reviews has given clinicians a valuable tool with which to synthesise evidence
As the methodology of systematic reviews has evolved, the quality of reviews has improved
Nevertheless, high quality systematic reviews may overlook important clinical details in the papers reviewed, thereby diminishing their validity
This shortcoming might be avoided if trials were assessed from a clinician's viewpoint as well as from a reviewer's viewpoint
Background
Guidelines have been drawn up to improve the quality of reviews.9 Differences in the quality of reviews, however, do not always explain discordance. Jadad and McQuay4 identified six sets of reviews covering six topics in pain research; despite similar quality scores for reviews in each set, four of the sets contained discordant reviews. Jadad et al8 identified six generic differences between reviews that might lead to discordance: the clinical question asked; the selection and inclusion of studies; data extraction; assessment of study quality; …
Sign in
Personal subscribers, sign in here:
Article access
Article access for 1 day
Purchase this article for £20 $30 €32*
The PDF version can be downloaded as your personal record
CiteULike
Connotea
Del.icio.us
Digg
Facebook
Reddit
Technorati
Twitter
Stumbleupon
Rapid responses
Latest Responses
Re: How much of a social media profile can doctors have?
Published 13 February 2012
Re: Diagnosis and management of Raynaud’s phenomenon
Published 13 February 2012
Re: Is it unethical for doctors to encourage healthy adults to donate a kidney to a stranger? No
Published 13 February 2012
Re: Report predicts 20 million AIDS orphans in Africa by 2010
Published 13 February 2012
Re: On the impossibility of being expert
Published 13 February 2012
Most responses
Does anyone understand the government’s plan for the NHS? (17 responses)
Published 17 Jan 2012
Bad medicine: medical nutrition (15 responses)
Published 18 Jan 2012
Shared decision making: really putting patients at the centre of healthcare (8 responses)
Published 27 Jan 2012
How much of a social media profile can doctors have? (7 responses)
Published 23 Jan 2012
Why legislation is necessary for my health reforms (7 responses)
Published 1 Feb 2012