Effect of interpretive bias on research evidence

BMJ 2003; 326 doi: http://dx.doi.org/10.1136/bmj.326.7404.1453 (Published 25 June 2003)
Cite this as: BMJ 2003;326:1453

Get access to this article and all of bmj.com for the next 14 days

Sign up for a 14 day free trial today

Access to the full text of this article requires a subscription or payment. Please log in or subscribe below.

  1. Ted J Kaptchuk (ted_kaptchuk@hms.harvard.edu), assistant professor of medicine1
  1. 1 Harvard Medical School, Osher Institute, 401 Park Drive, Boston, MA 02215, USA
  • Accepted 19 March 2003

Doctors are being encouraged to improve their critical appraisal skills to make better use of medical research. But when using these skills, it is important to remember that interpretation of data is inevitably subjective and can itself result in bias.

Facts do not accumulate on the blank slates of researchers' minds and data simply do not speak for themselves.1 Good science inevitably embodies a tension between the empiricism of concrete data and the rationalism of deeply held convictions. Unbiased interpretation of data is as important as performing rigorous experiments. This evaluative process is never totally objective or completely independent of scientists' convictions or theoretical apparatus. This article elaborates on an insight of Vandenbroucke, who noted that “facts and theories remain inextricably linked… At the cutting edge of scientific progress, where new ideas develop, we will never escape subjectivity.”2 Interpretation can produce sound judgments or systematic error. Only hindsight will enable us to tell which has occurred. Nevertheless, awareness of the systematic errors that can occur in evaluative processes may facilitate the self regulating forces of science and help produce reliable knowledge sooner rather than later.


Embedded Image

Interpretative processes and biases in medical science

Science demands a critical attitude, but it is difficult to know whether you have allowed for too much or too little scepticism. Also, where is the demarcation between the background necessary for making judgments (such as theoretical commitments and previous knowledge) and the scientific goal of being objective and free of preconceptions? The interaction between data and judgment is often ignored because there is no objective measure for the subjective components of interpretation. Taxonomies of bias usually emphasise technical problems that can be fixed.3 The biases discussed below, however, may be present in the most rigorous science and are obvious only in retrospect.

Quality assessment and confirmation bias

The quality of any experimental findings must be appraised. …

Get access to this article and all of bmj.com for the next 14 days

Sign up for a 14 day free trial today

Access to the full text of this article requires a subscription or payment. Please log in or subscribe below.

Article access

Article access for 1 day

Purchase this article for £20 $30 €32*

The PDF version can be downloaded as your personal record

* Prices do not include VAT

THIS WEEK'S POLL