BMJ response to the report of the independent statins panel

Several recommendations were made by the independent panel that was convened to consider the question of retraction, and to review the processing, of the articles by Abramson and Malhotra. This document itemises the journal's response to those recommendations. Further details of each suggestion from the panel and its context can be found in the panel’s final report; page numbers for the report are given after each item below, and items are considered in the order in which they occur in the report.

1. Initial Submission (p11)

“Editors could consider developing guidance for internal use in relation to when Analysis articles that contain calculations and numerical extrapolations warrant statistical review.”

Such guidelines have been developed, and statistical reviews analogous to those provided for research articles are now sought for Analysis articles that rely on statistical argument.

2. Revision and Publication: Summary and Assessment (p12)

• “Senior or deputy editors should sign off revisions that include substantive additions to an article or changes in a “fact” box.”
  
  Such changes are always seen by the editor handling the article in addition to the technical editor who is copy-editing it. In addition, handling editors are encouraged to escalate any concerns to the relevant Deputy Editor.

• “Extra attention should be given to manuscripts that have been noted by reviewers and editors to be controversial and potentially slanted or one-sided. “
  
  Additional flags and warnings are now put in place for particularly controversial articles, both on the manuscript tracking system and via discussion at team meetings.

• “Editors might consider whether such pieces are best placed (and clearly labelled) as opinion pieces or whether they are best placed and clearly labelled as articles/analyses that are meant to have a more comprehensive and, according to author instructions, “an even-handed approach in evaluating evidence, a lucid line of argument, and a worthwhile conclusion.”
  
  The editors feel that there is a place for articles that combine data and argument to make a case, and that Analysis is the format currently identified for articles of this type.
  
  
  

• “Although the article by Abramson et al was not press released, that by Malhotra, which was also clearly presenting a controversial view, was ( see press release). Press releases should be used with great care in such contexts.”

  Press releases are always seen by the authors of the article in question and by a Deputy Editor acting as ‘Duty Editor’. A weekly planning meeting ensures that particularly controversial articles are flagged up to the press release team. Our press releases aim to give a straightforward summary of the views as set out in the article. Because the press release can only provide a very brief summary of a paper, we always provide journalists with the full text of articles and author contact details

• “Editors might give extra attention to the following issues when considering potentially controversial articles that postulate strong arguments: possible selective citing of material, failure to critically appraise evidence that is used to support authors’ arguments, and over criticism of evidence that does not support authors’ arguments.“
  
  Editors are now alerted to consider these issues in particular in controversial articles, and to ask reviewers to do so.

• “Editors should carefully consider whether articles that include extrapolations and recalculations of numerical data need statistical review. “
  

  As noted in response to item 1, we do now seek specific statistical advice for such articles.

• “They should also consider whether a paper that has been revised requires additional peer review.”
  
  Editors discussed whether there should be a blanket policy of re-review after revision and decided against. However, re-review is required when substantial additions have been made, or changes to data and analysis, or when specific details have been requested by a specific reviewer, or after other  escalation  with colleagues. Editors should err on the side of caution when considering the need for re-review.




3. Review and comment on how criticisms and complaints against the articles were raised, and how the journal responded (p 14)

“The BMJ editorial staff should implement a significant event audit in relation to the need for the correction. The aim of the audit would be to try and identify what would need to have been in place to ensure that the correction was made in a more timely fashion.”

The editors undertook an end-to-end critical event audit of the handling of the two papers and their associated corrections. This is presented in a separate document.