Re: Improving the conduct, reporting, and appraisal of animal research; PREPARE before you ARRIVE
Despite widespread journal endorsement of reporting guidelines, the inadequate reporting of preclinical research is being increasingly debated by the scientific and laboratory animal scientific communities (1, 2, 3). Studies demonstrating inadequate reporting (which is frequently unrelated to the journals' impact factor) suggest that it is related to the poor reproducibility of many animal experiments. This is at any rate a major threat to the validity of preclinical research (3). In a recent Editorial in BMJ on improving the conduct, reporting and appraisal of animal research, Merel Ritskes-Hoitinga and Kim Wever cite pre-registration, systematic reviews and better reporting as the major requirements for raising standards (4).
We propose that there is an elephant in the room that has been ignored for too long. Reporting guidelines, while well-intentioned, attempt to solve the reproducibility problem after the event - and appear to be failing. It should really be obvious that better reporting cannot improve the intrinsic quality of an experiment which has already been performed. While a good sales pitch may attract more customers, a product does not improve until its constituent parts and manufacturing conditions are upgraded. Systematic improvement of animal research must begin at the beginning, with guidelines for planning experiments. Such an approach is also in keeping with the 3R's principle of Replacement, Reduction and Refinement (5) which is part of modern animal research legislation such as the EU Directive 2010/63 (6).
With this in mind, we have constructed a set of planning guidelines called PREPARE (7), based upon our experiences over the last 30 years in planning and supervising animal experiments. PREPARE contains, of course, many of the elements embodied in reporting guidelines like ARRIVE (8), but, importantly, PREPARE highlights issues which are seldom reported, partly due to lack of space, but which can have dramatic impacts on not only the scientific validity of the research but also on animal welfare and the safety of all those involved.
PREPARE contains a "checklist" as does ARRIVE, which acts more of an aide memoire than a form to complete. It aims to provide a gentle reminder to all scientists of the items which should be addressed pre-study, much in the same way as pilots, however experienced, work their way through a checklist before take-off.
More importantly, we have constructed a website which supports and expands upon the topics in the checklist. PREPARE can thus offer scientists an up-to-date overview, with links to specific guidelines for each topic, adding new ones as they are published. An intelligent search engine on the 6,000-page Norecopa website where PREPARE resides (https://norecopa.no/PREPARE) facilitates the location of other relevant resources as well.
It is our hope that the debate on poor reproducibility will rotate towards planning, rather than reporting animal experiments. Otherwise, we are in danger of wasting time discussing the quality of the lock on the door of the stable from which the horse has already bolted.
1. Enserink M. Sloppy reporting on animal studies proves hard to change. Science2017;357:1337-8. doi:doi:10.1126/science.357.6358.1337pmid:28963232
2. Baker M. 1,500 scientists lift the lid on reproducibility. Nature2016;533:452-454. doi:10.1038/533452a
3. Skibba R. Swiss survey highlights potential flaws in animal studies. Nature2016;doi:10.1038/nature.2016.21093
4. Avey MT, Moher D, Sullivan KJ, Fergusson D, Griffin G, Grimshaw JM, Hutton B, Lalu MM, Macleod M, Marshall J, Mei SHJ, Rudnicki M, Stewart DJ, Turgeon AF, McIntyre L. The Devil Is in the Details: Incomplete Reporting in Preclinical Animal Research. PLoSONE2016;11:e0166733. doi:doi:10.1371/journal.pone.0166733
5. Ritskes-Hoitinga M, Wever K. Improving the conduct, reporting, and appraisal of animal research. BMJ2018;360:j4935. doi:doi:10.1136/bmj.j4935
6. Russell WMS, Burch RL. The Principles of Humane Experimental Technique; Universities Federation for Animal Welfare: Wheathampstead, UK, 1959. http://altweb.jhsph.edu/pubs/books/humane_exp/het-toc
7. EU Commission. Directive 2010/63/EU of the European Parliament and of the Council of 22 September 2010 on the Protection of Animals Used for Scientific Purposes. http://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2010:276:0033...
8. Smith AJ, Clutton RE, Lilley E, Hansen KEAa Brattelid T. PREPARE: Guidelines for planning animal research and testing. LaboratoryAnimals2017. Prepublished 3 August 2017. doi:10.1177/0023677217724823
9. Kilkenny C, Browne WJ, Cuthill IC, Emerson M, Altman DG. Improving bioscience research reporting: the ARRIVE guidelines for reporting animal research. PLOSBiol2010;8:e1000412. doi:doi:10.1371/journal.pbio.1000412pmid:20613859
Competing interests: We have read and understood BMJ policy on declaration of interests and declare the following interests: we are the unpaid authors of the PREPARE guidelines which we refer to in our Response. AS is the paid Secretary and employee of Norecopa. The other authors hold paid positions at other institutions and promote PREPARE where appropriate when they lecture.