BMJ 2001;323:1462-1463 ( 22-29 December )

Publish and be damned

Wanted---more answers than questions: literature review

Anthony S David, professor

Institute of Psychiatry and Guy's, King's College, and St Thomas's School of Medicine, London SE5 8AF

a.david{at}iop.kcl.ac.uk

The purpose of medical research is to advance knowledge and solve clinical problems. These high ideals are difficult to achieve. Instead, academia sometimes draws criticism for apparently doing research for its own sake. I therefore carried out a systematic literature review to examine whether published research was providing more questions than answers, or vice versa.


    Methods and results
Top
Methods and results
Comment
References

I used "more questions than answers" as a search term in the Medline database, spanning from 1966 to March 2001. To limit the potential number of hits, only the title and abstract were used as search fields. I also searched on the phrase "more answers than questions." All article types were included if they had an English abstract.

Two terms occurred in 166 articles (reference list available on request). However, only three articles (0.018%) purported to describe more answers than questions. Of the remaining 163, 119 used the term in the title and 13 prefixed the phrase with the word "still." No article suggested an equal number of answers and questions. Had the prevalence of answers to questions been a matter of chance, each search term would have yielded 83 articles (95% confidence interval 70 to 97); hence the finding is highly significant (P<0.001, binomial test).

The articles seem to be evenly distributed between basic science and clinical publications. The journals ranged from the Acta Gastroenterologica Belgica to Zeitschrift für Gastroenterologie (but gastroenterologists were not over-represented). I also tested a secondary hypothesis: are psychiatrists, notorious for answering one question with another, over-represented? Apart from two psychiatrically related articles, one on methadone treatment and the other on counselling, and a third written by two psychiatrists on the epidemiology of fatigue,1 there were only two articles in mainstream psychiatric journals (not including the must-read "Pornography, erotica, and behavior: more questions than answers"2). Only one article used the phrase legitimately: "More questions than answers: a study of question-answer sequences in a naturalistic setting"---this was published in the Journal of Child Language.3 Comments on the proportions of such articles in different branches of medicine, and indeed as proportions of all scientific publications, are at best speculative since the denominators are unknown.

No particular theme unified the three papers that valiantly claimed to have more answers than questions. One was a review of advances in ischaemic heart disease research, and one was about newly discovered neurosecretory functions of the hypothalamus---suddenly we have a whole range of proteins that we weren't expecting, and questions on what they do soon followed. The third article considered the mysterious case of spontaneous regression of Merkel cell carcinoma. The authors' solemn answer? It regressed spontaneously.

As a follow on, I carried out a similar literature search for the phrase "need more research." This yielded 162 articles, only one of which---a thought provoking polemic on aromatherapy---suggested the need for less research.4


    Comment
Top
Methods and results
Comment
References

Overwhelmingly more medical publications conclude that there are more questions than answers. Those claiming the opposite turn out on closer scrutiny to have an excess of questions too. The negative stereotype of medical research as being of little practical help finds support in these data. The frequent claim that we need more research is hard to sustain given the apparent outcome of this effort. It could be argued that the phrase "more questions than answers" is merely a cliché and not an accurate representation of the state of the field, or that finding the right question is a worthy aim. Hence it would be premature to advocate a major reduction in research funding on this basis. Nevertheless there is clear need for a moratorium on the use of clichés in scientific writing. For researchers aspiring to write a "classic paper"5 there can be only one conclusion: avoid clichés like the plague.

    Acknowledgments

   Contributors: ASD put the jokes in and the BMJ's editorial team took them out.

    Footnotes

Competing interests: ASD is an academic.


    References
Top
Methods and results
Comment
References

1. Lewis G, Wessely S. The epidemiology of fatigue: more questions than answers. J Epidemiol Community Health 1992; 46: 92-97[Medline].
2. Fisher WA, Barak A. Pornography, erotica, and behavior: more questions than answers. Int J Law Psychiatry 1991; 14: 65-83[CrossRef][Medline].
3. Van Hekkan SM, Roelofsen W. More questions than answers: a study of question-answer sequences in a naturalistic setting. J Child Lang 1982; 9: 445-460[Medline].
4. Vickers A. Why aromatherapy works (even if it doesn't and why we need less research) [editorial]. Br J Gen Pract 2000; 50: 444-445[Medline].
5. David AS. How to do it: write a classic paper. BMJ 1990; 300: 30-31.


© BMJ 2001

Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?

Relevant Article

The in-between world of knowledge brokering
Jonathan Lomas
BMJ 2007 334: 129-132. [Extract] [Full Text] [PDF]

This article has been cited by other articles:

  • Lomas, J. (2007). The in-between world of knowledge brokering. BMJ 334: 129-132 [Full text]  

Rapid Responses:

Read all Rapid Responses

'Wanted-More answers than questions' raises more questions than answers!
Paul Fearon
bmj.com, 22 Dec 2001 [Full text]
Defining the questions
Rajan Madhok, et al.
bmj.com, 9 Jan 2002 [Full text]
More questions than answers
Noam Zevit, et al.
bmj.com, 15 Jan 2002 [Full text]
Your Scientist Knows More Than You
Ernest L. Abel
bmj.com, 29 Oct 2002 [Full text]



Student BMJ

Sepsis

The latest guidlines will affect how we practice medicine

www.student.bmj.com

Listen to the latest BMJ Interview