Jump to: Page Content, Site Navigation, Site Search,
You are seeing this message because your web browser does not support basic web standards. Find out more about why this message is appearing and what you can do to make your experience on this site better.
John W Ely a Department
of Family Medicine, University of Iowa College of Medicine, 200 Hawkins
Drive, 01291-D PFP, Iowa City, IA 52242, USA, b American College of Physicians- American Society of
Internal Medicine, Philadelphia, PA, USA, c Department of Family Practice, Michigan State University, East
Lansing, MI, USA, d Moses Cone Hospital Family Medicine Residency,
Greensboro, NC, USA, e Student Health Service, University of
Iowa, Iowa City
Correspondence to: J W Ely john-ely{at}uiowa.edu
| |
Abstract |
|---|
|
|
|---|
Objectives:
To characterise the information needs of
family doctors by collecting the questions they asked about patient
care during consultations and to classify these in ways that would be
useful to developers of knowledge bases.
Design:
Observational study in which investigators visited doctors for two half days and collected their questions. Taxonomies were developed to characterise the clinical topic and generic type of information sought for each question.
Setting:
Eastern Iowa.
Participants:
Random sample of 103 family doctors.
Main outcome measures:
Number of questions posed,
pursued, and answered; topic and generic type of information sought for
each question; time spent pursuing answers; information resources used.
Results:
Participants asked a total of 1101 questions. Questions about drug prescribing, obstetrics and gynaecology, and adult
infectious disease were most common and comprised 36% of all
questions. The taxonomy of generic questions included 69 categories;
the three most common types, comprising 24% of all questions, were
"What is the cause of symptom X?" "What is the dose of drug X?"
and "How should I manage disease or finding X?" Answers to most
questions (702, 64%) were not immediately pursued, but, of those
pursued, most (318, 80%) were answered. Doctors spent an average of
less than 2 minutes pursuing an answer, and they used readily available
print and human resources. Only two questions led to a formal
literature search.
Conclusions:
Family doctors in this study did not
pursue answers to most of their questions. Questions about patient care can be organised into a limited number of generic types, which could
help guide the efforts of knowledge base developers.
|
Key messages
|
| |
Introduction |
|---|
|
|
|---|
Doctors often have questions about the care of their patients. "Should a 6 week old girl exposed to chicken pox be given varicella-zoster immunoglobulin?" "What could cause urinary retention in an elderly woman?" "Is it safe to use nicotine patches during pregnancy?" Most questions occur at the point of care in busy clinics and hospitals.1-3 Answers may or may not be pursued, and, if pursued, they may or may not be found.
When faced with questions about patient care, doctors are advised to seek the "best available evidence" to guide their decisions.4 However, this advice is often ignored in practice. 1 5-7 Instead, practising doctors seek "bottom line" answers from highly digested, immediately available resources. 1 5 6 8-11
Our objective was to characterise the information needs of family
doctors by collecting their questions and classifying them in ways that
would be useful to developers of knowledge bases.12 We
collected questions about medical knowledge that could potentially be
answered by general sources such as textbooks and journals, not
questions about patient data that would be answered by the medical
record.13 Previous studies have analysed relatively small
numbers of questions, making it difficult to develop comprehensive descriptions and classification schemes.
1 2 14 15
Questions that arise in practice could help guide the content of
textbooks, review articles, continuing education courses, and medical
school curricula. Questions without answers could help guide research.
| |
Participants and methods |
|---|
|
|
|---|
Participants
All 386 family doctors working in the eastern third of Iowa (area
code 319) were eligible for our study, and, using a doctor database
maintained by the University of Iowa, we invited them in random order
to participate. To achieve our goal of at least 100 participants and
1000 questions, we invited 129 doctors. This goal was based on a
subjective sense of adequacy and on the frequency of questions
occurring in previous studies.
1 2 14
We excluded retired
doctors, house officers, and full time emergency doctors.
Procedures
One week after receiving an introductory letter, each doctor
was invited by telephone to participate. Two half day visits were
scheduled, usually separated by a week. JWE made the first visit, and a
research nurse made the second. All visits occurred between April 1996 and December 1997. Before the first visit, the participants received a
letter informing them about the study:
not to your patients or nurse), which is
not a natural thing to do."
We included all clinical questions related to the care of specific
patients. We excluded requests for facts that could be obtained from
the medical record ("What was her blood potassium concentration?")
or from the patient ("How long have you been coughing?").
The visiting researcher stood in a clinic hallway or a doctor's office
and recorded questions between patient visits by writing them on a
standard form. When a doctor pursued an answer we recorded the
resources used and the time spent with each resource. When an answer
was not pursued we asked why. Most questions referred to patients seen
during the observation period, but we also recorded questions recalled
about patients seen earlier.
Taxonomies
The questions were categorised using two taxonomies: topics and
generic questions (details given on the BMJ website). The topic taxonomy, which included 63 categories based on specialties, was modified from a system used to file journal
articles.16 We added categories to accommodate questions
that did not fall into a medical specialty (such as anatomy, legal
issues, medical ethics). We developed 43 arbitrary rules to improve
consistency among coders
such as "Osteoporosis is endocrinology, but
hormone replacement therapy is obstetrics and gynaecology." Because
almost all questions encompassed more than one topic, we assigned both a primary and a secondary topic. For prescribing questions ("What is
the dose of amoxicillin for a 1 year old?"), we assigned
"prescribing information" as the primary topic and the relevant
specialty ("pediatric infectious disease") as the secondary topic.
Statistical analysis
Most analyses were descriptive. The
statistic was used to
determine the interrater reliability of the question taxonomies. We
used liberal reliability criteria for the topic taxonomy: a match was
recorded if either the primary or secondary topic assigned by one coder
matched either the primary or secondary topic assigned by the other. We
used the Kruskal-Wallis one way analysis of variance and linear
regression for continuous outcomes, such as the frequency of questions
and the time spent answering them, and used the
2
statistic and logistic regression for dichotomous outcomes, such as
whether an answer was found. A two tailed significance level of 0.05 was chosen, and all analyses were performed with Stata (Stata
Corporation, College Station TX, USA).
| |
Results |
|---|
|
|
|---|
Demographic data
Of the 129 doctors invited, 103 (80%) agreed to participate. The
mean age of participants was 48 (range 31-87), and 23 were female.
Twenty one were in single handed practices, and 54 practised in a rural
area (town population <30 000). Among the 83 doctors in group
practices, the number of partners ranged from one to 10 (median 3).
Eighty doctors practised in freestanding clinic buildings where family
practice was the only specialty. Seven doctors were full time faculty
members, two at the University of Iowa and five in community residency
programmes. Typically, each doctor had a private office and saw
patients by rotating among two or three adjacent examination rooms.
Each doctor generally worked with a nurse, who took vital signs,
answered patient telephone calls, cleaned examination rooms, and
assisted with procedures. The primary funding source for 90 of the
doctors was fee for service. Patients were typically scheduled every 10 to 15 minutes.
Taxonomies
Topics
The most common question topics were drug prescribing (209 questions, 19%), obstetrics and gynaecology (96 questions, 9%), and
adult infectious disease (89 questions, 8%). The distribution of
question topics tended to mirror the distribution of clinical problems
seen. However, there were disproportionately more questions about
prescribing and disproportionately fewer questions about health
maintenance visits (annual adult examinations and "well child"
examinations). Except for drug prescribing, most topics were not
pursued. The 14 most common topics accounted for 899 (82%) of all
questions. The
statistic for the topic taxonomy was 0.91 (indicating "almost perfect" interrater agreement18).
Generic questions
The most frequently assigned generic questions were "What is the
cause of symptom X?" "What is the dose of drug X?" and "How
should I manage disease or finding X?" (table 1). Only queries about
drug dose were routinely pursued. The 25 most common generic questions
accounted for 887 (81%) of all questions. The
statistic for the
generic question taxonomy was 0.66 (indicating "substantial"
interrater agreement18). Although most questions were
unique, we found several repeated questions with essentially identical
wording: "What is this rash?" (n=22), "Is this a viral or a
bacterial infection?" (n=13), "What is causing the patient's abdominal pain?" (n=11), "What is causing the patient's chest pain?" (n=10), "What is causing the patient's fatigue?" (n=8), "What is causing the patient's dysuria (urine analysis normal)?" (n=5), "What is causing the patient's hives?" (n=4), and "Should the patient be given prophylaxis for subacute bacterial
endocarditis?" (n=4).
|
Answers
During the observation period, answers to 702 (64%) of the
questions were not pursued. Doctors said that they might pursue answers
to 123 of these questions after the observation period. The commonest
reason for not immediately pursuing an answer was that, after voicing
some uncertainty, the doctor felt that a reasonable decision could be
based on his or her current knowledge (n=148, 21%). Doctors found
answers to 318 (80%) of the 399 questions they pursued. As judged by
the observer, most answers (n=291, 92%) directly answered the question
posed, whereas 27 (8%) provided information related to the question
without directly answering it.
|
| |
Discussion |
|---|
|
|
|---|
With the exception of questions about drug prescribing, doctors in this study did not pursue answers to most of their questions. This result is consistent with a study of Oregon doctors in which an answer was pursued when the problem was perceived as urgent and when a definitive answer was thought to exist.3 In that study, and in ours, doctors pursued only a minority of their questions but found answers to about 80% of those pursued. 3 14
In previous studies the frequency of questions has varied widely and seems to depend on the setting, the definition of a "question," and the methods used to collect them.8 We recorded 3.2 questions for every 10 patients seen. In other studies this number has ranged from 0.7 questions per 10 patients in a private office setting to 57.7 questions per 10 patients on an inpatient teaching service. 2 8 19
Our participants spent an average of less than 2 minutes pursuing an answer. In a study of questions asked by Missouri family doctors, Medline searches by medical librarians took an average of 27 minutes per question.15 Sackett and Strauss found that printed summaries of evidence could be provided at the point of care within 30 seconds but that computer applications were too slow and too bulky to be feasible in their hospital setting.20 Although computers fared poorly in this and other studies, 6 9 improvements in their speed, portability, and user friendliness are making them more useful to doctors.21
Study limitations
Our taxonomies require validation in other settings because we
studied a homogeneous group of doctors in a small geographic area. The
presence of a researcher may have influenced the questioning behaviour
of the participants: some doctors may have been reluctant to reveal
gaps in their knowledge, whereas others may have generated questions to
please the observer. We tried to minimise these effects by assuring
participants that there was no right number of questions and by
developing the trust needed to reveal knowledge gaps. We did not ask
participants to rate the importance or urgency of the questions.
Conclusions
Busy family doctors need "bottom line" answers to their
questions, and they need them quickly.
10 14 22
Evidence can be provided at the point of care, but it is most useful when it has
been digested into quickly accessible summaries.
8 20 23
These summaries tend to reflect the perspective of research,
emphasising the performance characteristics of tests and results of
clinical trials. We found that this perspective often did not mesh with the needs of family doctors. For example, when faced with a clinical problem the doctors often asked what steps to take, without
distinguishing between diagnostic and therapeutic steps ("How should
I manage disease or finding X?"). We agree with those who say that
doctors should frame their questions better,4 but we also
think that authors should frame their answers better. By learning what
questions occur in practice, authors could provide more useful
information, which could ultimately lead to better patient care.
| |
Acknowledgments |
|---|
We thank Sharon Kaschmitter, who helped collect the data; Jeff Dawson, who helped analyse the data; Dedra Diehl, who helped verify the references; and to the 103 doctors who generously gave their time as participants.
Contributors: JWE, GRB, and ERE had the original idea for the study and designed the data collection procedures. JAO developed the concept of a taxonomy of generic questions. JWE made the first visits to all participants and trained the research nurse who made the second visits. JWE, JAO, MHE, GRB, BTL, and MLC coded the questions and revised the taxonomies. JWE wrote the first draft of the paper, and all authors contributed to subsequent revisions. JWE and JAO are guarantors for the paper.
| |
Footnotes |
|---|
Funding: This study was supported by a grant (G9518) from the American Academy of Family Physicians Foundation.
Competing interests: None declared.
| |
References |
|---|
|
|
|---|
| 1. | Covell DG, Uman GC, Manning PR. Information needs in office practice: are they being met? Ann Intern Med 1985; 103: 596-599. |
| 2. | Ely JW, Burch RJ, Vinson DC. The information needs of family physicians: case-specific clinical questions. J Fam Pract 1992; 35: 265-269[Medline]. |
| 3. |
Gorman PN, Helfand M.
Information seeking in primary care: how physicians choose which clinical questions to pursue and which to leave unanswered.
Med Decis Making
1995;
15:
113-119 |
| 4. | Sackett DL, Richardson WS, Rosenberg W, Hayes RB. Evidence-based medicine. How to practice and teach EBM. Edinburgh: Churchill Livingstone , 1997. |
| 5. |
McColl A, Smith H, White P, Field J.
General practitioner's perceptions of the route to evidence based medicine: a questionnaire survey.
BMJ
1998;
316:
361-365 |
| 6. | Haug JD. Physician's preferences for information sources: a meta-analytic study. Bull Med Libr Assoc 1997; 85: 223-232[Medline]. |
| 7. | Feinstein AR, Horwitz RI. Problems in the "evidence" of "evidence-based medicine." Am J Med 1997; 103: 529-535[Medline]. |
| 8. |
Smith R.
What clinical information do doctors need?
BMJ
1996;
313:
1062-1068 |
| 9. | Verhoeven AA, Boerma EJ, Meyboom-de Jong B. Use of information sources by family physicians: a literature survey. Bull Med Libr Assoc 1995; 83: 85-90[Medline]. |
| 10. |
Huth EJ.
"In the balance": weighing the evidence.
Ann Intern Med
1994;
120:
889 |
| 11. | Timpka T, Ekstrom M, Bjurulf P. Information needs and information seeking behaviour in primary health care. Scand J Prim Care 1989; 7: 105-109[Medline]. |
| 12. | Cimino J. Generic queries for meeting clinical information needs. Bull Med Libr Assoc 1993; 81: 195-206[Medline]. |
| 13. | Wyatt J. Use and sources of medical knowledge. Lancet 1991; 338: 1368-1373[Medline]. |
| 14. | Gorman PN, Ash J, Wykoff L. Can primary care physicians' questions be answered using the medical journal literature? Bull Med Libr Assoc 1994; 82: 140-146[Medline]. |
| 15. | Chambliss ML, Conley J. Answering clinical questions. J Fam Pract 1996; 43: 140-144[Medline]. |
| 16. | Reynolds RD. A family practice article filing system. J Fam Pract 1995; 41: 583-590[Medline]. |
| 17. | Wilson SR, Starr-Schneidkraut N, Cooper MD. Use of the critical incident technique to evaluate the impact of MEDLINE. Final report submitted to the National Library of Medicine. Palo Alto, CA: American Institute for Research , 1989(NTIS order No PB90-142522.) |
| 18. | Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-174[Medline]. |
| 19. | Osheroff JA, Forsythe DE, Buchanan BG, Bankowitz RA, Blumenfeld BH, Miller RA. Physicians' information needs: analysis of questions posed during clinical teaching. Annal Intern Med 1991; 114: 576-581. |
| 20. |
Sackett DL, Straus SE.
Finding and applying evidence during clinical rounds: the "evidence cart."
JAMA
1998;
280:
1336-1338 |
| 21. | Ebell MH, Barry HC. InfoRetriever: rapid access to evidence-based information on a handheld computer. MD Computing 1998; 15: 289-297. |
| 22. |
Greer AL.
The two cultures of biomedicine: can there be a consensus?
JAMA
1987;
258:
2739-2740 |
| 23. | Shaughnessy AF, Slawson DC, Becker L. Clinical jazz: harmonizing clinical experience and evidence-based medicine. J Fam Pract 1998; 47: 425-428[Medline]. |
(Accepted 29 June 1999)
Read all Rapid Responses