- Jeffrey J Perry, associate professor1,
- Ian G Stiell, professor and chair1,
- Marco L A Sivilotti, associate professor2,
- Michael J Bullard, professor3,
- Jacques S Lee, assistant professor4,
- Mary Eisenhauer, associate professor of medicine5,
- Cheryl Symington, research coordinator1,
- Melodie Mortensen, research coordinator1,
- Jane Sutherland, research coordinator6,
- Howard Lesiuk, consulting neurosurgeon7,
- George A Wells, professor biostatistics and epidemiology8
- 1Department of Emergency Medicine, University of Ottawa and Ottawa Hospital Research Institute, Ottawa, Ontario, Canada K1Y 4E9
- 2Department of Pharmacology and Toxicology, Queen’s University, Kingston, Ontario
- 3Division of Emergency Medicine, University of Alberta, Edmonton, Alberta
- 4Division of Emergency Medicine, University of Toronto, Toronto, Ontario
- 5Division of Emergency Medicine, University of Western Ontario, London, Ontario
- 6University of Ottawa, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario
- 7Division of Neurosurgery, Ottawa Hospital Research Institute, Ottawa, Ontario
- 8Department of Epidemiology and Community Medicine, Ottawa Hospital Research Institute, Ottawa, Ontario
- Correspondence to: J Perry
- Accepted 31 August 2010
Objective To identify high risk clinical characteristics for subarachnoid haemorrhage in neurologically intact patients with headache.
Design Multicentre prospective cohort study over five years.
Setting Six university affiliated tertiary care teaching hospitals in Canada. Data collected from November 2000 until November 2005.
Participants Neurologically intact adults with a non-traumatic headache peaking within an hour.
Main outcome measures Subarachnoid haemorrhage, as defined by any of subarachnoid haemorrhage on computed tomography of the head, xanthochromia in the cerebrospinal fluid, or red blood cells in the final sample of cerebrospinal fluid with positive results on angiography. Physicians completed data collection forms before investigations.
Results In the 1999 patients enrolled there were 130 cases of subarachnoid haemorrhage. Mean (range) age was 43.4 (16-93), 1207 (60.4%) were women, and 1546 (78.5%) reported that it was the worst headache of their life. Thirteen of the variables collected on history and three on examination were reliable and associated with subarachnoid haemorrhage. We used recursive partitioning with different combinations of these variables to create three clinical decisions rules. All had 100% (95% confidence interval 97.1% to 100.0%) sensitivity with specificities from 28.4% to 38.8%. Use of any one of these rules would have lowered rates of investigation (computed tomography, lumbar puncture, or both) from the current 82.9% to between 63.7% and 73.5%.
Conclusion Clinical characteristics can be predictive for subarachnoid haemorrhage. Practical and sensitive clinical decision rules can be used in patients with a headache peaking within an hour. Further study of these proposed decision rules, including prospective validation, could allow clinicians to be more selective and accurate when investigating patients with headache.
Headache is a common presenting complaint in emergency departments, accounting for about 2% of all visits.1 2 Although subarachnoid haemorrhage accounts for only 1-3% of these headaches,2 3 4 emergency physicians need to rule out this important diagnosis. Typically, these headaches have a sudden onset and are severe.5 Neurological deficits, including coma at presentation, make the decision to investigate some patients relatively straightforward. It is particularly important, however, to investigate alert neurologically intact patients who present with headache alone and who account for up to half of all patients with subarachnoid haemorrhage because they benefit most from prompt diagnosis.6 Misdiagnosis occurs in a small number of patients with subarachnoid haemorrhage on the initial visit, when appropriate investigations are not performed.7 8 9 Missing a subarachnoid haemorrhage in an otherwise alert patient can lead to catastrophic morbidity or death.5 10 11 12 13 14 Prognosis is most favourable when patients are treated early, while they are clinically well (that is, alert with no neurological deficits), and untreated patients can have abrupt clinical worsening because of re-bleeding.15 Such patients epitomise the challenges of emergency medicine; the condition is uncommon and difficult to diagnose and yet they have the most to lose by a missed diagnosis.12 14 16 17
Patients with suspected subarachnoid haemorrhage are typically investigated with unenhanced computed tomography and a lumbar puncture if the scan result is negative. Not surprisingly, current use of these investigations in alert patients with non-traumatic headache is inefficient.3 Computed tomography is a high volume imaging technology, which adds considerably to healthcare costs and involves radiation that can increase the risk of cancer.18 Over 95% of scans to rule out subarachnoid haemorrhage, however, yield negative results, and traditionally all of these patients then undergo lumbar puncture.3 11 12 13 Lumbar puncture can be painful and can result in a headache that might be worse than the original headache.19 Although it would be ideal to investigate only high risk patients, no previous research has safely and rigorously identified this high risk population.
We prospectively assessed clinical characteristics of neurologically intact patients in emergency departments with a headache peaking within an hour to determine which variables are predictive for subarachnoid haemorrhage and are reliable between physicians. We also combined these high risk variables into preliminary potential clinical decision rules. Such rules should be highly sensitive and reliable while also reducing the number of patients requiring investigation to rule out subarachnoid haemorrhage.
This was a prospective multicentre cohort study conducted at six university affiliated tertiary care teaching hospitals in Canada. Data were collected from November 2000 to November 2005.
We included alert patients aged ≥16 who presented to an emergency department with a chief complaint of non-traumatic headache peaking within an hour or of syncope associated with a headache. Alert was defined as a score of 15 on the Glasgow coma scale. Non-traumatic was defined as the absence of falls or direct trauma to the head in the previous seven days. Acute was defined as an interval of less than one hour from headache onset to peak intensity, and an interval of less than 14 days from headache onset to presentation.
We excluded patients with a history of three or more recurrent headaches of the same character and intensity as the presenting headache over a period of over six months; referred from other centres with a confirmed subarachnoid haemorrhage by either computed tomography or lumbar puncture; returned for reassessment of the same headache if they had already been investigated with computed tomography or lumbar puncture, or both; with papilloedema (as determined by treating physician); new focal neurological deficits, previous diagnosis of cerebral aneurysm or subarachnoid haemorrhage; previous diagnosis of a brain neoplasm; or known hydrocephalus.
Attending emergency physicians or supervised residents in an emergency medicine training programme with input from their attending physician assessed all patients. Physicians were familiarised with the study and the standardised assessment by means of a formal one hour teaching presentation. Emergency physicians completed data forms to identify the presence or absence of 33 clinical findings in consecutive eligible patients. When feasible, we requested that the first physician ask another on duty emergency physician to complete a second data collection form, without knowledge of the first physician’s findings. The study nurse collected the data forms, verified data, confirmed eligibility, and performed telephone follow-up at one and six months when necessary. Study nurses also reviewed all records of emergency department visits to identify any missed eligible patients. If patients with headache were not clearly excluded by the eligibility criteria, they were deemed to be a missed eligible patient. For these patients we recorded information on age, sex, arrival by ambulance, computed tomography, lumbar puncture, and diagnosis of subarachnoid haemorrhage on a standardised missed patient data collection form. Review of health records and structured telephone follow-up were conducted as necessary to identify missed subarachnoid haemorrhage by using the same outcome criteria as used for enrolled patients.
Subarachnoid haemorrhage was defined by subarachnoid blood on unenhanced computed tomography of the head, xanthochromia in the cerebrospinal fluid, or red blood cells (>5×106/l) in the final sample of cerebrospinal fluid, with an aneurysm or arteriovenous malformation evident on cerebral angiography. This outcome was established a priori by consensus with five emergency physicians and one neurosurgeon.20
All results of computed tomography were verified by the local attending radiologists (either neuroradiologists or general radiologists who routinely interpret computed tomograms of the head). The radiologists were blinded to the contents of the data collection forms when they interpreted the scans but had the usual clinical information. Radiologists, as per usual practice at the time of the study, provided a final radiology report within one to three days after the scan. All computed tomographic scanners were third generation scanners. Lumbar puncture was done as per local practice, with the laboratory technicians visually inspecting the cerebrospinal fluid for the presence of red blood cells or xanthochromia.20 21 22 23
As the study protocol did not alter current practice, many patients were discharged without computed tomography and a lumbar puncture. We reviewed medical records of these patients (both enrolled and missed eligible patients) and carried out a structured telephone interview at one month and six months to identify any subsequent adverse events. At review or follow-up we assessed repeat visits to a physician, change in diagnosis, and subsequent testing with computed tomography, lumbar puncture, angiography, or magnetic resonance imaging. We internally validated our follow-up tool to identify subarachnoid haemorrhage. Patients who could not be contacted by telephone, despite at least five repeated attempts at varying times of the day, had an additional review of health records at the end of the study to see if they had any subsequent hospital encounters. At all five sites in Ontario, those patients lost to all follow-up were further checked against records from the provincial coroner’s office to identify any deaths compatible with subarachnoid haemorrhage.
Univariate analyses determined the strength of the association between each of 26 possible predictor variables and the outcome variable. We used Pearson’s χ2 or Fisher’s exact test for nominal variables and the unpaired two tailed t test for continuous variables, using either pooled or separate variance estimates as appropriate. We further explored variables of potential interest (either on statistical or clinical basis) using clinically sensible cut points. Cut points were used to ensure the final model did not contain any continuous variables so that clinicians could categorise patients as high or low risk without performing any calculations. The interobserver agreement for each variable was measured with the κ coefficient or Spearman’s interclass coefficient, which measures the potential agreement beyond chance.
We then developed multivariate models to predict subarachnoid haemorrhage. Variables found to be associated at an α <0.20 were evaluated with χ2 recursive partitioning analysis. This cut point was chosen to limit the number of associated variables, without requiring variables to be significant until we adjusted for the effect of confounding variables. Recursive partitioning was performed with KnowledgeSEEKER 6.0 software (Agnoss, Toronto, ON) to generate highly sensitive models. In addition to using variables with good interobserver reliability (κ >0.6), we considered only models that made clinical sense and could be easily incorporated into clinical practice.
We chose recursive partitioning analysis over logistic regression analysis because our objective was to correctly classify one outcome group at the expense of the other (that is, high sensitivity is more important than overall accuracy). Recursive partitioning has been used to derive the Ottawa ankle rules, Ottawa knee rule, Canadian C-spine rule, and the Canadian CT head rule for minor trauma.24 25 26 27
We estimated our sample size based on the objective of developing a clinical decision rule. We determined that a clinical decision rule for a life threatening problem such as subarachnoid haemorrhage would need 100% sensitivity with a narrow confidence interval (such as 97% to 100%). Based on a cohort prevalence of 6.7% of subarachnoid haemorrhage in previous pilot study, we calculated that we required a total of 120 patients with subarachnoid haemorrhage, corresponding to a total sample size of 1800 enrolled patients.
We enrolled 1999 patients, 130 of whom had confirmed subarachnoid haemorrhage (fig 1⇓). Of the remaining 1869, only 26 were lost to active follow-up. None of these patients was seen at the regional neurosurgical referral centre within six months of their index visit. For five sites (accounting for 25 of the 26 patients), we were able to search provincial coroner reports (reporting is required by law for all sudden and unexpected deaths), and none of those lost to follow-up had died.
We identified 1050 (34.4%) potentially eligible headache patients who were not enrolled. If we could not conclusively determine that they did not meet our eligibility criteria on review of the emergency department visit we deemed them as “missed eligible.” The demographics were similar to enrolled patients (mean age 44.0; 59.9% women; 22.9% arrived by ambulance), though fewer were investigated (73.0% underwent computed tomography, 36.7% underwent lumbar puncture) and fewer ultimately had a diagnosis of subarachnoid haemorrhage (2.7%). At telephone follow-up at one and six months, we confirmed the absence of subsequent subarachnoid haemorrhage in all patients contacted (87.5% at one month and 80.6% at six months). None of these patients had return visits to the regional neurosurgical referral centre within six months of their initial visit.
Table 1⇓ lists the characteristics of our study cohort. Overall, patients were relatively young, more than half were women, and over three quarters described the headache as the worst of their lives. The time from onset was relatively fast, with a mean time from onset to peak of around nine minutes. About a third of patients complained of neck pain and another third reported vomiting. In all, 1657 (82.9%) patients were investigated with computed tomography of the head, lumbar puncture, or both. Most (1521, 81.4%) were diagnosed with benign headaches (such as tension, cluster, or other headache without a serious aetiology identified at the time of their six month follow-up) or migraine (according to the final diagnosis of the emergency physician). In addition to the cases of subarachnoid haemorrhage, computed tomography or lumbar puncture led to a diagnosis of other serious illnesses in 48 patients (such as transient ischaemic attack/acute ischaemic stroke, other types of haemorrhagic stroke, bacterial meningitis, hypertensive emergency, or cerebral neoplasm). All but nine cases of subarachnoid haemorrhage were identified by the radiologist’s final interpretation of the computed tomogram. Of these nine patients with negative results on computed tomography, seven had xanthochromia and two had red blood cells in the cerebrospinal fluid with positive results on cerebral angiography. Emergency physicians initially misinterpreted the computed tomogram as normal in three cases and discharged the patients home. These three patients were recalled after radiologists reviewed the computed tomogram. In another case, the radiology resident initially misinterpreted the computed tomogram as normal but the patient went on to have a lumbar puncture that showed blood in the cerebrospinal fluid. This blood was thought to be secondary to traumatic tap (632 000×106/l in the fourth tube) and the neurosurgery resident discharged the patient home with follow-up magnetic resonance angiography booked in five days. This angiogram showed an aneurysm, which was managed surgically. No other cases of subarachnoid haemorrhage were missed on the initial emergency department visit.
Many of the variables cited in the literature on subarachnoid haemorrhage were associated with the condition in our patients (table 2⇓). For the 103 patients who had two independent physician assessments, there was substantial interobserver agreement for being awoken by headache, transient loss of consciousness, vomiting, complaint of neck stiffness or pain, and onset with exertion. Interobserver agreement was poor for the worst headache of life and needing to rest. The interclass correlation coefficient calculated for the continuous variables showed poor correlation for time from onset to peak of headache and substantial agreement for peak pain intensity (on a scale from 0 to 10, where 0=no pain and 10=worst pain ever).
Figure 2⇓ shows an example of χ2 recursive partitioning for rule 1. This same method was used to derive rules 2 and 3. This figure shows the sequential stepwise analysis in which the most predictive variable is chosen at each level, until a low risk group without any cases of subarachnoid haemorrhage remains. Patients with any one of the variables who had subarachnoid haemorrhage form the high risk group.
Each model suggests that only patients with any of the high risk variables will need to be investigated. The box displays the three derived rules, and table 3⇓ shows their respective classification of performance. All three rules have retrospective sensitivity of 100% (95% confidence interval 97.1% to 100.0%). The specificity of the models ranges from 28.4% to 38.8%, with corresponding investigation rates (computed tomography, lumbar puncture, or both) from 63.7% to 73.5%. Each of the three rules suggests a lower investigation rate than the current rate of 82.9%. We conducted a post hoc bootstrapping analysis of 1000 iterations to determine the internal stability of each of the three models and found that the specificity was stable at each of the point estimates for each model with perfect sensitivity (see appendix 1 on bmj.com).
Variables included in each of three proposed rules
For each rule, patients should be investigated if one or more of the variables are present
Complaint of neck pain or stiffness
Witnessed loss of consciousness
Onset with exertion
Arrival by ambulance
Vomiting at least once
Diastolic blood pressure >100 mm Hg
Arrival by ambulance
Systolic blood pressure >160 mm Hg
Complaint of neck pain or stiffness
In a five year multicentre study we derived three decision rules using clinical findings to identify which neurologically intact patients with headache require investigation to rule out arguably the most serious cause of headache, subarachnoid haemorrhage. Arrival by ambulance, age ≥40, complaint of neck stiffness or pain, onset with exertion, vomiting, witnessed loss of consciousness, and raised blood pressure were strongly and reliably associated with subarachnoid haemorrhage. The presence of one or more of these findings in a patient with an acute non-traumatic headache reaching maximum intensity within one hour and that is unlike previous headaches should prompt physicians to consider investigating for subarachnoid haemorrhage.
We have previously shown that while physicians can discriminate between patients with subarachnoid haemorrhage and other forms of headache, they are reluctant to do so solely on their clinical findings.28 Our clinical decision rules, if validated, should provide physicians with evidence to manage more headache patients safely without investigation. Beyond healthcare costs, investigations entail exposure to radiation and perhaps intravenous contrast medium, difficulties in interpreting erythrocyte counts in traumatic lumbar punctures with false positive results, the indirect costs of incidental findings, and the morbidity of a headache after dural puncture. More selective testing can also shorten length of stay in an overcrowded emergency department. We have previously shown that computed tomography of the head adds about three hours to a patient’s length of stay, and performing a lumbar puncture adds another four hours.3
We are not aware of previous studies on clinical decision rules in patients with headache and normal results on neurological examinations. One small prospective study in 137 headache patients, including 23 cases of subarachnoid haemorrhage, concluded, without conducting a multivariate analysis, that there was no single clinical feature that could reliably identify which patients with headache require investigation.29 Other previous studies have attempted to identify risk factors and features suggestive of subarachnoid haemorrhage. A retrospective study of 500 patients with aneurysmal subarachnoid haemorrhage found that risk factors included women aged over 50, men aged under 50, and stressful events.30 Other proposed risk factors include alcohol consumption, smoking, hypertension, and oral contraceptives, but these variables are prevalent among many patients in emergency departments and might not be clinically useful for differentiating subarachnoid haemorrhage from other headaches.31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 Uncommon connective tissue disorders, including Ehlers-Danlos syndrome type IV, autosomal dominant polycystic kidney disease, and Marfan’s syndrome, can lead to subarachnoid haemorrhage but are absent in most patients with subarachnoid haemorrhage.14 46 47 48 49 50 51 Neck stiffness is often cited in reviews of the topic.12 14 Other associations with subarachnoid haemorrhage include acutely raised blood pressure.12
Strengths of study
To develop the clinical decision rules, we followed previously established methodological standards for developing and testing.52 53 54 55 We clearly defined our outcome, subarachnoid haemorrhage, and it was assessed without knowledge of the predictor variables. The predictor variables were prospectively evaluated and documented on standardised data collection forms before head computed tomography or lumbar puncture. We assessed the interobserver reliability of the predictor variables by having an independent second physician repeat the assessment of the patient. Patients were selected without bias and did not differ significantly from missed eligible patients. We were estimating the classification of performances of the clinical decision rules. The large sample size allowed us to achieve narrow confidence intervals for sensitivity. Each of our derived rules contains only four variables, all of which are relatively simple and well defined, which should allow clinicians to easily incorporate the optimal rule into everyday practice.
We set out to derive one or more models that met the methodological standards for development of a clinical decision rule. In particular we sought models that had strong statistical association with subarachnoid haemorrhage and that were clinically sensible and easy to use. We opted to retain the three best performing models for further evaluation, partly because of the high morbidity or mortality associated with a missed diagnosis. In addition, we had some reservation regarding arrival by ambulance as a component of any rule. While this strong predictor presumably captures a measure of severity of headache and seriousness perceived by the patient, it is also probably strongly influenced by the local pre-hospital system and might not be transferrable to regions where people have differing thresholds for calling for an ambulance. Hence, we opted to keep one model without the ambulance variable for additional study.
While we identified a few cases of misdiagnosed subarachnoid haemorrhage, most tests performed yielded negative results. Given the increased costs of medical care and increasing problems of overcrowding in emergency departments, improved diagnostic efficiency is particularly important. Use of these rules could eliminate the need for any tests without missing any cases of subarachnoid haemorrhage for between one in five and one in 10 patients presenting to the emergency department with a headache peaking within an hour.
Forty eight enrolled patients had serious conditions other than subarachnoid haemorrhage. For these patients, it was apparent from the documentation that physicians were concerned about the possibility of other pathology before they obtained results of imaging or lumbar puncture. We did not explicitly ask physicians if they were investigating for other conditions on the study forms or exclude patients in whom subarachnoid haemorrhage was not the most probable serious diagnostic consideration. Given the heterogeneity of headache, it would be impractical to generate one clinical decision rule for all causes. Generally speaking, most other causes of serious headache would have other clinical clues (such as fever and transient or persistent neurological deficits) to help guide investigations for other significant pathology.
Our inclusion criteria allowed for patients with non-thunderclap headaches to be enrolled by specifying an onset to peak intensity of up to one hour. While this could have diluted the acuity, we note that the reported time to peak headache intensity was up to several minutes in our patients with subarachnoid haemorrhage. In addition, we excluded patients with a history of three or more similar headaches (same intensity and character) in the past over a time frame of over six months. This was intended to eliminate patients with chronic recurrent headaches, in whom our rules should not be applied. We recognise that physicians might overlook exclusion criteria when applying any decision rule and emphasise that such extrapolation is not evidence based. Another potential limitation was the lack of an established standard definition of a positive subarachnoid haemorrhage. We believe that our composite outcome is the best definition available at this time. In addition, we derived three potential clinical decision rules rather than choosing just the best performing rule, mainly on the basis that arrival by ambulance might not be useful without validation in regions with different cultural or business models for ambulance services.
As many as a third of eligible patients might not have been enrolled in this study. This is almost certainly overstating the magnitude of this potential limitation as we coded patients as being “missed” if we could not definitely determine that they did not meet the eligibility criteria. Because of poor recording, often we could not determine how rapidly the headache peaked. Hence, by default, these patients were deemed missed, even though many would probably not have peaked within one hour. This conclusion is reinforced by the lower investigation rates and lower rates of subarachnoid haemorrhage in these “missed” patients.
Finally, the proposed clinical rules need to be validated before being incorporated fully in clinical practice, as essential component of the development of any clinical decision rule. While we did carry out bootstrapping analysis for internal validation, the rules require independent validation before they can be implemented.
While the rules should not yet be used to explicitly rule out subarachnoid haemorrhage, they certainly can be considered to help to identify high risk patients. Hence, patients with any one or more of the seven findings (age ≥40, witnessed loss of consciousness, complaint of neck pain or stiffness, onset with exertion, arrival by ambulance, vomiting, diastolic blood ≥100 mm Hg or systolic blood ≥160 mm Hg) should be considered carefully for subarachnoid haemorrhage and undergo rapid and thorough investigation to rule out this life threatening condition.
The three proposed rules are being prospectively and explicitly evaluated in an ongoing study to determine their accuracy for subarachnoid haemorrhage, their interobserver agreement for interpretation, and their potential impact on investigation. Once this prospective evaluation has been completed, the optimal rule can be chosen for implementation into clinical practice. The best performing rule will allow clinicians to be more selective in determining which patients require investigation. This will improve care of patients by directing testing for those at high risk who might otherwise not be adequately investigated. At the same time, the rule should result in no computed tomography or lumbar puncture for patients at low risk, thus decreasing their morbidity from unnecessary tests.
What is already known on this topic
Subarachnoid haemorrhage can occur in emergency patients presenting with sudden severe headache, even if they are neurologically intact at initial presentation
Lumbar puncture is traditionally carried out to exclude this possibility, even if results of computed tomography are negative
Most sudden headaches are benign and self limiting; universal investigation is inefficient and involves unnecessary exposure to radiation and post-lumbar puncture headache
What this study adds
Three similar but distinct decision rules for subarachnoid haemorrhage have perfect sensitivity and are based on readily available pragmatic and consistent predictor variables
Use of any one of these rules can reduce unnecessary investigation without missing any cases of subarachnoid haemorrhage
Cite this as: BMJ 2010;341:c5204
We thank the hundreds of physicians who completed our data collection forms and all the emergency department nurses and clerks at the six study sites for their cooperation. We thank Albert E Lauwers, deputy coroner, and the Office of the Coroner of Ontario assistance with verifying outcomes. We also thank Evelyn Gilkinson (London Health Sciences Centre, London, Ontario); Erica Battram and Nicole Fortin (Ottawa Hospital, Civic Campus and General Campus, Ottawa, Ontario); Harris Lari, Leslie Saunders, Ginny Willis, and Sandy Sandilands (University of Alberta Health Sciences Centre, Edmonton, Alberta); Deborah Wright and Johanna Pak (Sunnybrook and Women’s College Health Sciences Centre, Toronto, Ontario); Kathy Bowes, Julie Richard, Deborah Crosby, and Jane Reid (Kingston General Hospital, Kingston, Ontario); and our colleagues at the Ottawa Hospital Research Institute (My-Linh Tran, Irene Harris, and Angela Marcantonio) for their assistance with this project.
Contributors: JJP developed and contributed substantially to study concept and design and secured research funding. JJP IGS, MLAS, MJB, JSL, ME, HL, and GAW participated in the study design and supervised in the recruitment of patients and management of data. All authors supervised in the conduct of the trial and data collection, drafted the manuscript and/or contributed to its revision, and approved the final version. JJP, IGS, and GAW provided statistical advice and data analysis. JJP is guarantor.
Funding: This study was funded by Ontario Ministry of Health and Long Term Care, physicians of Ontario through the Physician’s Services Incorporated Foundation (grant No 01-39), the Canadian Institutes for Health Research (grant No 67107). JJP was funded as a career scientist by the Ontario Ministry of Health and is now funded by a Canadian Institutes for Health Research New Investigator Award. IGS is a University Health Research Chair, University of Ottawa.
Competing interests: All authors have completed the Unified Competing Interest form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: no support from any institution for the submitted work; no financial relationships with any institutions that might have an interest in the submitted work in the previous 3 years; no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: The study protocol was approved by the research ethics boards at each centre without the need for written informed consent as patients continued to be investigated as per current practice. Participants were informed that they could be contacted by telephone for an update on their status, and verbal consent was obtained at the time of the telephone call.
Data sharing: No additional data available.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/2.0/ and http://creativecommons.org/licenses/by-nc/2.0/legalcode.