BMJ  2003;326:1070 (17 May), doi:10.1136/bmj.326.7398.1070

Primary care

Systematic review of scope and quality of electronic patient record data in primary care

Krish Thiru, research fellow1, Alan Hassey, general practitioner1, Frank Sullivan, general practitioner2

1 Fisher Medical Centre Research Unit, Skipton, North Yorkshire BD23 1EU, 2 Tayside Centre for General Practice, University of Dundee, Dundee DD2 4AD

Correspondence to: K Thiru krish.thiru{at}st-marys.nhs.uk

Objective To systematically review measures of data quality in electronic patient records (EPRs) in primary care.

Design Systematic review of English language publications, 1980-2001.

Data sources Bibliographic searches of medical databases, specialist medical informatics databases, conference proceedings, and institutional contacts.

Study selection Studies selected according to a predefined framework for categorising review papers.

Data extraction Reference standards and measurements used to judge quality.

Results Bibliographic searches identified 4589 publications. After primary exclusions 174 articles were classified, 52 of which met the inclusion criteria for review. Selected studies were primarily descriptive surveys. Variability in methods prevented meta-analysis of results. Forty eight publications were concerned with diagnostic data, 37 studies measured data quality, and 15 scoped EPR quality. Reliability of data was assessed with rate comparison. Measures of sensitivity were highly dependent on the element of EPR data being investigated, while the positive predictive value was consistently high, indicating good validity. Prescribing data were generally of better quality than diagnostic or lifestyle data.

Conclusion The lack of standardised methods for assessment of quality of data in electronic patient records makes it difficult to compare results between studies. Studies should present data quality measures with clear numerators, denominators, and confidence intervals. Ambiguous terms such as "accuracy" should be avoided unless precisely defined.


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to StumbleUpon StumbleUpon   Add to Technorati Technorati    What's this?

This article has been cited by other articles:

  • Dean, B. B., Lam, J., Natoli, J. L., Butler, Q., Aguilar, D., Nordyke, R. J. (2009). Review: Use of Electronic Medical Records for Health Outcomes Research: A Literature Review. Med Care Res Rev 66: 611-638 [Abstract]  
  • Esteban-Vasallo, M., Dominguez-Berjon, M., Astray-Mochales, J, Genova-Maleras, R, Perez-Sania, A, Sanchez-Perruca, L, Aguilera-Guzman, M, Gonzalez-Sanz, F. (2009). Epidemiological usefulness of population-based electronic clinical records in primary care: estimation of the prevalence of chronic diseases. Fam Pract 26: 445-454 [Abstract] [Full text]  
  • Floor-Schreudering, A., De Smet, P. A., Buurma, H., Egberts, A. C., Bouvy, M. L (2009). Documentation Quality in Community Pharmacy: Completeness of Electronic Patient Records After Patients' First Visits. The Annals of Pharmacotherapy 43: 1787-1794 [Abstract] [Full text]  
  • Ong, D. S. Y., Kuyvenhoven, M. M., van Dijk, L., Verheij, T. J. M. (2008). Antibiotics for respiratory, ear and urinary tract disorders and consistency among GPs. J Antimicrob Chemother 62: 587-592 [Abstract] [Full text]  
  • Soler, J.-K., Okkes, I., Wood, M., Lamberts, H. (2008). The coming of age of ICPC: celebrating the 21st birthday of the International Classification of Primary Care. Fam Pract 25: 312-317 [Abstract] [Full text]  
  • Majeed, A., Car, J., Sheikh, A. (2008). Accuracy and completeness of electronic patient records in primary care. Fam Pract 25: 213-214 [Full text]  
  • Gormley, G., Connolly, D., Catney, D., Freeman, L., Murray, L. J, Gavin, A. (2008). Reporting of research data by GPs: a cautionary tale for primary care researchers. Fam Pract 25: 209-212 [Abstract] [Full text]  
  • Voorham, J., Haaijer-Ruskamp, F. M., Stolk, R. P., Wolffenbuttel, B. H.R., Denig, P., the Groningen Initiative to Analyze Type 2 Diabete, (2008). Influence of Elevated Cardiometabolic Risk Factor Levels on Treatment Changes in Type 2 Diabetes. Diabetes Care 31: 501-503 [Abstract] [Full text]  
  • Lam, K., Parkin, T., Riggs, C., Morgan, K. (2007). Use of free text clinical records in identifying syndromes and analysing health data. Vet Rec. 161: 547-551 [Abstract] [Full text]  
  • Gadzhanova, S., Iankov, I. I., Warren, J. R., Stanek, J., Misan, G. M., Baig, Z., Ponte, L. (2007). Developing High-specificity Anti-hypertensive Alerts by Therapeutic State Analysis of Electronic Prescribing Records. J. Am. Med. Inform. Assoc. 14: 100-109 [Abstract] [Full text]  
  • de Lusignan, S., Belsey, J., Hague, N., Dhoul, N., van Vlymen, J. (2006). Audit-based education to reduce suboptimal management of cholesterol in primary care: a before and after study. J Public Health (Oxf) 28: 361-369 [Abstract] [Full text]  
  • Brouwer, H., Bindels, P., Weert, H. (2006). Data quality improvement in general practice. Fam Pract 23: 529-536 [Abstract] [Full text]  
  • Jordan, K., Porcheret, M., Kadam, U. T., Croft, P. (2006). The use of general practice consultation databases in rheumatology research. Rheumatology (Oxford) 45: 126-128 [Full text]  
  • Linder, J. A., Bates, D. W., Williams, D. H., Connolly, M. A., Middleton, B. (2006). Acute Infections in Primary Care: Accuracy of Electronic Diagnoses and Electronic Antibiotic Prescribing. J. Am. Med. Inform. Assoc. 13: 61-66 [Abstract] [Full text]  
  • Hamilton, W, Peters, T J, Round, A, Sharp, D (2005). What are the clinical features of lung cancer before the diagnosis is made? A population based case-control study. Thorax 60: 1059-1065 [Abstract] [Full text]  
  • Buurma, H., De Smet, P. A., Kruijtbosch, M., Egberts, A. C. (2005). Disease and Intolerability Documentation in Electronic Patient Records. The Annals of Pharmacotherapy 39: 1640-1646 [Abstract] [Full text]  
  • Feron, J M, Paulus, D, Tonglet, R, Lorant, V, Pestiaux, D (2005). Substantial use of primary health care by prisoners: epidemiological description and possible explanations. J. Epidemiol. Community Health 59: 651-655 [Abstract] [Full text]  
  • Han, Y., Huh, S. J., Ju, S. G., Ahn, Y. C., Lim, D. H., Lee, J. E., Park, W. (2005). Impact of an Electronic Chart on the Staff Workload in a Radiation Oncology Department. Jpn J Clin Oncol 35: 470-474 [Abstract] [Full text]  
  • Delpierre, C., Cuzin, L., Fillaux, J., Alvarez, M., Massip, P., Lang, T. (2004). A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach?. Int J Qual Health Care 16: 407-416 [Abstract] [Full text]  
  • Jordan, K., Porcheret, M., Croft, P. (2004). Quality of morbidity coding in general practice computerized medical records: a systematic review. Fam Pract 21: 396-412 [Abstract] [Full text]  
  • Morris, C J, Rodgers, S, Hammersley, V S, Avery, A J, Cantrill, J A (2004). Indicators for preventable drug related morbidity: application in primary care. Qual Saf Health Care 13: 181-185 [Abstract] [Full text]  
  • Winkelman, W. J, Leonard, K. J (2004). Overcoming Structural Constraints to Patient Utilization of Electronic Medical Records: A Critical Review and Proposal for an Evaluation Framework. J Am Med Inform Assoc 11: 151-161 [Abstract] [Full text]  
  • Stengel, D., Bauwens, K., Walter, M., Kopfer, T., Ekkernkamp, A. (2004). Comparison of Handheld Computer-Assisted and Conventional Paper Chart Documentation of Medical Records. A Randomized, Controlled Trial. JBJS 86: 553-560 [Abstract] [Full text]  
  • Winkelman, W. J., Leonard, K. J. (2004). Overcoming Structural Constraints to Patient Utilization of Electronic Medical Records: A Critical Review and Proposal for an Evaluation Framework. J. Am. Med. Inform. Assoc. 11: 151-161 [Abstract] [Full text]  
  • Porcheret, M., Hughes, R., Evans, D., Jordan, K., Whitehurst, T., Ogden, H., Croft, P., on behalf of the North Staffordshire General Pract, (2004). Data Quality of General Practice Electronic Health Records: The Impact of a Program of Assessments, Feedback, and Training. J Am Med Inform Assoc 11: 78-86 [Abstract] [Full text]  
  • Porcheret, M., Hughes, R., Evans, D., Jordan, K., Whitehurst, T., Ogden, H., Croft, P. (2004). Data Quality of General Practice Electronic Health Records: The Impact of a Program of Assessments, Feedback, and Training. J. Am. Med. Inform. Assoc. 11: 78-86 [Abstract] [Full text]  

Rapid Responses:

Read all Rapid Responses

EUNICE should sort EPR's!
Alex G Manning
bmj.com, 17 May 2003 [Full text]
Electronic medical writing: A prescription for clarity?
Javier Rodríguez-Vera, et al.
bmj.com, 21 May 2003 [Full text]
Time to move from diagnostic codes to disease complexes
K Thiru, et al.
bmj.com, 29 May 2003 [Full text]



Access jobs at BMJ Careers
Whats new online at Student 

BMJ