Review: Electronic Health Records and the Reliability and Validity of Quality Measures: A Review of the Literature

Previous reviews of research on electronic health record (EHR) data quality have not focused on the needs of quality measurement. The authors reviewed empirical studies of EHR data quality, published from January 2004, with an emphasis on data attributes relevant to quality measurement. Many of the 35 studies reviewed examined multiple aspects of data quality. Sixty-six percent evaluated data accuracy, 57% data completeness, and 23% data comparability. The diversity in data element, study setting, population, health condition, and EHR system studied within this body of literature made drawing specific conclusions regarding EHR data quality challenging. Future research should focus on the quality of data from specific EHR components and important data attributes for quality measurement such as granularity, timeliness, and comparability. Finally, factors associated with poor or variability in data quality need to be better understood and effective interventions developed.

[1]  M Pringle,et al.  Assessment of the completeness and accuracy of computer medical records in four practices committed to recording data on computer. , 1995, The British journal of general practice : the journal of the Royal College of General Practitioners.

[2]  D. Eddy,et al.  Enhancing performance measurement: NCQA's road map for a health information framework. National Committee for Quality Assurance. , 1999, JAMA.

[3]  K. Thiru,et al.  Systematic review of scope and quality of electronic patient record data in primary care , 2003, BMJ : British Medical Journal.

[4]  J G Williams,et al.  Measuring the Completeness and Currency of Codified Clinical Information , 2003, Methods of Information in Medicine.

[5]  M. Hornbrook,et al.  Opportunities and Challenges for Measuring Cost, Quality, and Clinical Effectiveness in Health Care , 2004, Medical care research and review : MCRR.

[6]  S. de Lusignan,et al.  An eight-step method for assessing diagnostic data quality in practice: chronic obstructive pulmonary disease as an exemplar. , 2004, Informatics in primary care.

[7]  Simon de Lusignan,et al.  An educational intervention to improve data recording in the management of ischaemic heart disease in primary care. , 2004, Journal of public health.

[8]  Mitchell J. Barnett,et al.  Assessing the accuracy of computerized medication histories. , 2004, The American journal of managed care.

[9]  Carol R. Thrush,et al.  Research Paper: Use of Electronic Medical Record Data for Quality Improvement in Schizophrenia Treatment , 2004, J. Am. Medical Informatics Assoc..

[10]  Roberto A. Rocha,et al.  Integration Challenges of Clinical Information Systems Developed Without a Shared Data Dictionary , 2004, MedInfo.

[11]  Yuchiao Chang,et al.  Measuring provider adherence to tobacco treatment guidelines: a comparison of electronic medical record review, patient survey, and provider survey. , 2005, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[12]  Harlan M Krumholz,et al.  Validity of Using an Electronic Medical Record for Assessing Quality of Care in an Outpatient Setting , 2005, Medical care.

[13]  Michael I. Lieberman,et al.  Clinical Terminology Support for a National Ambulatory Practice Outcomes Research Network , 2005, AMIA.

[14]  S de Lusignan,et al.  Quality and variability of osteoporosis data in general practice computer records: implications for disease registers. , 2005, Public health.

[15]  Dean F. Sittig,et al.  Natural language processing in the electronic medical record: assessing clinician adherence to tobacco treatment guidelines. , 2005, American journal of preventive medicine.

[16]  Stephen D. Persell,et al.  Assessing the validity of national quality measures for coronary artery disease using an electronic health record. , 2006, Archives of internal medicine.

[17]  John Powell,et al.  Sharing electronic health records: the patient view. , 2006, Informatics in primary care.

[18]  Marc M. Triola,et al.  Brief report: Failure of an electronic medical record tool to improve pain assessment documentation , 2006, Journal of General Internal Medicine.

[19]  Sterling T Bennett,et al.  Technical Brief: A Case for Manual Entry of Structured, Coded Laboratory Data from Multiple Sources into an Ambulatory Electronic Health Record , 2006, J. Am. Medical Informatics Assoc..

[20]  A. V. van Ginneken,et al.  Paper Versus Computer: Feasibility of an Electronic Medical Record in General Pediatrics , 2006, Pediatrics.

[21]  David W. Bates,et al.  Improving electronic health record (EHR) accuracy and increasing compliance with health maintenance clinical guidelines through patient access and input , 2006, Int. J. Medical Informatics.

[22]  Joseph Erdos,et al.  Measuring Performance Directly Using the Veterans Health Administration Electronic Medical Record: A Comparison With External Peer Review , 2007, Medical care.

[23]  Paul C Tang,et al.  Research Paper: Comparison of Methodologies for Calculating Quality Measures Based on Administrative Data versus Clinical Data from an Electronic Health Record System: Implications for Performance Measures , 2007, J. Am. Medical Informatics Assoc..

[24]  Kenric W. Hammond,et al.  Copying and pasting of examinations within the electronic medical record , 2007, Int. J. Medical Informatics.

[25]  R. Baron,et al.  Quality Improvement with an Electronic Health Record: Achievable, but Not Automatic , 2007, Annals of Internal Medicine.

[26]  A. Seger,et al.  Medication reconciliation in ambulatory oncology. , 2007, Joint Commission journal on quality and patient safety.

[27]  P. Varkey,et al.  Improving medication reconciliation in the outpatient setting. , 2007, Joint Commission journal on quality and patient safety.

[28]  Stephen D. Persell,et al.  Automated Review of Electronic Health Records to Assess Quality of Care for Outpatients with Heart Failure , 2007, Annals of Internal Medicine.

[29]  Serguei V. S. Pakhomov,et al.  Quality Performance Measurement Using the Text of Electronic Medical Records , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  Serguei V. S. Pakhomov,et al.  Agreement between patient-reported symptoms and their documentation in the medical record. , 2008, The American journal of managed care.

[31]  Woodruff English,et al.  Rewarding Provider Performance: Aligning Incentives in Medicare , 2008, Annals of Internal Medicine.

[32]  Sowmya R. Rao,et al.  Electronic health records in ambulatory care--a national survey of physicians. , 2008, The New England journal of medicine.

[33]  Matthias Egger,et al.  Electronic medical record systems, data quality and loss to follow-up: survey of antiretroviral therapy programmes in resource-limited settings. , 2008, Bulletin of the World Health Organization.

[34]  Karen Brandt Baldwin,et al.  Evaluating Healthcare Quality Using Natural Language Processing , 2008, Journal for healthcare quality : official publication of the National Association for Healthcare Quality.

[35]  Roberta J. Ambuehl,et al.  Prenatal Syphilis Screening Rates Measured Using Medicaid Claims and Electronic Medical Records , 2008, Sexually transmitted diseases.

[36]  Cameron Grant,et al.  Determining immunisation coverage rates in primary health care practices: A simple goal but a complex task , 2008, Int. J. Medical Informatics.

[37]  Susan Szpunar,et al.  Improving the documentation of vital signs: a business reengineering efficiency study. , 2008, Joint Commission journal on quality and patient safety.

[38]  David W. Bates,et al.  An effort to improve electronic health record medication list accuracy between visits: Patients' and physicians' response , 2008, Int. J. Medical Informatics.

[39]  D. Solomon,et al.  Measuring quality of care for rheumatic diseases using an electronic medical record , 2008, Annals of the rheumatic diseases.

[40]  Stephen D. Persell,et al.  Improving Hypertension Quality Measurement Using Electronic Health Records , 2009, Medical care.

[41]  B. Dean,et al.  Review: Use of Electronic Medical Records for Health Outcomes Research , 2009, Medical care research and review : MCRR.

[42]  Joseph Erdos,et al.  Comparison of Two VA Laboratory Data Repositories Indicates That Missing Data Vary Despite Originating From the Same Source , 2009, Medical care.

[43]  Jeffrey A. Linder,et al.  Using Electronic Health Records to Measure Physician Performance for Acute Conditions in Primary Care: Empirical Evaluation of the Community-Acquired Pneumonia Clinical Quality Measure Set , 2009, Medical care.

[44]  David W. Baker,et al.  Electronic Health Record-Based Cardiac Risk Assessment and Identification of Unmet Preventive Needs , 2009, Medical care.