Electronic health record-based triggers to detect potential delays in cancer diagnosis

Background Delayed diagnosis of cancer can lead to patient harm, and strategies are needed to proactively and efficiently detect such delays in care. We aimed to develop and evaluate ‘trigger’ algorithms to electronically flag medical records of patients with potential delays in prostate and colorectal cancer (CRC) diagnosis. Methods We mined retrospective data from two large integrated health systems with comprehensive electronic health records (EHR) to iteratively develop triggers. Data mining algorithms identified all patient records with specific demographics and a lack of appropriate and timely follow-up actions on four diagnostic clues that were newly documented in the EHR: abnormal prostate-specific antigen (PSA), positive faecal occult blood test (FOBT), iron-deficiency anaemia (IDA), and haematochezia. Triggers subsequently excluded patients not needing follow-up (eg, terminal illness) or who had already received appropriate and timely care. Each of the four final triggers was applied to a test cohort, and chart reviews of randomly selected records identified by the triggers were used to calculate positive predictive values (PPV). Results The PSA trigger was applied to records of 292 587 patients seen between 1 January 2009 and 31 December 2009, and the CRC triggers were applied to 291 773 patients seen between 1 March 2009 and 28 February 2010. Overall, 1564 trigger positive patients were identified (426 PSA, 355 FOBT, 610 IDA and 173 haematochezia). Record reviews revealed PPVs of 70.2%, 66.7%, 67.5%, and 58.3% for the PSA, FOBT, IDA and haematochezia triggers, respectively. Use of all four triggers at the study sites could detect an estimated 1048 instances of delayed or missed follow-up of abnormal findings annually and 47 high-grade cancers. Conclusions EHR-based triggers can be used successfully to flag patient records lacking follow-up of abnormal clinical findings suspicious for cancer.

[1]  Sowmya R. Rao,et al.  Use of electronic health records in U.S. hospitals. , 2009, The New England journal of medicine.

[2]  G A Noskin,et al.  Active surveillance using electronic triggers to detect adverse events in hospitalized patients , 2006, Quality and Safety in Health Care.

[3]  Jonathan R. Nebeker,et al.  Informatics Tools for the Development of Action-Oriented Triggers for Outpatient Adverse Drug Events , 2008, AMIA.

[4]  Hardeep Singh,et al.  Reducing referral delays in colorectal cancer diagnosis: is it about how you ask? , 2010, Quality and Safety in Health Care.

[5]  Traber Davis,et al.  Characteristics and predictors of missed opportunities in lung cancer diagnosis: an electronic health record-based study. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[6]  George Hripcsak,et al.  Mining complex clinical data for patient safety research: a framework for event discovery , 2003, J. Biomed. Informatics.

[7]  Hardeep Singh,et al.  Errors in cancer diagnosis: current understanding and future directions. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  M. Gulliford,et al.  Alarm symptoms in early diagnosis of cancer in primary care: cohort study using General Practice Research Database , 2007, BMJ : British Medical Journal.

[9]  D. Classen,et al.  Methodology and rationale for the measurement of harm with trigger tools , 2003, Quality & safety in health care.

[10]  D. Fisher,et al.  Barriers to Full Colon Evaluation for a Positive Fecal Occult Blood Test , 2006, Cancer Epidemiology Biomarkers & Prevention.

[11]  Dean F. Sittig,et al.  Timely follow-up of abnormal diagnostic imaging test results in an outpatient setting: are electronic medical records achieving their potential? , 2009, Archives of internal medicine.

[12]  Mba DrPH Dong Wook Shin MD,et al.  Delay to Curative Surgery Greater than 12 Weeks Is Associated with Increased Mortality in Patients with Colorectal and Breast Cancer but Not Lung or Thyroid Cancer , 2013, Annals of Surgical Oncology.

[13]  Clement J. McDonald,et al.  Electronic medical records and preserving primary care physicians' time: comment on "electronic health record-based messages to primary care providers". , 2012, Archives of Internal Medicine.

[14]  Amy Leader,et al.  Is the Promise of Cancer-Screening Programs Being Compromised? Quality of Follow-Up Care after Abnormal Screening Results , 2003, Medical care research and review : MCRR.

[15]  R S Evans,et al.  Computerized surveillance of adverse drug events in hospital patients* , 1991, Quality and Safety in Health Care.

[16]  S. Waxman,et al.  Legal aspects of men's genitourinary health , 2009, International Journal of Impotence Research.

[17]  Lisa V Rubenstein,et al.  Measuring the Quality of Colorectal Cancer Screening: The Importance of Follow-Up , 2006, Diseases of the colon and rectum.

[18]  Hardeep Singh,et al.  Exploring situational awareness in diagnostic errors in primary care , 2011, BMJ quality & safety.

[19]  Barbara J. Grosz,et al.  Natural-Language Processing , 1982, Artificial Intelligence.

[20]  Dean F Sittig,et al.  Electronic health record-based messages to primary care providers: valuable information or just noise? , 2012, Archives of internal medicine.

[21]  S. Mcfall,et al.  Lack of Follow-up of Prostate-Specific Antigen Test Results , 2009, Public health reports.

[22]  H. Koenig,et al.  Prostate-Specific Antigen-Based Screening for Prostate Cancer , 2011 .

[23]  T. Brennan,et al.  Missed and Delayed Diagnoses in the Ambulatory Setting: A Study of Closed Malpractice Claims , 2006, Annals of Internal Medicine.

[24]  L L Roos,et al.  Using computers to identify complications after surgery. , 1985, American journal of public health.

[25]  Terry L Wahls,et al.  Patient- and system-related barriers for the earlier diagnosis of colorectal cancer , 2009, BMC family practice.

[26]  Hardeep Singh,et al.  Identifying diagnostic errors in primary care using an electronic screening algorithm. , 2007, Archives of internal medicine.

[27]  J. Frankovich,et al.  Evidence-based medicine in the EMR era. , 2011, The New England journal of medicine.

[28]  S Macdonald,et al.  Risk factors for delayed presentation and referral of symptomatic cancer: evidence for common cancers , 2009, British Journal of Cancer.

[29]  Roshan Bastani,et al.  Interventions to improve follow‐up of abnormal findings in cancer screening , 2004, Cancer.

[30]  Hardeep Singh,et al.  Using a Multifaceted Approach to Improve the Follow-Up of Positive Fecal Occult Blood Test Results , 2009, The American Journal of Gastroenterology.

[31]  Dean F Sittig,et al.  Notification of abnormal lab test results in an electronic medical record: do any safety concerns remain? , 2010, The American journal of medicine.

[32]  N L Jain,et al.  Respiratory Isolation of Tuberculosis Patients Using Clinical Guidelines and an Automated Clinical Decision Support System , 1998, Infection Control & Hospital Epidemiology.

[33]  Stephanie L. Shimada,et al.  Applying Trigger Tools to Detect Adverse Events Associated With Outpatient Surgery , 2011, Journal of patient safety.

[34]  B. G. Blijenberg,et al.  Prostate-cancer mortality at 11 years of follow-up. , 2012, The New England journal of medicine.

[35]  R. Phillips,et al.  Learning from malpractice claims about negligent, adverse events in primary care in the United States , 2004, Quality and Safety in Health Care.

[36]  Hardeep Singh,et al.  Missed Opportunities to Initiate Endoscopic Evaluation for Colorectal Cancer Diagnosis , 2009, The American Journal of Gastroenterology.

[37]  P. Conway,et al.  Identifying causes of adverse events detected by an automated trigger tool through in-depth analysis , 2010, Quality and Safety in Health Care.

[38]  N. Franklin,et al.  Diagnostic error in internal medicine. , 2005, Archives of internal medicine.

[39]  Allen Kachalia,et al.  Cognitive Errors and Logistical Breakdowns Contributing to Missed and Delayed Diagnoses of Breast and Colorectal Cancers: A Process Analysis of Closed Malpractice Claims , 2012, Journal of General Internal Medicine.

[40]  Steven B. Zeliadt,et al.  What Happens After an Elevated PSA Test: The Experience of 13,591 Veterans , 2010, Journal of General Internal Medicine.

[41]  David C Classen,et al.  Getting moving on patient safety--harnessing electronic data for safer care. , 2011, The New England journal of medicine.

[42]  Robert A McNutt,et al.  Missed hypothyroidism diagnosis uncovered by linking laboratory and pharmacy data. , 2005, Archives of internal medicine.

[43]  David W. Bates,et al.  A computerized method for identifying incidents associated with adverse drug events in outpatients , 2001, Int. J. Medical Informatics.

[44]  Stephen L. Hillis,et al.  Prevalence of delayed clinician response to elevated prostate-specific antigen values. , 2008, Mayo Clinic proceedings.

[45]  D. Classen,et al.  'Global trigger tool' shows that adverse events in hospitals may be ten times greater than previously measured. , 2011, Health affairs.

[46]  Mohan M. Nadkarni,et al.  Prevalence and Functionality of Electronic Health Records in Internal Medicine Continuity Clinics , 2010, Academic medicine : journal of the Association of American Medical Colleges.

[47]  R S Evans,et al.  Computerized surveillance of adverse drug events in hospital patients. 1991. , 1991, Quality & safety in health care.

[48]  P. Bowie,et al.  The preliminary development and testing of a global trigger tool to detect error and patient harm in primary-care records , 2009, Postgraduate Medical Journal.

[49]  Dean F Sittig,et al.  Notifications received by primary care practitioners in electronic health records: a taxonomy and time analysis. , 2012, The American journal of medicine.