LERM (Logical Elements Rule Method): A method for assessing and formalizing clinical rules for decision support

PURPOSE The aim of this study was to create a step-by-step method for transforming clinical rules for use in decision support, and to validate this method for usability and reliability. METHODS A sample set of clinical rules was identified from the relevant literature. Using an iterative approach with a focus group of mixed clinical and informatics experts, a method was developed for assessing and formalizing clinical rules. Two assessors then independently applied the method to a separate validation set of rules. Usability was assessed in terms of the time required and the error rate, and reliability was assessed by comparing the results of the two assessors. RESULTS The resulting method, called the Logical Elements Rule Method, consists of 7 steps: (1) restate the rule proactively; (2) restate the rule as a logical statement (preserving key phrases); (3) assess for conflict between rules; (4) identify concepts which are not needed; (5) classify concepts as crisp or fuzzy, find crisp definitions corresponding to fuzzy concepts, and extract data elements from crisp concepts; (6) identify rules which are related by sharing patients, actions, etc.; (7) determine availability of data in local systems. Validation showed that the method was usable with rules from various sources and clinical conditions, and reliable between users provided that the users agree on a terminology and agree on when the rule will be evaluated. CONCLUSIONS A method is presented to assist in assessing clinical rules for their amenability to decision support, and formalizing the rules for implementation. Validation shows that the method is usable and reliable between users. Use of a terminology increases reliability but also the error rate. The method is useful for future developers of systems which offer decision support based on clinical rules.

[1]  Kristin Niemi,et al.  Implementation and evaluation of electronic clinical decision support for compliance with pneumonia and heart failure quality indicators. , 2009, American journal of health-system pharmacy : AJHP : official journal of the American Society of Health-System Pharmacists.

[2]  Michael G Shaw,et al.  Expert Clinical Rules Automate Steps in Delivering Evidence-based Care in the Electronic Health Record , 2006, Computers, informatics, nursing : CIN.

[3]  M. Donaldson.  Measuring the Quality of Health Care: A Statement by The National Roundtable on Health Care Quality , 1999 .

[4]  John Fox,et al.  Comparing computer-interpretable guideline models: a case-study approach. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[5]  H. Krumholz,et al.  Improving the quality of care for Medicare patients with acute myocardial infarction: results from the Cooperative Cardiovascular Project. , 1998, JAMA.

[6]  M. S. Kirkman,et al.  Comment on: American Diabetes Association. Standards of Medical Care in Diabetes—2011. Diabetes Care 2011;34(Suppl. 1):S11–S61 , 2011 .

[7]  Bernd Blobel,et al.  A development framework for semantically interoperable health information systems , 2009, Int. J. Medical Informatics.

[8]  Silvia Miksch,et al.  Tracing the Formalization Steps of Textual Guidelines , 2004, CGP.

[9]  I. Scott,et al.  What are the most effective strategies for improving quality and safety of health care? , 2009, Internal medicine journal.

[10]  Arie Hasman,et al.  A parallel guideline development and formalization strategy to improve the quality of clinical practice guidelines , 2009, Int. J. Medical Informatics.

[11]  D. Khanna,et al.  Measuring process of arthritis care: the Arthritis Foundation's quality indicator set for rheumatoid arthritis. , 2006, Seminars in arthritis and rheumatism.

[12]  Molla S. Donaldson,et al.  Measuring the Quality of Health Care , 1999 .

[13]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[14]  L. Diamond,et al.  Forum of the End-Stage Renal Disease Networks' role in implementing the National Kidney Foundation-Dialysis Outcomes Quality Initiative Clinical Practice Guidelines. , 1999, Advances in renal replacement therapy.

[15]  Joanna E. Klopotowska,et al.  Gebruik van procesindicatoren voor kwaliteitsmeting van farmacotherapeutische ouderenzorg bij polyfarmacie , 2009 .

[16]  Katharina Kaiser,et al.  Versioning computer-interpretable guidelines: Semi-automatic modeling of 'Living Guidelines' using an information extraction method , 2009, Artif. Intell. Medicine.

[17]  G Hripcsak,et al.  Writing Arden Syntax Medical Logic Modules. , 1994, Computers in biology and medicine.

[18]  Richard N. Shiffman,et al.  Bmc Medical Informatics and Decision Making the Guideline Implementability Appraisal (glia): Development of an Instrument to Identify Obstacles to Guideline Implementation , 2022 .

[19]  A. Sauaia,et al.  Influencing Care in Acute Myocardial Infarction: A Randomized Trial Comparing 2 Types of Intervention , 2000, American journal of medical quality : the official journal of the American College of Medical Quality.

[20]  V. Basevi.  Standards of medical care in diabetes--2007. , 2009, Diabetes care.

[21]  J. Marc Overhage,et al.  Arthritis Quality Indicators for the Veterans Administration: Implications for Electronic Data Collection, Storage Format, Quality Assessment, and Clinical Decision Support , 2007, AMIA.

[22]  Yuval Shahar,et al.  A framework for a distributed, hybrid, multiple-ontology clinical-guideline library, and automated guideline-support tools , 2004, J. Biomed. Informatics.

[23]  W G Henderson,et al.  Improving residents' compliance with standards of ambulatory care: results from the VA Cooperative Study on Computerized Reminders. , 2000, JAMA.

[24]  Richard N. Shiffman,et al.  Model Formulation: GEM: A Proposal for a More Comprehensive Guideline Document Model Using XML , 2000, J. Am. Medical Informatics Assoc..

[25]  Kent A. Spackman,et al.  SNOMED clinical terms: overview of the development process and project status , 2001, AMIA.

[26]  Richard N. Shiffman,et al.  Model Formulation: Representation of Clinical Practice Guidelines in Conventional and Augmented Decision Tables , 1997, J. Am. Medical Informatics Assoc..

[27]  Vojtech Svátek,et al.  Step-by-step mark-up of medical guideline documents , 2003, Int. J. Medical Informatics.

[28]  Lemuel R Waitman,et al.  Improved compliance with quality measures at hospital discharge with a computerized physician order entry system. , 2006, American heart journal.

[29]  H. Cohen,et al.  Assessing Care of Vulnerable Elders‐3 Quality Indicators , 2007, Journal of the American Geriatrics Society.

[30]  Franz Baader,et al.  SNOMED reaching its adolescence: Ontologists' and logicians' health check , 2009, Int. J. Medical Informatics.