Formal representation of eligibility criteria: A literature review

Standards-based, computable knowledge representations for eligibility criteria are increasingly needed to provide computer-based decision support for automated research participant screening, clinical evidence application, and clinical research knowledge management. We surveyed the literature and identified five aspects of eligibility criteria knowledge representation that contribute to the various research and clinical applications: the intended use of computable eligibility criteria, the classification of eligibility criteria, the expression language for representing eligibility rules, the encoding of eligibility concepts, and the modeling of patient data. We consider three of these aspects (expression language, codification of eligibility concepts, and patient data modeling) to be essential constructs of a formal knowledge representation for eligibility criteria. The requirements for each of the three knowledge constructs vary for different use cases, which therefore should inform the development and choice of the constructs toward cost-effective knowledge representation efforts. We discuss the implications of our findings for standardization efforts toward knowledge representation for sharable and computable eligibility criteria.

[1]  Robert A. Jenders,et al.  Towards improved knowledge sharing: assessment of the HL7 Reference Information Model to support medical logic module queries , 1997, AMIA.

[2]  Carol Friedman,et al.  Towards a comprehensive medical language processing system: methods and issues , 1997, AMIA.

[3]  Robert A. Jenders,et al.  Making the Standard More Standard: A Data and Query Model for Knowledge Representation in the Arden Syntax , 2003, AMIA.

[4]  John Fox,et al.  Comparing computer-interpretable guideline models: a case-study approach. , 2003, Journal of the American Medical Informatics Association : JAMIA.

[5]  Ram Chilukuri,et al.  Common Data Element (CDE) Management and Deployment in Clinical Trials , 2003, AMIA.

[6]  Amar K. Das,et al.  A combined data mining approach for infrequent events: analyzing HIV mutation changes based on treatment history. , 2006, Computational systems bioinformatics. Computational Systems Bioinformatics Conference.

[7]  Allen Newell,et al.  The Knowledge Level , 1989, Artif. Intell..

[8]  Li Li,et al.  Comparing ICD9-Encoded Diagnoses and NLP-Processed Discharge Summaries for Clinical Trials Pre-Screening: A Case Study , 2008, AMIA.

[9]  James R. Campbell,et al.  Synthesis of Research Paper: The SAGE Guideline Model: Achievements and Overview , 2007, J. Am. Medical Informatics Assoc..

[10]  Edith Schonberg,et al.  Matching Patient Records to Clinical Trials Using Ontologies , 2007, ISWC/ASWC.

[11]  Samson W. Tu,et al.  A flexible approach to guideline modeling , 1999, AMIA.

[12]  J. Chisholm,et al.  The Read clinical classification. , 1990, BMJ.

[13]  Bruce G. Buchanan,et al.  Using computer modeling to help identify patient subgroups in clinical data repositories , 1998, AMIA.

[14]  Chunhua Weng,et al.  Temporal knowledge representation for scheduling tasks in clinical trial protocols , 2002, AMIA.

[15]  Mark Richters,et al.  A precise approach to validating UML models and OCL constraints , 2002 .

[16]  R M Gardner,et al.  Computerized medication monitoring system. , 1976, American journal of hospital pharmacy.

[17]  Eugene Fink,et al.  Selection of patients for clinical trials: an interactive web-based system , 2004, Artif. Intell. Medicine.

[18]  Lawrence M. Fagan,et al.  T-HELPER: automated support for community-based clinical research. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[19]  Tracy Hampton Rare disease research gets boost. , 2006, JAMA.

[20]  B. Gordon Current procedural terminology , 1966 .

[21]  Scott Gustafson,et al.  caCORE: A common infrastructure for cancer informatics , 2003, Bioinform..

[22]  Eugene Fink,et al.  Experiments on the automated selection of patients for clinical trials , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[23]  John Fox,et al.  Application of Information Technology: The Syntax and Semantics of the PROforma Guideline Modeling Language , 2003, J. Am. Medical Informatics Assoc..

[24]  James J Cimino,et al.  Semantic query generation from eligibility criteria in clinical trials. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[25]  S W Tu,et al.  AIDS2: a decision-support tool for decreasing physicians' uncertainty regarding patient eligibility for HIV treatment protocols. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[26]  P M Nadkarni,et al.  The Common Data Elements for Cancer Research: Remarks on Functions and Structure , 2006, Methods of Information in Medicine.

[27]  Samson W. Tu,et al.  The Chronus II temporal database mediator , 2002, AMIA.

[28]  D. Lindberg,et al.  The Unified Medical Language System , 1993, Methods of Information in Medicine.

[29]  Aziz A. Boxwala,et al.  Decision support for clinical trial eligibility determination in breast cancer , 1999, AMIA.

[30]  Ida Sim,et al.  RuleEd, a Web-based Semantic Network Interface for Constructing and Revising Computable Eligibility Rules , 2006, AMIA.

[31]  Aziz A. Boxwala,et al.  Representation primitives, process models and patient data in computer-interpretable clinical practice guidelines: : A literature review of guideline representation models , 2002, Int. J. Medical Informatics.

[32]  Sanjay Modgil,et al.  Design-a-Trial: A Rule-Based Decision Support System for Clinical Trial Design , 2003, SGAI Conf..

[33]  Sanjay Modgil,et al.  Decision support tools for clinical trial design , 2003, Artif. Intell. Medicine.

[34]  Ida Sim,et al.  An ontology of randomized controlled trials for evidence-based practice: content specification and evaluation using the competency decomposition method , 2007 .

[35]  Atul J. Butte,et al.  Enrolling patients into clinical trials faster using RealTime Recuiting , 2000, AMIA.

[36]  Christopher G. Chute,et al.  Cancer Informatics , 2002, Health Informatics.

[37]  Omolola Ogunyemi,et al.  Description and Status Update on GELLO: a Proposed Standardized Object-Oriented Expression Language for Clinical Decision Support , 2004, MedInfo.

[38]  Samson W. Tu,et al.  Modeling Data and Knowledge in the EON Guideline Architecture , 2001, MedInfo.

[39]  Nick Booth,et al.  Using scenarios in chronic disease management guidelines for primary care , 2000, AMIA.

[40]  Yuval Shahar,et al.  Synthesis of Research: EON: A Component-Based Approach to Automation of Protocol-Directed Therapy , 1996, J. Am. Medical Informatics Assoc..

[41]  Omolola Ogunyemi,et al.  GLIF3: a representation format for sharable computer-interpretable clinical practice guidelines , 2004, J. Biomed. Informatics.

[42]  M. Hampshire,et al.  An Internet-Based Cancer Clinical Trials Matching Resource , 2005, Journal of medical Internet research.

[43]  David W. Embley,et al.  Assessing clinical trial eligibility with logic expression queries , 2008, Data Knowl. Eng..

[44]  Samson W. Tu,et al.  A virtual medical record for guideline-based decision support , 2001, AMIA.

[45]  E H Shortliffe,et al.  Computer-based screening of patients with HIV/AIDS for clinical-trial eligibility. , 1995, The Online journal of current clinical trials.

[46]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[47]  C J McDonald,et al.  A computer-based record and clinical monitoring system for ambulatory care. , 1977, American journal of public health.

[48]  David Sklar,et al.  Cross-tool communication: from protocol authoring to eligibility determination , 2001, AMIA.

[49]  Silvana Quaglini,et al.  Guideline-based careflow systems , 2000, Artif. Intell. Medicine.

[50]  J. P. Christensen,et al.  Health telematics for clinical guidelines and protocols , 1995 .

[51]  Lawrence M. Fagan,et al.  Extensions to the Time-Oriented Database Model to Support Temporal Reasoning in Medical Expert Systems , 1991, Methods of Information in Medicine.

[52]  Yuval Shahar,et al.  ASBRU: A TASK-SPECIFIC, INTENTION-BASED, AND TIME-ORIENTED LANGUAGE FOR REPRESENTING SKELETAL PLANS , 1999 .

[53]  A. Kiss,et al.  Eligibility criteria of randomized controlled trials published in high-impact general medical journals: a systematic sampling review. , 2007, JAMA.

[54]  Marek J. Sergot,et al.  Computer Support for Protocol-Based Treatment of Cancer , 1996, J. Log. Program..

[55]  Edward H. Shortliffe,et al.  ONCOCIN: An Expert System for Oncology Protocol Management , 1981, IJCAI.

[56]  S. Tu,et al.  A Methodology for Determining Patients’ Eligibility for Clinical Trials , 1993, Methods of Information in Medicine.

[57]  S. Nikiforou,et al.  Knowledge acquisition for clinical-trial selection , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[58]  Jacques Bouaud,et al.  Using OncoDoc as a computer-based eligibility screening system to improve accrual onto breast cancer clinical trials , 2001, Artif. Intell. Medicine.

[59]  John Fox,et al.  PROforma: a general technology for clinical decision support systems. , 1997, Computer methods and programs in biomedicine.

[60]  Giordano Lanzola,et al.  Flexible guideline-based patient careflow systems , 2001, Artif. Intell. Medicine.

[61]  Clement J. McDonald,et al.  Development of the Logical Observation Identifier Names and Codes (LOINC) vocabulary. , 1998, Journal of the American Medical Informatics Association : JAMIA.

[62]  Peter L. Elkin,et al.  Initializing the VA medication reference terminology using UMLS metathesaurus co-occurrences , 2002, AMIA.

[63]  C E Lipscomb,et al.  Medical Subject Headings (MeSH). , 2000, Bulletin of the Medical Library Association.

[64]  Jacques Bouaud,et al.  ONCODOC: a successful experiment of computer-supported guideline development and implementation in the treatment of breast cancer , 2001, Artif. Intell. Medicine.

[65]  김삼묘,et al.  “Bioinformatics” 특집을 내면서 , 2000 .

[66]  Donald D. Chamberlin,et al.  SEQUEL: A structured English query language , 1974, SIGFIDET '74.

[67]  Yuval Shahar,et al.  The Asgaard project: a task-specific framework for the application and critiquing of time-oriented clinical guidelines , 1998, Artif. Intell. Medicine.

[68]  Aziz A. Boxwala,et al.  Enhancing Arden Syntax for Clinical Trial Eligibility Criteria , 1999, AMIA.

[69]  Rachel L Richesson,et al.  Viewpoint: Data Standards in Clinical Research: Gaps, Overlaps, Challenges and Future Directions , 2007, J. Am. Medical Informatics Assoc..

[70]  J Rogers,et al.  Minimum data set. , 1979, Medical record news.

[71]  Fenguangzhai Song CD , 1992 .

[72]  M A Musen,et al.  A Temporal Query System for Protocol-Directed Decision Support , 1994, Methods of Information in Medicine.

[73]  Christopher G. Chute,et al.  Medical Concept Representation , 2005 .

[74]  Sridhar Mahadevan,et al.  An Expert System for Assigning Patients into Clinical Trials Based on Bayesian Networks , 1998, Journal of Medical Systems.

[75]  Jeffrey P. Krischer,et al.  Use of SNOMED CT to represent clinical research data: a semantic characterization of data items on case report forms in vasculitis research. , 2006, Journal of the American Medical Informatics Association : JAMIA.

[76]  Daniel L. Rubin,et al.  Tool support for authoring eligibility criteria for cancer trials , 1999, AMIA.