Enhancing reuse of structured eligibility criteria and supporting their relaxation

Patient recruitment is one of the most important barriers to successful completion of clinical trials and thus to obtaining evidence about new methods for prevention, diagnostics and treatment. The reason is that recruitment is effort consuming. It requires the identification of candidate patients for the trial (the population under study), and verifying for each patient whether the eligibility criteria are met. The work we describe in this paper aims to support the comparison of population under study in different trials, and the design of eligibility criteria for new trials. We do this by introducing structured eligibility criteria, that enhance reuse of criteria across trials. We developed a method that allows for automated structuring of criteria from text. Additionally, structured eligibility criteria allow us to propose suggestions for relaxation of criteria to remove potentially unnecessarily restrictive conditions. We thereby increase the recruitment potential and generalizability of a trial. Our method for automated structuring of criteria enables us to identify related conditions and to compare their restrictiveness. The comparison is based on the general meaning of criteria, comprised of commonly occurring contextual patterns, medical concepts and constraining values. These are automatically identified using our pattern detection algorithm, state of the art ontology annotators and semantic taggers. The comparison uses predefined relations between the patterns, concept equivalences defined in medical ontologies, and threshold values. The result is a library of structured eligibility criteria which can be browsed using fine grained queries. Furthermore, we developed visualizations for the library that enable intuitive navigation of relations between trials, criteria and concepts. These visualizations expose interesting co-occurrences and correlations, potentially enhancing meta-research. The method for criteria structuring processes only certain types of criteria, which results in low recall of the method (18%) but a high precision for the relations we identify between the criteria (94%). Analysis of the approach from the medical perspective revealed that the approach can be beneficial for supporting trial design, though more research is needed.

[1]  L. Marks,et al.  Using technology to address recruitment issues in the clinical trial process. , 2002, Trends in biotechnology.

[2]  Rachel L. Richesson,et al.  An informatics framework for the standardized collection and analysis of medication data in networked research , 2014, J. Biomed. Informatics.

[3]  Alan R. Aronson,et al.  Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program , 2001, AMIA.

[4]  Frank van Harmelen,et al.  Identifying Most Relevant Concepts to Describe Clinical Trial Eligibility Criteria , 2013, HEALTHINF.

[5]  Aziz A. Boxwala,et al.  Enhancing Arden Syntax for Clinical Trial Eligibility Criteria , 1999, AMIA.

[6]  Ricardo Pietrobon,et al.  The Database for Aggregate Analysis of ClinicalTrials.gov (AACT) and Subsequent Regrouping by Clinical Specialty , 2012, PloS one.

[7]  Mor Peleg,et al.  A practical method for transforming free-text eligibility criteria into computable criteria , 2011, J. Biomed. Informatics.

[8]  Chunhua Weng,et al.  Visual aggregate analysis of eligibility features of clinical trials , 2015, J. Biomed. Informatics.

[9]  S. Tu,et al.  Analysis of Eligibility Criteria Complexity in Clinical Trials , 2010, Summit on translational bioinformatics.

[10]  Alan R. Aronson,et al.  An overview of MetaMap: historical perspective and recent advances , 2010, J. Am. Medical Informatics Assoc..

[11]  Andrew J Vickers,et al.  Do we want more cancer patients on clinical trials If so, what are the barriers to greater accrual , 2008, Trials.

[12]  Chunhua Weng,et al.  EliXR-TIME: A Temporal Knowledge Representation for Clinical Research Eligibility Criteria , 2012, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[13]  Tianyong Hao,et al.  Clustering clinical trials with similar eligibility criteria features , 2014, J. Biomed. Informatics.

[14]  HeerJeffrey,et al.  D3 Data-Driven Documents , 2011 .

[15]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[16]  Chunhua Weng,et al.  Trend and Network Analysis of Common Eligibility Features for Cancer Trials in ClinicalTrials.gov , 2014, ICSH.

[17]  Chunhua Weng,et al.  Extracting temporal constraints from clinical research eligibility criteria using conditional random fields. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[18]  Philip R. O. Payne,et al.  Advancing methodologies in Clinical Research Informatics (CRI): Foundational work for a maturing field , 2014, J. Biomed. Informatics.

[19]  Peter J. Embi,et al.  Federated Aggregate Cohort Estimator (FACE): An easy to deploy, vendor neutral, multi-institutional cohort query architecture , 2014, J. Biomed. Informatics.

[20]  Xiaoying Wu,et al.  EliXR: an approach to eligibility criteria extraction and representation , 2011, J. Am. Medical Informatics Assoc..

[21]  Frank van Harmelen,et al.  Rule-Based Formalization of Eligibility Criteria for Clinical Trials , 2013, AIME.

[22]  Omolola Ogunyemi,et al.  GELLO: An Object-Oriented Query and Expression Language for Clinical Decision Support: AMIA 2003 Open Source Expo , 2003, AMIA.

[23]  Frank van Harmelen,et al.  Building a Library of Eligibility Criteria to Support Design of Clinical Trials , 2012, EKAW.

[24]  Chunhua Weng,et al.  Formal representation of eligibility criteria: A literature review , 2010, J. Biomed. Informatics.

[25]  M. Puhan,et al.  Recruitment barriers in a randomized controlled trial from the physicians' perspective – A postal survey , 2009, BMC Medical Research Methodology.

[26]  David Glasspool,et al.  Comparing semi-automatic systems for recruitment of patients to clinical trials , 2011, Int. J. Medical Informatics.

[27]  Riccardo Miotto,et al.  A Method for Probing Disease Relatedness Using Common Clinical Eligibility Criteria , 2013, MedInfo.

[28]  Frank van Harmelen,et al.  Patterns of Clinical Trial Eligibility Criteria , 2011, KR4HC.

[29]  Tianyong Hao,et al.  A Method for Analyzing Commonalities in Clinical Trial Target Populations , 2014, AMIA.

[30]  Sanjay Modgil,et al.  Design-a-Trial: A Rule-Based Decision Support System for Clinical Trial Design , 2003, SGAI Conf..

[31]  Stefano Gagliardi,et al.  The ACTIVE (Acute Cholecystitis Trial Invasive Versus Endoscopic) study: Multicenter randomized, double-blind, controlled trial of laparoscopic (LC) versus open (LTC) surgery for acute cholecystitis (AC) in adults , 2008, Trials.

[32]  Toby Reynolds Clinical trials: can technology solve the problem of low recruitment? , 2011, BMJ : British Medical Journal.

[33]  Sean Bechhofer,et al.  The OWL API: A Java API for OWL ontologies , 2011, Semantic Web.

[34]  Anca I. D. Bucur,et al.  Formalization of clinical trial eligibility criteria: Evaluation of a pattern-based approach , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[35]  S L George,et al.  Reducing patient eligibility criteria in cancer clinical trials. , 1996, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.