Employing Computers for the Recruitment into Clinical Trials: A Comprehensive Systematic Review

Background Medical progress depends on the evaluation of new diagnostic and therapeutic interventions within clinical trials. Clinical trial recruitment support systems (CTRSS) aim to improve the recruitment process in terms of effectiveness and efficiency. Objective The goals were to (1) create an overview of all CTRSS reported until the end of 2013, (2) find and describe similarities in design, (3) theorize on the reasons for different approaches, and (4) examine whether projects were able to illustrate the impact of CTRSS. Methods We searched PubMed titles, abstracts, and keywords for terms related to CTRSS research. Query results were classified according to clinical context, workflow integration, knowledge and data sources, reasoning algorithm, and outcome. Results A total of 101 papers on 79 different systems were found. Most lacked details in one or more categories. There were 3 different CTRSS that dominated: (1) systems for the retrospective identification of trial participants based on existing clinical data, typically through Structured Query Language (SQL) queries on relational databases, (2) systems that monitored the appearance of a key event of an existing health information technology component in which the occurrence of the event caused a comprehensive eligibility test for a patient or was directly communicated to the researcher, and (3) independent systems that required a user to enter patient data into an interface to trigger an eligibility assessment. Although the treating physician was required to act for the patient in older systems, it is now becoming increasingly popular to offer this possibility directly to the patient. Conclusions Many CTRSS are designed to fit the existing infrastructure of a clinical care provider or the particularities of a trial. We conclude that the success of a CTRSS depends more on its successful workflow integration than on sophisticated reasoning and data processing algorithms. Furthermore, some of the most recent literature suggest that an increase in recruited patients and improvements in recruitment efficiency can be expected, although the former will depend on the error rate of the recruitment process being replaced. Finally, to increase the quality of future CTRSS reports, we propose a checklist of items that should be included.

[1]  David A. Hanauer,et al.  Enhanced identification of eligibility for depression research using an electronic medical record search engine , 2009, Int. J. Medical Informatics.

[2]  James R. Anderson,et al.  Web-based decision support for clinical trial eligibility determination in an international clinical trials network. , 2003, Controlled clinical trials.

[3]  Mustapha Mezghanni,et al.  A clinical recruiting management system for complex multi-site clinical trials using qualification decision support systems. , 2007, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[4]  Chunhua Weng,et al.  Formal representation of eligibility criteria: A literature review , 2010, J. Biomed. Informatics.

[5]  P. Kirchhof,et al.  Routine data from hospital information systems can support patient recruitment for clinical studies , 2010, Clinical trials.

[6]  David Sklar,et al.  Cross-tool communication: from protocol authoring to eligibility determination , 2001, AMIA.

[7]  Peter J. Embi,et al.  Physician Perceptions of an Electronic Health Record-based Clinical Trial Alert System: A Survey of Study Participants , 2005, AMIA.

[8]  George Hripcsak,et al.  Caveats for the use of operational electronic health record data in comparative effectiveness research. , 2013, Medical care.

[9]  William Gilbert,et al.  The design and implementation of an open-source, data-driven cohort recruitment system: the Duke Integrated Subject Cohort and Enrollment Research Network (DISCERN) , 2012, J. Am. Medical Informatics Assoc..

[10]  Lawrence B. Afrin,et al.  Leveraging of Open EMR Architecture for Clinical Trial Accrual , 2003, AMIA.

[11]  Walter Gall,et al.  Management of data from clinical trials using the ArchiMed system , 2002, Medical informatics and the Internet in medicine.

[12]  Justin Starren,et al.  Evaluation of the google search appliance for patient cohort discovery. , 2008, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[13]  Rohit Gupta,et al.  Real Time Electronic Patient Study Enrollment System in Emergency Room , 2005, AMIA.

[14]  Claire Snowdon,et al.  Does it matter if clinicians recruiting for a trial don't understand what the trial is really about? Qualitative study of surgeons' experiences of participation in a pragmatic multi-centre RCT , 2007, Trials.

[15]  Iain E. Buchan,et al.  Preserving consent-for-consent with feasibility-assessment and recruitment in clinical studies: FARSITE architecture , 2009, HealthGrid.

[16]  Jon D. Miller,et al.  Public attitudes toward participation in cancer clinical trials. , 2003, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[17]  Sridhar Mahadevan,et al.  An Expert System for Assigning Patients into Clinical Trials Based on Bayesian Networks , 1998, Journal of Medical Systems.

[18]  Omolola Ogunyemi,et al.  Finding appropriate clinical trials: evaluating encoded eligibility criteria with incomplete data , 2001, AMIA.

[19]  Satoshi Teramukai,et al.  The correlation between the number of eligible patients in routine clinical practice and the low recruitment level in clinical trials: a retrospective study using electronic medical records , 2013, Trials.

[20]  Anthony Stell,et al.  Supporting the clinical trial recruitment process through the grid , 2006 .

[21]  Christopher G. Chute,et al.  Prospective recruitment of patients with congestive heart failure using an ad-hoc binary classifier , 2005, J. Biomed. Informatics.

[22]  Martin Overath,et al.  A special query tool in the hospital information system to recognize patients and to increase patient numbers for clinical trials. , 2012, Studies in health technology and informatics.

[23]  S W Tu,et al.  AIDS2: a decision-support tool for decreasing physicians' uncertainty regarding patient eligibility for HIV treatment protocols. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[24]  Sarah Cha,et al.  Impact of Seasonality on Recruitment, Retention, Adherence, and Outcomes in a Web-Based Smoking Cessation Intervention: Randomized Controlled Trial , 2013, Journal of medical Internet research.

[25]  Anita Burgun-Parenthoine,et al.  Using Semantic Web Technologies for Clinical Trial Recruitment , 2010, International Semantic Web Conference.

[26]  Flory Nkoy,et al.  Enhancing an Existing Clinical Information System to Improve Study Recruitment and Census Gathering Efficiency , 2009, AMIA.

[27]  Abel Kho,et al.  Information Technology in PBRNs: The Indiana University Medical Group Research Network (IUMG ResNet) Experience , 2007, The Journal of the American Board of Family Medicine.

[28]  Raphael W. Majeed,et al.  Identifying Patients for Clinical Trials Using Fuzzy Ternary Logic Expressions on HL7 Messages , 2011, MIE.

[29]  David W. Embley,et al.  Generating Medical Logic Modules for Clinical Trial Eligibility Criteria , 2003, AMIA.

[30]  Atul J Butte,et al.  Computerized recruiting for clinical trials in real time. , 2003, Annals of emergency medicine.

[31]  Troels Andreasen,et al.  Flexible Query Answering Systems: 6th International Conference, FQAS 2004, Lyon, France, June 24-26, 2004, Proceedings , 2004 .

[32]  Diego Boscá,et al.  Interoperability of clinical decision-support systems and electronic health records using archetypes: A case study in clinical trial eligibility , 2013, J. Biomed. Informatics.

[33]  Lior Rokach,et al.  Information Retrieval System for Medical Narrative Reports , 2004, FQAS.

[34]  Peter J. Embi,et al.  Physicians' perceptions of an electronic health record-based clinical trial alert approach to subject recruitment: A survey , 2008, BMC Medical Informatics Decis. Mak..

[35]  James Quinn,et al.  Implementing a Real-time Complex Event Stream Processing System to Help Identify Potential Participants in Clinical and Translational Research Studies. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[36]  D Elbourne,et al.  Recruitment to randomised trials: strategies for trial enrollment and participation study. The STEPS study. , 2007, Health technology assessment.

[37]  Chunhua Weng,et al.  Comparing the effectiveness of a clinical registry and a clinical data warehouse for supporting clinical trial recruitment: a case study. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[38]  David W. Embley,et al.  Assessing clinical trial eligibility with logic expression queries , 2008, Data Knowl. Eng..

[39]  D. Weiss,et al.  Planning patient recruitment: fantasy and reality. , 1984, Statistics in medicine.

[40]  E H Shortliffe,et al.  Computer-based screening of patients with HIV/AIDS for clinical-trial eligibility. , 1995, The Online journal of current clinical trials.

[41]  Michael A. Gold,et al.  Impact of Individual Physicians on Enrollment of Patients into Clinical Trials , 2003, American journal of clinical oncology.

[42]  M. Hampshire,et al.  An Internet-Based Cancer Clinical Trials Matching Resource , 2005, Journal of medical Internet research.

[43]  Paul A. Harris,et al.  Application of Information Technology: Clinical Research Subject Recruitment: The Volunteer for Vanderbilt Research Program www.volunteer.mc.vanderbilt.edu , 2005, J. Am. Medical Informatics Assoc..

[44]  Chunhua Weng,et al.  A real-time screening alert improves patient recruitment efficiency. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[45]  Stephen B. Johnson,et al.  Medical decision support: experience with implementing the Arden Syntax at the Columbia-Presbyterian Medical Center. , 1995, Proceedings. Symposium on Computer Applications in Medical Care.

[46]  Martin Dugas,et al.  Workflow to improve patient recruitment for clinical trials within hospital information systems – a case-study , 2008, Trials.

[47]  Madhu C. Reddy,et al.  Participatory design and an eligibility screening tool , 2000, AMIA.

[48]  M. Yokode,et al.  A pragmatic method for electronic medical record-based observational studies: developing an electronic medical records retrieval system for clinical research , 2012, BMJ Open.

[49]  R. Hornung,et al.  Effect of a clinical trial alert system on physician participation in trial recruitment. , 2005, Archives of internal medicine.

[50]  Björn Bergh,et al.  First experiences in implementing a software-based support for patient recruitment at Heidelberg university hospital. , 2012, Studies in health technology and informatics.

[51]  Victor J Stevens,et al.  Using web-based screening to enhance efficiency of HMO clinical trial recruitment in women aged forty and older , 2007, Clinical trials.

[52]  L.O. Hall,et al.  A cost-effective agent for clinical trial assignment , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[53]  R A Rudick,et al.  Using an automated recruitment process to generate an unbiased study sample of multiple sclerosis patients. , 2010, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[54]  Hans-Ulrich Prokosch,et al.  Evaluating predictive modeling algorithms to assess patient eligibility for clinical trials from routine data , 2013, BMC Medical Informatics and Decision Making.

[55]  Martin Dugas,et al.  Estimation of Patient Accrual Rates in Clinical Trials Based on Routine Data from Hospital Information Systems , 2009, Methods of Information in Medicine.

[56]  Johan van der Lei,et al.  Randomised studies in general practice: how to integrate the electronic patient record. , 2005, Informatics in primary care.

[57]  Hagop S. Mekhjian,et al.  Using an Information Warehouse to screen patients for Clinical trials: A prototype , 2005, AMIA.

[58]  Henry C. Chueh,et al.  Visual query tool for finding patient cohorts from a clinical data warehouse of the partners HealthCare system , 2000, AMIA.

[59]  Henry C. Chueh,et al.  Optimizing healthcare research data warehouse design through past COSTAR query analysis , 1999, AMIA.

[60]  William J Meurer,et al.  Utility of an automated notification system for recruitment of research subjects , 2010, Emergency Medicine Journal.

[61]  Joyce A. Mitchell,et al.  Evaluating the informatics for integrating biology and the bedside system for clinical research , 2009 .

[62]  Chunhua Weng,et al.  ECRL: an eligibility criteria representation language based on the UMLS Semantic Network. , 2008, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[63]  Atul J. Butte,et al.  Enrolling patients into clinical trials faster using RealTime Recuiting , 2000, AMIA.

[64]  Khaled Mellouli,et al.  2002 IEEE International Conference on Systems, Man, and Cybernetics : bridging the digital divide : cyber-development, human progress, peace and prosperity : Yasmine Hammamet, Tunisia, October 6-9, 2002 : conference proceedings , 2002 .

[65]  N Colabianchi,et al.  Factors that predict the referral of breast cancer patients onto clinical trials by their surgeons and medical oncologists. , 2000, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[66]  Stephanie Heinemann,et al.  A clinical trial alert tool to recruit large patient samples and assess selection bias in general practice research , 2011, BMC medical research methodology.

[67]  Adrian H. Zai,et al.  Efficacy and cost-effectiveness of an automated screening algorithm in an inpatient clinical trial , 2012, Clinical trials.

[68]  Hans-Ulrich Prokosch,et al.  Secondary use of routinely collected patient data in a clinical trial: An evaluation of the effects on patient recruitment and data acquisition , 2013, Int. J. Medical Informatics.

[69]  Eugene Fink,et al.  Experiments on the automated selection of patients for clinical trials , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[70]  Stuart Speedie,et al.  A Model for the Electronic Support of Practice-Based Research Networks , 2012, The Annals of Family Medicine.

[71]  M. Boland,et al.  Feasibility of Feature-based Indexing, Clustering, and Search of Clinical Trials , 2013, Methods of Information in Medicine.

[72]  Mor Peleg,et al.  A practical method for transforming free-text eligibility criteria into computable criteria , 2011, J. Biomed. Informatics.

[73]  G O Barnett,et al.  Conducting a matched-pairs historical cohort study with a computer-based ambulatory medical record system. , 1990, Computers and biomedical research, an international journal.

[74]  J. Denny,et al.  Naïve Electronic Health Record phenotype identification for Rheumatoid arthritis. , 2011, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[75]  Chunhua Weng,et al.  Using Personal Health Records for Automated Clinical Trials Recruitment: the ePaIRing Model , 2009, Summit on translational bioinformatics.

[76]  Jianhua Liu,et al.  Computational challenges and human factors influencing the design and use of clinical research participant eligibility pre-screening tools , 2012, BMC Medical Informatics and Decision Making.

[77]  Aziz A. Boxwala,et al.  Decision support for clinical trial eligibility determination in breast cancer , 1999, AMIA.

[78]  Richard Bache,et al.  An adaptable architecture for patient cohort identification from diverse data sources. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[79]  Li Li,et al.  Comparing ICD9-Encoded Diagnoses and NLP-Processed Discharge Summaries for Clinical Trials Pre-Screening: A Case Study , 2008, AMIA.

[80]  Lawrence M. Fagan,et al.  T-HELPER: automated support for community-based clinical research. , 1992, Proceedings. Symposium on Computer Applications in Medical Care.

[81]  Jerry L Miller,et al.  The EHR solution to clinical trial recruitment in physician groups. , 2006, Health management technology.

[82]  Peter J. Embi,et al.  Development of an Electronic Health Record-based Clinical Trial Alert System to Enhance Recruitment at the Point of Care , 2005, AMIA.

[83]  C. Gotay,et al.  Accrual to cancer clinical trials: directions from the research literature. , 1991, Social science & medicine.

[84]  L. Penberthy,et al.  Automated matching software for clinical trials eligibility: measuring efficiency and flexibility. , 2010, Contemporary clinical trials.

[85]  Vitaly Herasevich,et al.  The accuracy and efficiency of electronic screening for recruitment into a clinical trial on COPD. , 2011, Respiratory medicine.

[86]  Iain Buchan,et al.  FARSITE: evaluation of an automated trial feasibility assessment and recruitment tool , 2011, Trials.

[87]  Joe Kesterson,et al.  Comparing methods for identifying pancreatic cancer patients using electronic data sources. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[88]  Brian Boswell,et al.  Desktop software to identify patients eligible for recruitment into a clinical trial: using SARMA to recruit to the ROAD feasibility trial. , 2010, Informatics in primary care.

[89]  George Hripcsak,et al.  Bias Associated with Mining Electronic Health Records , 2011, Journal of biomedical discovery and collaboration.

[90]  Sara T Brookes,et al.  A review of reporting of participant recruitment and retention in RCTs in six major journals , 2009, Trials.

[91]  F Olesen,et al.  Identifying patients for research in general practice. , 1996, Scandinavian journal of primary health care.

[92]  Nicole Urban,et al.  Using a Population-Based Cancer Registry for Recruitment of Newly Diagnosed Patients With Ovarian Cancer , 2005, American journal of clinical oncology.

[93]  Jesualdo Tomás Fernández-Breis,et al.  Leveraging electronic healthcare record standards and semantic web technologies for the identification of patient cohorts. , 2013, Journal of the American Medical Informatics Association : JAMIA.

[94]  J. Quinn,et al.  A real-time tracking, notification, and web-based enrollment system for emergency department research. , 2004, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[95]  Stephen B. Johnson,et al.  A review of approaches to identifying patient phenotype cohorts using electronic health records , 2013, J. Am. Medical Informatics Assoc..

[96]  P M Ellis,et al.  Attitudes towards and participation in randomised clinical trials in oncology: a review of the literature. , 2000, Annals of oncology : official journal of the European Society for Medical Oncology.

[97]  Satoshi Morita,et al.  Physicians' reasons for not entering their patients in a randomized controlled trial in Japan. , 2004, The Tohoku journal of experimental medicine.

[98]  M. Kelner,et al.  Interpreting physician participation in randomized clinical trials: the Physician Orientation Profile. , 1987, Journal of health and social behavior.

[99]  D. Hunninghake,et al.  Recruitment experience in clinical trials: literature summary and annotated bibliography. , 1987, Controlled clinical trials.

[100]  Henry C. Chueh,et al.  Calculating the Benefits of a Research Patient Data Repository , 2006, AMIA.

[101]  W M Tierney,et al.  Application of Information Technology: Pilot Study of a Point-of-use Decision Support Tool for Cancer Clinical Trials Eligibility , 1999, J. Am. Medical Informatics Assoc..

[102]  Johan van der Lei,et al.  A randomized database study in general practice yielded quality data but patient recruitment in routine consultation was not practical. , 2006, Journal of clinical epidemiology.

[103]  Ronan A Lyons,et al.  The Health Informatics Trial Enhancement Project (HITE): Using routinely collected primary care data to identify potential participants for a depression trial , 2010, Trials.

[104]  Marguerite Swietlik,et al.  Research Subject Enrollment by Primary Care Pediatricians Using an Electronic Health Record , 2007, AMIA.

[105]  D Kalra,et al.  Electronic health records: new opportunities for clinical research , 2013, Journal of internal medicine.

[106]  Yugyung Lee,et al.  MindTrial: An Intelligent System for Clinical Trials. , 2010, AMIA ... Annual Symposium proceedings. AMIA Symposium.

[107]  Jun Zhang,et al.  Automatic patient search for breast cancer clinical trials using free-text medical reports , 2010, IHI.

[108]  Edith Schonberg,et al.  Matching Patient Records to Clinical Trials Using Ontologies , 2007, ISWC/ASWC.

[109]  David Glasspool,et al.  Comparing semi-automatic systems for recruitment of patients to clinical trials , 2011, Int. J. Medical Informatics.

[110]  Eugene Fink,et al.  Selection of patients for clinical trials: an interactive web-based system , 2004, Artif. Intell. Medicine.

[111]  David S. C. Thompson,et al.  Sepsis Alert and Diagnostic System: Integrating Clinical Systems to Enhance Study Coordinator Efficiency , 2003, Computers, informatics, nursing : CIN.

[112]  M. Deering,et al.  User-Centered Research on Breast Cancer Patient Needs and Preferences of an Internet-Based Clinical Trial Matching System , 2007, Journal of medical Internet research.

[113]  Marjorie Coristine,et al.  Barriers and facilitators to enrollment in cancer clinical trials , 2002, Cancer.

[114]  Xiaoying Wu,et al.  EliXR: an approach to eligibility criteria extraction and representation , 2011, J. Am. Medical Informatics Assoc..

[115]  David W. Embley,et al.  Formulating Queries for Assessing Clinical Trial Eligibility , 2006, NLDB.

[116]  Jeffrey P. Krischer,et al.  An automated communication system in a contact registry for persons with rare diseases: scalable tools for identifying and recruiting clinical research participants. , 2009, Contemporary clinical trials.

[117]  Vitaly Herasevich,et al.  Enrollment into a time sensitive clinical study in the critical care setting: results from computerized septic shock sniffer implementation , 2011, J. Am. Medical Informatics Assoc..

[118]  S. Tu,et al.  A Methodology for Determining Patients’ Eligibility for Clinical Trials , 1993, Methods of Information in Medicine.

[119]  Jacques Bouaud,et al.  Using OncoDoc as a computer-based eligibility screening system to improve accrual onto breast cancer clinical trials , 2001, Artif. Intell. Medicine.

[120]  K Canfield,et al.  Improving the efficiency of patient recruitment with an automated telephone screening system in a client-server environment. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[121]  Gary S. Fischer,et al.  Comparison of Electronic Physician Prompts versus Waitroom Case-Finding on Clinical Trial Enrollment , 2008, Journal of General Internal Medicine.

[122]  Mack T Ruffin,et al.  Using Patient Monetary Incentives and Electronically Derived Patient Lists to Recruit Patients to a Clinical Trial , 2011, The Journal of the American Board of Family Medicine.

[123]  Sanjukta Bhanja,et al.  A Qualitative Expert System for Clinical Trial Assignment , 1998, FLAIRS.

[124]  Claire Ballinger,et al.  Recruitment to a clinical trial from the databases of specialists in Parkinson's disease. , 2007, Parkinsonism & related disorders.

[125]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[126]  Peter J. Embi,et al.  Evaluating alert fatigue over time to EHR-based clinical trial alerts: findings from a randomized controlled study , 2012, J. Am. Medical Informatics Assoc..

[127]  Chunhua Weng,et al.  Case Report: Electronic Screening Improves Efficiency in Clinical Trial Recruitment , 2009, J. Am. Medical Informatics Assoc..

[128]  Benjamin Trinczek,et al.  Design and multicentric Implementation of a generic Software Architecture for Patient Recruitment Systems re-using existing HIS tools and Routine Patient Data , 2014, Applied Clinical Informatics.