A Rapid Process for Identifying and Prioritizing Technology-Based Tools for Health System Implementation

Background Health system decisions to put new technologies into clinical practice require a rapid and trustworthy decision-making process informed by best evidence. Objective This study aimed to present a rapid evidence review process that can be used to inform health system leaders and clinicians seeking to implement new technology tools to improve patient-clinician decision making and patient-oriented outcomes. Methods The rapid evidence review process we pioneered involved 5 sequential subprocesses: (1) environmental scan, (2) expert panel recruitment, (3) host evidence review panel, (4) analysis, and (5) local validation panel. We conducted an environmental scan of health information technology (IT) literature to identify relevant digital tools in oncology care. We synthesized the recent literature using current evidence review methods, creating visual summaries for use by a national panel of experts. Panelists were taken through a 6-hour modified Delphi process to prioritize tools for implementation. Findings from the rapid evidence review panel were taken to a local validation panel for further rapid review during a 3-hour session. Results Our rapid evidence review process shows promise for informing decision making by reducing the amount of time and resources needed to identify and prioritize adoption of IT tools. Despite evidence of improved patient outcomes, panelists had substantial concerns about implementing patient-reported outcome tracking tools, voicing concerns about liability, lack of familiarity with new technology, and additional time and workflow changes such tools would require. Instead, clinicians favored technologies that did not require clinician involvement. Conclusions Health system leaders can use the rapid evidence review process presented here to usefully inform local technology adoption, implementation, and use in practice.

[1]  C. Petersen,et al.  Balancing Between Privacy and Patient Needs for Health Information in the Age of Participatory Health and Social Media: A Scoping Review , 2018, Yearbook of Medical Informatics.

[2]  R. Hayward,et al.  Beyond the Randomized Clinical Trial the Role of Effectiveness Studies in Evaluating Cardiovascular Therapies the Achilles' Heel of Rcts Key Issues in Outcomes Research , 2022 .

[3]  Cornelia M. Ruland,et al.  Effects of a computer-supported interactive tailored patient assessment tool on patient care, symptom distress, and patients' need for symptom management support: a randomized clinical trial , 2010, J. Am. Medical Informatics Assoc..

[4]  Joanne Greenhalgh,et al.  Implementing patient-reported outcomes assessment in clinical practice: a review of the options and considerations , 2012, Quality of Life Research.

[5]  Julie Polisena,et al.  RAPID REVIEW: AN EMERGING APPROACH TO EVIDENCE SYNTHESIS IN HEALTH TECHNOLOGY ASSESSMENT , 2014, International Journal of Technology Assessment in Health Care.

[6]  Alireza Ahmadvand CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions , 2011 .

[7]  Steven N Goodman,et al.  The research-treatment distinction: a problematic approach for determining which activities should have ethical oversight. , 2013, The Hastings Center report.

[8]  S. Woolf The meaning of translational research and why it matters. , 2008, JAMA.

[9]  H. Mcdonald,et al.  Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. , 2005, JAMA.

[10]  James Beebe,et al.  Basic Concepts and Techniques of Rapid Appraisal , 1995 .

[11]  Gerd A. Kullak-Ublick,et al.  3.5 Clinical Decision Support Systems , 2012 .

[12]  Jorge A. Gálvez,et al.  A systematic review of near real-time and point-of-care clinical decision support in anesthesia information management systems , 2017, Journal of Clinical Monitoring and Computing.

[13]  Craig E. Kuziemsky,et al.  A Framework for Incorporating Patient Preferences to Deliver Participatory Medicine via Interdisciplinary Healthcare Teams , 2014, AMIA.

[14]  Douglas S. Bell,et al.  A conceptual framework and protocol for defining clinical decision support objectives applicable to medical specialties , 2012, BMC Medical Informatics and Decision Making.

[15]  Amit G Singal,et al.  A Primer on Effectiveness and Efficacy Trials , 2014, Clinical and Translational Gastroenterology.

[16]  M. Hotopf,et al.  It’s a long shot, but it just might work! Perspectives on the future of medicine , 2016, BMC Medicine.

[17]  Paul E. Johnson,et al.  Impact of Electronic Health Record Clinical Decision Support on Diabetes Care: A Randomized Trial , 2011, The Annals of Family Medicine.

[18]  J. Westfall,et al.  Practice-based research--"Blue Highways" on the NIH roadmap. , 2007, JAMA.

[19]  E. Shortliffe Clinical decision-support systems , 1990 .

[20]  Geoffrey M. Curran,et al.  Effectiveness-implementation Hybrid Designs: Combining Elements of Clinical Effectiveness and Implementation Research to Enhance Public Health Impact , 2012, Medical care.

[21]  Robyn Bluhm,et al.  From Hierarchy to Network: a richer view of evidence for evidence-based medicine , 2005, Perspectives in biology and medicine.

[22]  Sandy Oliver,et al.  Rapid evidence assessments of research to inform social policy: taking stock and moving forward , 2013 .

[23]  Karen R. Sepucha,et al.  Ten Years, Forty Decision Aids, And Thousands Of Patient Uses: Shared Decision Making At Massachusetts General Hospital. , 2016, Health affairs.

[24]  Roma Maguire,et al.  What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[25]  Richard Baker,et al.  A checklist for identifying determinants of practice: A systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice , 2013, Implementation Science.

[26]  Susan Sheridan,et al.  The PCORI Engagement Rubric: Promising Practices for Partnering in Research , 2017, The Annals of Family Medicine.

[27]  B. Burnand,et al.  The RAND/UCLA Appropriateness Method User's Manual , 2001 .

[28]  P. Memiah,et al.  The utility of the environmental scan for public health practice: lessons from an urban program to increase cancer screening. , 2005, Journal of the National Medical Association.

[29]  G. Velikova,et al.  Development of an integrated electronic platform for patient self-report and management of adverse events during cancer treatment , 2017, Annals of oncology : official journal of the European Society for Medical Oncology.

[30]  E. Basch Patient-Reported Outcomes - Harnessing Patients' Voices to Improve Clinical Care. , 2017, The New England journal of medicine.

[31]  E. Balas,et al.  Improving clinical practice using clinical decision support systems: a systematic review of trials to identify features critical to success , 2005, BMJ : British Medical Journal.

[32]  Julie Polisena,et al.  Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods , 2015, Systematic Reviews.

[33]  Xiping Song,et al.  Understanding requirements for computer-aided healthcare workflows: experiences and challenges , 2006, ICSE '06.

[34]  Amy P Abernethy,et al.  Review of electronic patient-reported outcomes systems used in cancer clinical care. , 2014, Journal of oncology practice.

[35]  Heleen Riper,et al.  The Pace of Technologic Change: Implications for Digital Health Behavior Intervention Research. , 2016, American journal of preventive medicine.

[36]  Rob Sanson-Fisher,et al.  Tailored and Integrated Web-Based Tools for Improving Psychosocial Outcomes of Cancer Patients: The DoTTI Development Framework , 2014, Journal of medical Internet research.

[37]  G. Guyatt,et al.  The impact of measuring patient-reported outcomes in clinical practice: a systematic review of the literature , 2008, Quality of Life Research.

[38]  Deborah Schrag,et al.  Symptom Monitoring With Patient-Reported Outcomes During Routine Cancer Treatment: A Randomized Controlled Trial. , 2016, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[39]  Jos Kleijnen,et al.  What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. , 2012, International journal of evidence-based healthcare.

[40]  Jonathan M. Teich,et al.  Grand challenges in clinical decision support , 2008, J. Biomed. Informatics.

[41]  James Beebe,et al.  Rapid Assessment Process: An Introduction , 2001 .