A retrospective assessment of the KLIK PROM portal implementation using the Consolidated Framework for Implementation Research (CFIR)

The KLIK Patient-Reported Outcome Measure (PROM) portal is an evidence-based intervention implemented in clinical practice in > 25 Dutch hospitals for patients (children and adults) who regularly visit the outpatient clinic. Implementation science frameworks can be used to understand why implementation succeeded or failed, to structure barriers and enablers, and to develop implementation strategies to overcome barriers. This paper aimed to (A) retrospectively describe determinants of successful KLIK PROM implementation using the Consolidated Framework for Implementation Research (CFIR), and (B) identify current barriers and match implementation strategies. (A) The KLIK implementation process was described retrospectively based on literature and experience, using the 39 CFIR constructs organized in five general domains: intervention characteristics, outer setting, inner setting, characteristics of individuals, and implementation process. (B) The CFIR-Expert Recommendations for Implementing Change (ERIC) Implementation Strategy Matching tool identified current barriers in the KLIK implementation and matched implementation strategies that addressed the identified barriers. (A) The most prominent determinants of successful KLIK PROM implementation lie in the following CFIR domains: intervention characteristics (e.g., easy to use), characteristics of individuals (e.g., motivation), and process of implementation (e.g., support). (B) 13 CFIR constructs were identified as current barriers for implementing the KLIK PROM portal. The highest overall advised ERIC strategy for the specific KLIK barriers was to identify and prepare champions. Using an implementation science framework, e.g., CFIR, is recommended for groups starting to use PROMs in clinical care as it offers a structured approach and provides insight into possible enablers and barriers.

[1]  J. Greenhalgh.  The applications of PROs in clinical practice: what are they, do they work, and why? , 2009, Quality of Life Research.

[2]  M. Kris,et al.  Overall Survival Results of a Trial Assessing Patient-Reported Outcomes for Symptom Monitoring During Routine Cancer Treatment , 2017, JAMA.

[3]  M. Grootenhuis,et al.  Clinicians’ perspective on the implemented KLIK PROM portal in clinical practice , 2020, Quality of Life Research.

[4]  Roma Maguire,et al.  What is the value of the routine use of patient-reported outcome measures toward improvement of patient outcomes, processes of care, and health service outcomes in cancer care? A systematic review of controlled trials. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  David A. Chambers,et al.  Implementation Research in Mental Health Services: an Emerging Science with Conceptual, Methodological, and Training challenges , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[6]  Jacqueline A. ter Stege,et al.  Patient-Reported Outcome Measurement in Clinical Dermatological Practice: Relevance and Feasibility of a Web-Based Portal , 2015, Dermatology.

[7]  Frank J. Snoek,et al.  Monitoring and Discussing Health-Related Quality of Life in Adolescents With Type 1 Diabetes Improve Psychosocial Well-Being , 2008, Diabetes Care.

[8]  Martha A. Grootenhuis,et al.  Options for the Interpretation of and Recommendations for Acting on Different PROMs in Daily Clinical Practice Using KLIK , 2019, Medical care.

[9]  Lotte Haverman,et al.  Monitoring health-related quality of life in paediatric practice: development of an innovative web-based application , 2011, BMC pediatrics.

[10]  Jeffrey A. Johnson,et al.  Measuring Quality of Life in Paediatric Patients , 1999, PharmacoEconomics.

[11]  P. Nilsen.  Making sense of implementation theories, models and frameworks , 2015, Implementation Science.

[12]  Richard Beasley,et al.  External validity of randomised controlled trials in asthma: to whom do the results of the trials apply? , 2006, Thorax.

[13]  David Feeny,et al.  Training clinicians in how to use patient-reported outcome measures in routine clinical practice , 2015, Quality of Life Research.

[14]  Michel Wensing,et al.  Real‐world implementation of electronic patient‐reported outcomes in outpatient pediatric cancer care , 2017, Psycho-oncology.

[15]  Anna Beurskens,et al.  Implementation of a Patient Reported Experience Measure in a Dutch disability care organisation: a qualitative study , 2020, Journal of Patient-Reported Outcomes.

[16]  Alicia C. Bunger,et al.  Outcomes for Implementation Research: Conceptual Distinctions, Measurement Challenges, and Research Agenda , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[17]  Lotte Haverman,et al.  Development and implementation of a patient reported outcome intervention (QLIC-ON PROfile) in clinical paediatric oncology practice. , 2010, Patient education and counseling.

[18]  Lillian Sung,et al.  Priorities for quality care in pediatric oncology supportive care. , 2015, Journal of oncology practice.

[19]  Huibert J. Tange,et al.  A systematic review on the implementation of eHealth interventions for informal caregivers of people with dementia , 2018, Internet interventions.

[20]  J. B. van Goudoever,et al.  Implementation of electronic Patient Reported Outcomes in pediatric daily clinical practice: the KLIK experience , 2013 .

[21]  Chris Feudtner,et al.  Symptoms and Distress in Children With Advanced Cancer: Prospective Patient-Reported Outcomes From the PediQUEST Study. , 2015, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[22]  M. Fekkes,et al.  Development and psychometric evaluation of the TAPQOL: A health-related quality of life instrument for 1–5-year-old children , 2004, Quality of Life Research.

[23]  Henrica C W de Vet,et al.  Specific agreement on dichotomous outcomes can be calculated for more than two raters. , 2017, Journal of clinical epidemiology.

[24]  Christophe Letellier,et al.  Two-Year Survival Comparing Web-Based Symptom Monitoring vs Routine Surveillance Following Treatment for Lung Cancer , 2019, JAMA.

[25]  Lotte Haverman,et al.  Effectiveness of a Web-Based Application to Monitor Health-Related Quality of Life , 2013, Pediatrics.

[26]  J. Kirchner,et al.  A refined compilation of implementation strategies: results from the Expert Recommendations for Implementing Change (ERIC) project , 2015, Implementation Science.

[27]  Galina Velikova,et al.  Measuring quality of life in routine oncology practice improves communication and patient well-being: a randomized controlled trial. , 2004, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[28]  P. Rothwell,et al.  External validity of randomised controlled trials: “To whom do the results of this trial apply?” , 2005, The Lancet.

[29]  H. Caron,et al.  Reporting health‐related quality of life scores to physicians during routine follow‐up visits of pediatric oncology patients: Is it effective? , 2012, Pediatric blood & cancer.

[30]  Chris Feudtner,et al.  Improving the care of children with advanced cancer by using an electronic patient-reported feedback intervention: results from the PediQUEST randomized controlled trial. , 2014, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[31]  Brenton G. Abadie,et al.  Choosing implementation strategies to address contextual barriers: diversity in recommendations and future directions , 2019, Implementation Science.

[32]  John Brazier,et al.  The facilitators and barriers to implementing patient reported outcome measures in organisations delivering health related services: a systematic review of reviews , 2018, Journal of Patient-Reported Outcomes.

[33]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[34]  F. Snoek,et al.  Follow‐up results on monitoring and discussing health‐related quality of life in adolescent diabetes care: benefits do not sustain in routine practice , 2009, Pediatric diabetes.

[35]  Claire F. Snyder,et al.  What do these scores mean? Presenting patient‐reported outcomes data to patients and clinicians to improve interpretability , 2017, Cancer.

[36]  Amy P Abernethy,et al.  Review of electronic patient-reported outcomes systems used in cancer clinical care. , 2014, Journal of oncology practice.

[37]  T. Paulussen,et al.  Determinants of innovation within health care organizations: literature review and Delphi study. , 2004, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[38]  N. Aaronson,et al.  Health-related quality-of-life assessments and patient-physician communication: a randomized controlled trial. , 2002, JAMA.

[39]  Chris Feudtner,et al.  Symptom Monitoring in Pediatric Oncology Using Patient-Reported Outcomes: Why, How, and Where Next , 2018, The Patient - Patient-Centered Outcomes Research.

[40]  Jana Witt,et al.  Perspectives of patients, family caregivers and health professionals on the use of outcome measures in palliative care and lessons for implementation: a multi-method qualitative study. , 2018, Annals of palliative medicine.

[41]  Michael Seid,et al.  The PedsQL 4.0 as a pediatric population health measure: feasibility, reliability, and validity. , 2003, Ambulatory pediatrics : the official journal of the Ambulatory Pediatric Association.

[42]  Henna Hasson,et al.  Systematic evaluation of implementation fidelity of complex interventions in health and social care , 2010, Implementation science : IS.