Clinical trial monitoring effectiveness: Remote risk-based monitoring versus on-site monitoring with 100% source data verification

BACKGROUND/AIMS Traditional on-site monitoring of clinical trials via frequent site visits and 100% source data verification is cost-consuming, and it still cannot guarantee data quality effectively. Depending on the types and designs of clinical trials, an alternative would be combining several monitoring methods, such as risk-based monitoring and remote monitoring. However, there is insufficient evidence of its effectiveness. This research compared the effectiveness of risk-based monitoring with a remote monitoring system with that of traditional on-site monitoring. METHODS With a cloud-based remote monitoring system called beagle View®, we created a remote risk-based monitoring methodology that focused only on critical data and processes. We selected a randomized controlled trial conducted at Tohoku University Hospital and randomly sampled 11 subjects whose case report forms had already been reviewed by data managers. Critical data and processes were verified retrospectively by remote risk-based monitoring; later, all data and processes were confirmed by on-site monitoring. We compared the ability of remote risk-based monitoring to detect critical data and process errors with that of on-site monitoring with 100% source data verification, including an examination of clinical trial staff workload and potential cost savings. RESULTS Of the total data points (n = 5617), 19.7% (n = 1105, 95% confidence interval = 18.7-20.7) were identified as critical. The error rates of critical data detected by on-site monitoring, remote risk-based monitoring, and data review by data managers were 7.6% (n = 84, 95% CI = 6.2-9.3), 7.6% (n = 84, 95% confidence interval = 6.2-9.3), and 3.9% (n = 43, 95% confidence interval = 2.9-5.2), respectively. The total number of critical process errors detected by on-site monitoring was 14. Of these 14, 92.9% (n = 13, 95% confidence interval = 68.5-98.7) and 42.9% (n = 6, 95% confidence interval = 21.4-67.4) of critical process errors were detected by remote risk-based monitoring and data review by data managers, respectively. The mean time clinical trial staff spent dealing with remote risk-based monitoring was 9.9 ± 5.3 (mean ± SD) min per visit per subject. Our calculations show that remote risk-based monitoring saved between 9 and 41 on-site monitoring visits, corresponding to a cost of between US$13,500 and US$61,500 per trial site. CONCLUSION Remote risk-based monitoring was able to detect critical data and process errors as well as on-site monitoring with 100% source data verification, saving travel time and monitoring costs. Remote risk-based monitoring offers an effective alternative to traditional on-site monitoring of clinical trials.

[1]  Kevin Mortimer,et al.  The Cooking and Pneumonia Study (CAPS) in Malawi: Implementation of Remote Source Data Verification , 2016, PloS one.

[2]  Yong Joong Kim,et al.  Extended Risk-Based Monitoring Model, On-Demand Query-Driven Source Data Verification, and Their Economic Impact on Clinical Trial Operations , 2016, Therapeutic innovation & regulatory science.

[3]  Gary Gensler,et al.  Central site monitoring: Results from a test of accuracy in identifying trials and sites failing Food and Drug Administration inspection , 2014, Clinical trials.

[4]  Mike Clarke,et al.  Perceived barriers and facilitators to Risk Based Monitoring in academic-led clinical trials: a mixed methods study , 2017, Trials.

[5]  Jules T. Mitchel,et al.  Evaluation of Data Entry Errors and Data Changes to an Electronic Data Capture Clinical Trial Database , 2011, Drug information journal.

[6]  Lauren Houston,et al.  Exploring Data Quality Management within Clinical Trials , 2018, Applied Clinical Informatics.

[7]  Yong Joong Kim,et al.  Risk-Based Monitoring , 2015, Therapeutic innovation & regulatory science.

[8]  J B Vermorken,et al.  Quality control in multicentric clinical trials. An experience of the EORTC Gynecological Cancer Cooperative Group. , 2000, European journal of cancer.

[9]  Stephen Young,et al.  Evaluating Source Data Verification as a Quality Control Measure in Clinical Trials , 2014, Therapeutic innovation & regulatory science.

[10]  Dirk Hasenclever,et al.  Risk-adapted monitoring is not inferior to extensive on-site monitoring: Results of the ADAMON cluster-randomised study , 2017, Clinical trials.

[11]  Manoj P. Jadhav,et al.  Risk Based Monitoring (RBM): A global study focusing on perception and merits among clinical investigational sites , 2016, Contemporary clinical trials communications.

[12]  E. B. Wilson Probable Inference, the Law of Succession, and Statistical Inference , 1927 .

[13]  Sheena McCormack,et al.  The potential for central monitoring techniques to replace on-site monitoring: findings from an international multi-centre clinical trial , 2012, Clinical trials.

[14]  John R Zalcberg,et al.  Reducing clinical trial monitoring resource allocation and costs through remote access to electronic medical records. , 2013, Journal of oncology practice.

[15]  Catrin Tudur Smith,et al.  The Value of Source Data Verification in a Cancer Clinical Trial , 2012, PloS one.

[16]  J. Scannell,et al.  Diagnosing the decline in pharmaceutical R&D efficiency , 2012, Nature Reviews Drug Discovery.

[17]  Anders Grahnén,et al.  Quality assurance within the scope of Good Clinical Practice (GCP)—what is the cost of GCP-related activities? A survey within the Swedish Association of the Pharmaceutical Industry (LIF)'s members , 2009 .

[18]  Carlos Diaz-Montana,et al.  Triggered or routine site monitoring visits for randomised controlled trials: results of TEMPER, a prospective, matched-pair study , 2018, Clinical trials.

[19]  Sourabh De,et al.  Hybrid approaches to clinical trial monitoring: Practical alternatives to 100% source data verification , 2011, Perspectives in clinical research.

[20]  Jeppe Ragnar Andersen,et al.  Impact of source data verification on data quality in clinical trials: an empirical post hoc analysis of three phase 3 randomized clinical trials. , 2015, British journal of clinical pharmacology.

[21]  Elizabeth Nielsen,et al.  A Data-Driven Approach to Risk-Based Source Data Verification , 2014, Therapeutic innovation & regulatory science.

[22]  Munish Mehra,et al.  The Life Cycle and Management of Protocol Deviations , 2014, Therapeutic innovation & regulatory science.

[23]  Catherine Timmermans,et al.  Data-driven risk identification in phase III clinical trials using central statistical monitoring , 2016, International Journal of Clinical Oncology.

[24]  Faidra Kalakou,et al.  The impact of clinical trial monitoring approaches on data integrity and cost—a review of current literature , 2016, European Journal of Clinical Pharmacology.

[25]  Michael G. Kahn,et al.  Remote Source Document Verification in Two National Clinical Trials Networks: A Pilot Study , 2013, PloS one.

[26]  Ihn Sook Jeong,et al.  Clinical Research Coordinators’ Attitude Toward Risk-Based Monitoring , 2019, Therapeutic innovation & regulatory science.

[27]  Mike Clarke,et al.  Risk based monitoring (RBM) tools for clinical trials: A systematic review. , 2016, Contemporary clinical trials.