Exploring Data Quality Management within Clinical Trials

BACKGROUND Clinical trials are an important research method for improving medical knowledge and patient care. Multiple international and national guidelines stipulate the need for data quality and assurance. Many strategies and interventions are developed to reduce error in trials, including standard operating procedures, personnel training, data monitoring, and design of case report forms. However, guidelines are nonspecific in the nature and extent of necessary methods. OBJECTIVE This article gathers information about current data quality tools and procedures used within Australian clinical trial sites, with the aim to develop standard data quality monitoring procedures to ensure data integrity. METHODS Relevant information about data quality management methods and procedures, error levels, data monitoring, staff training, and development were collected. Staff members from 142 clinical trials listed on the National Health and Medical Research Council (NHMRC) clinical trials Web site were invited to complete a short self-reported semiquantitative anonymous online survey. RESULTS Twenty (14%) clinical trials completed the survey. Results from the survey indicate that procedures to ensure data quality varies among clinical trial sites. Centralized monitoring (65%) was the most common procedure to ensure high-quality data. Ten (50%) trials reported having a data management plan in place and two sites utilized an error acceptance level to minimize discrepancy, set at <5% and 5 to 10%, respectively. The quantity of data variables checked (10-100%), the frequency of visits (once-a-month to annually), and types of variables (100%, critical data or critical and noncritical data audits) for data monitoring varied among respondents. The average time spent on staff training per person was 11.58 hours over a 12-month period and the type of training was diverse. CONCLUSION Clinical trial sites are implementing ad hoc methods pragmatically to ensure data quality. Findings highlight the necessity for further research into "standard practice" focusing on developing and implementing publically available data quality monitoring procedures.

[1]  P. Harris,et al.  Research electronic data capture (REDCap) - A metadata-driven methodology and workflow process for providing translational research informatics support , 2009, J. Biomed. Informatics.

[2]  Michael G. Kahn,et al.  Remote Source Document Verification in Two National Clinical Trials Networks: A Pilot Study , 2013, PloS one.

[3]  Jeppe Ragnar Andersen,et al.  Impact of source data verification on data quality in clinical trials: an empirical post hoc analysis of three phase 3 randomized clinical trials. , 2015, British journal of clinical pharmacology.

[4]  Patrick B. Ryan,et al.  Transparent Reporting of Data Quality in Distributed Data Networks , 2015, EGEMS.

[5]  Dirk Hasenclever,et al.  Risk-adapted monitoring is not inferior to extensive on-site monitoring: Results of the ADAMON cluster-randomised study , 2017, Clinical trials.

[6]  Giri Kumar Tayi,et al.  Examining data quality , 1998, CACM.

[7]  J. Steiner,et al.  A pragmatic framework for single-site and multisite data quality assessment in electronic health record-based clinical research. , 2012, Medical care.

[8]  Lauren Houston,et al.  Measuring Data Quality Through a Source Data Verification Audit in a Clinical Research Setting. , 2015, Studies in health technology and informatics.

[9]  Binny Krishnankutty,et al.  Data management in clinical research: An overview , 2012, Indian journal of pharmacology.

[10]  Udo Schüklenk,et al.  Retraction watch. , 2012, Bioethics.

[11]  Sue E Bowman.  Impact of electronic health record systems on information integrity: quality and safety implications. , 2013, Perspectives in health information management.

[12]  Jonathan M Kagan,et al.  Investigating the Efficacy of Clinical Trial Monitoring Strategies: Design and Implementation of the Cluster Randomized START Monitoring Substudy , 2015, Therapeutic innovation & regulatory science.

[13]  Meredith Nahm,et al.  What can we learn from a decade of database audits? The Duke Clinical Research Institute experience, 1997—2006 , 2009, Clinical trials.

[14]  Sheena McCormack,et al.  The potential for central monitoring techniques to replace on-site monitoring: findings from an international multi-centre clinical trial , 2012, Clinical trials.

[15]  Yang W. Lee,et al.  Developing data production maps: meeting patient discharge data submission requirements , 2004 .

[16]  Catrin Tudur Smith,et al.  The Value of Source Data Verification in a Cancer Clinical Trial , 2012, PloS one.

[17]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[18]  Rema Padman,et al.  Analyzing the Effect of Data Quality on the Accuracy of Clinical Decision Support Systems: A Computer Simulation Approach , 2006, AMIA.

[19]  Carl F. Pieper,et al.  Quantifying Data Quality for Clinical Trials Using Electronic Data Capture , 2008, PloS one.

[20]  James D Neaton,et al.  Monitoring the quality of conduct of clinical trials: a survey of current practices , 2011, Clinical trials.

[21]  Jane M Blazeby,et al.  A systematic review of on-site monitoring methods for health-care randomised controlled trials , 2013, Clinical trials.

[22]  Markus Helfert,et al.  AN EVALUATION OF DATA QUALITY RELATED PROBLEM PATTERNS IN HEALTHCARE INFORMATION SYSTEMS-RESEARCH IN PROGRESS - , 2005 .

[23]  C. Kleppinger,et al.  Building quality in clinical trials with use of a quality systems approach. , 2010, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[24]  Sylvie Chevret,et al.  Validation of a risk-assessment scale and a risk-adapted monitoring plan for academic clinical research studies--the Pre-Optimon study. , 2011, Contemporary clinical trials.

[25]  R. Franklin,et al.  Verification of data in congenital cardiac surgery , 2008, Cardiology in the Young.

[26]  Ping Yu,et al.  A Review of Data Quality Assessment Methods for Public Health Information Systems , 2014, International journal of environmental research and public health.

[27]  Veda C. Storey,et al.  A Framework for Analysis of Data Quality Research , 1995, IEEE Trans. Knowl. Data Eng..

[28]  Taghrid Obied,et al.  Oversight of clinical investigations- A risk based approach to monitoring , 2014 .

[29]  Faidra Kalakou,et al.  The impact of clinical trial monitoring approaches on data integrity and cost—a review of current literature , 2016, European Journal of Clinical Pharmacology.

[30]  Christian Ohmann,et al.  Heterogeneity prevails: the state of clinical trial data management in Europe - results of a survey of ECRIN centres , 2010, Trials.

[31]  Christian Ohmann,et al.  Standard requirements for GCP-compliant data management in multinational clinical trials , 2011, Trials.

[32]  Carlo Batini,et al.  Methodologies for data quality assessment and improvement , 2009, CSUR.

[33]  Nicola Joffe,et al.  Update on the temper study: targeted monitoring, prospective evaluation and refinement , 2013, Trials.

[34]  Sourabh De,et al.  Hybrid approaches to clinical trial monitoring: Practical alternatives to 100% source data verification , 2011, Perspectives in clinical research.

[35]  Eric L Eisenstein,et al.  Reducing the costs of phase III cardiovascular clinical trials. , 2005, American heart journal.

[36]  Tobias Mettler,et al.  European Conference on Information Systems ( ECIS ) 2008 Improving Data Quality of Health Information Systems : A Holistic Design-Oriented Approach , 2017 .

[37]  Arun Bhatt.  Quality of clinical trials: A moving target , 2011, Perspectives in clinical research.

[38]  R. Califf,et al.  Developing systems for cost-effective auditing of clinical trials. , 1997, Controlled clinical trials.

[39]  Richard Y. Wang,et al.  Data Quality Assessment , 2002 .

[40]  Nicolette de Keizer,et al.  Model Formulation: Defining and Improving Data Quality in Medical Registries: A Literature Review, Case Study, and Generic Framework , 2002, J. Am. Medical Informatics Assoc..

[41]  Yong Joong Kim,et al.  Extended Risk-Based Monitoring Model, On-Demand Query-Driven Source Data Verification, and Their Economic Impact on Clinical Trial Operations , 2016, Therapeutic innovation & regulatory science.