Heterogeneity in clinical research data quality monitoring: A national survey

INTRODUCTION Clinical research is vital in the discovery of new medical knowledge and reducing disease risk in humans. In clinical research poor data quality is one of the major problems, affecting data integrity and the generalisability of the research findings. To achieve high quality data, guidance needs to be provided to clinical studies on the collection, processing and handling of data. However, clinical trials are implementing ad hoc, pragmatic approaches to ensure data quality. This study aims to explore the procedures for ensuring data quality in Australian clinical research studies. MATERIAL AND METHODS We conducted a national cross-sectional, mixed-mode multi-contact (postal letter and e-mail) web-based survey of clinical researchers associated with clinical studies listed on the Australian and New Zealand Clinical Trials Registry. RESULTS Of the 3689 clinical studies contacted, 589 (16%) responded, 570 (97%) consented and 441 (77%) completed the survey. 67% clinical studies reported following national and/or international guidelines for data monitoring, with the National Statement (86%) and Good Clinical Practice Guidelines (55%) most common. Source data were most likely to be recorded on one instrument (46%), of which paper (77%) being most common. 46.4% studies did not use data management software and 55% monitored data via traditional approaches (e.g. source data verification). Training on data quality was only provided to less than half of the staff responsible for data entry (43.9%) and data monitoring (37.5%). Regression analysis on 179 (33%) respondents found a borderline significant association between intervention trials and a definition for protocol deviation and/or violation (odds 3.065, p=0.096). This may suggest when clinical trials are provided with additional guidance and resources, they are more likely to implement required procedures. Statistical strength of the full regression model was not significant χ2 (13, 179) = 15.827, p=0.259. CONCLUSION Small single-site academic clinical studies implemented ad hoc procedures to ensure data quality. Education and training are required to promote standardised practices to ensure data quality in small scale clinical trials.

[1]  Martha Sylvia,et al.  An approach to clinical data management for the doctor of nursing practice curriculum. , 2014, Journal of professional nursing : official journal of the American Association of Colleges of Nursing.

[2]  H. Kelley,et al.  The social psychology of groups , 1960 .

[3]  Lauren Houston,et al.  Assessing data quality and the variability of source data verification auditing methods in clinical research settings , 2018, J. Biomed. Informatics.

[4]  Gloria M. Miele,et al.  Using e-technologies in clinical trials. , 2015, Contemporary clinical trials.

[5]  Morgan M. Millar,et al.  Improving Response To Web and Mixed-Mode Surveys , 2011 .

[6]  Richard Barohn,et al.  Enhancing Clinical Research Professionals’ Training and Qualifications (ECRPTQ): Recommendations for Good Clinical Practice (GCP) training for investigators and study coordinators , 2017, Journal of Clinical and Translational Science.

[7]  Lauren Houston,et al.  Exploring Data Quality Management within Clinical Trials , 2018, Applied Clinical Informatics.

[8]  M. Kahn,et al.  Reporting Data Quality Assessment Results: Identifying Individual and Organizational Barriers and Solutions , 2017, EGEMS.

[9]  K. A. Ericsson,et al.  Protocol Analysis: Verbal Reports as Data , 1984 .

[10]  D. Moher,et al.  CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials , 2010, BMC medicine.

[11]  Trudie Lang,et al.  Clinical research: time for sensible global guidelines , 2011, The Lancet.

[12]  Raffaella Ravinetto,et al.  The revision of the ICH Good Clinical Practice guidelines: a missed opportunity? , 2017, Indian journal of medical ethics.

[13]  Meredith Nahm,et al.  What can we learn from a decade of database audits? The Duke Clinical Research Institute experience, 1997—2006 , 2009, Clinical trials.

[14]  A. Agresti,et al.  Statistical Methods for the Social Sciences , 1979 .

[15]  Dirk Hasenclever,et al.  Risk-adapted monitoring is not inferior to extensive on-site monitoring: Results of the ADAMON cluster-randomised study , 2017, Clinical trials.

[16]  Gordon S Doig,et al.  Failure to report protocol violations in clinical trials: a threat to internal validity? , 2011, Trials.

[17]  C. Kleppinger,et al.  Building quality in clinical trials with use of a quality systems approach. , 2010, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[18]  Heather E Ridolfo,et al.  Analyzing Cognitive Interview Data Using the Constant Comparative Method of Analysis to Understand Cross-Cultural Patterns in Survey Data , 2011 .

[19]  Jason Williams,et al.  Unmet needs for analyzing biological big data: A survey of 704 NSF principal investigators , 2017, bioRxiv.

[20]  Yangyong Zhu,et al.  The Challenges of Data Quality and Data Quality Assessment in the Big Data Era , 2015, Data Sci. J..

[21]  P. Blau Exchange and Power in Social Life , 1964 .

[22]  S Greenland,et al.  The impact of confounder selection criteria on effect estimation. , 1989, American journal of epidemiology.

[23]  Sourabh De,et al.  Hybrid approaches to clinical trial monitoring: Practical alternatives to 100% source data verification , 2011, Perspectives in clinical research.

[24]  Birgitta Johansson,et al.  Evidence-based practice: the importance of education and leadership. , 2010, Journal of nursing management.

[25]  Eric L Eisenstein,et al.  Reducing the costs of phase III cardiovascular clinical trials. , 2005, American heart journal.

[26]  Binny Krishnankutty,et al.  Data management in clinical research: An overview , 2012, Indian journal of pharmacology.

[27]  Khaled El Emam,et al.  The Use of Electronic Data Capture Tools in Clinical Trials: Web-Survey of 259 Canadian Trials , 2009, Journal of medical Internet research.

[28]  James D Neaton,et al.  Monitoring the quality of conduct of clinical trials: a survey of current practices , 2011, Clinical trials.

[29]  James F. Brinkley,et al.  Issues in biomedical research data management and analysis: needs and barriers. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[30]  Jane M Blazeby,et al.  A systematic review of on-site monitoring methods for health-care randomised controlled trials , 2013, Clinical trials.

[31]  Patrick B. Ryan,et al.  Transparent Reporting of Data Quality in Distributed Data Networks , 2015, EGEMS.

[32]  Roger Tourangeau,et al.  Cognitive Aspects of Survey Methodology: Building a Bridge Between Disciplines. , 1987 .

[33]  Abhijeet Ghosh,et al.  Perceptions of primary care staff on a regional data quality intervention in Australian general practice: a qualitative study , 2016, BMC Family Practice.

[34]  Faidra Kalakou,et al.  The impact of clinical trial monitoring approaches on data integrity and cost—a review of current literature , 2016, European Journal of Clinical Pharmacology.

[35]  Gunther Eysenbach,et al.  Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES) , 2004, Journal of medical Internet research.

[36]  Christian Ohmann,et al.  Heterogeneity prevails: the state of clinical trial data management in Europe - results of a survey of ECRIN centres , 2010, Trials.

[37]  Edmund Leach GENERAL AND ETHNOLOGY: Social Behavior: Its Elementary Forms. George Caspar Homans , 1961 .

[38]  Ping Yu,et al.  Defining and Developing a Generic Framework for Monitoring Data Quality in Clinical Research , 2018, AMIA.

[39]  K. A. Ericsson,et al.  Verbal reports as data. , 1980 .

[40]  D. Moher,et al.  CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials , 2010, BMJ : British Medical Journal.

[41]  Yong Joong Kim,et al.  Extended Risk-Based Monitoring Model, On-Demand Query-Driven Source Data Verification, and Their Economic Impact on Clinical Trial Operations , 2016, Therapeutic innovation & regulatory science.

[42]  Helvi Kyngäs,et al.  The qualitative content analysis process. , 2008, Journal of advanced nursing.

[43]  P. Harris,et al.  Research electronic data capture (REDCap) - A metadata-driven methodology and workflow process for providing translational research informatics support , 2009, J. Biomed. Informatics.

[44]  David Moher,et al.  CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. , 2010, Journal of clinical epidemiology.

[45]  Rachel L. Richesson,et al.  Introduction to Clinical Research Informatics , 2019, Health Informatics.

[46]  Kevin B Read,et al.  Adapting data management education to support clinical research projects in an academic medical center , 2019, Journal of the Medical Library Association : JMLA.

[47]  Corinne Alberti,et al.  Comparison of two data collection processes in clinical studies: electronic and paper case report forms , 2014, BMC Medical Research Methodology.

[48]  Dominic Girardi,et al.  Data Quality- and Master Data Management - A Hospital Case , 2017, eHealth.

[49]  John P. A. Ioannidis,et al.  Why Most Clinical Research Is Not Useful , 2016, PLoS medicine.

[50]  L. Moneyham,et al.  Building DNP Essential Skills in Clinical Data Management and Analysis , 2018, Nurse educator.