Methods for certification in colonoscopy – a systematic review

Abstract Introduction: Reliable, valid, and feasible assessment tools are essential to ensure competence in colonoscopy. This study aims to provide an overview of the existing assessment methods and the validity evidence that supports them. Methods: A systematic search was conducted in October 2016. Pubmed, EMBASE, and PsycINFO were searched for studies evaluating assessment methods to ensure competency in colonoscopy. Outcome variables were described and evidence of validity was explored using a contemporary framework. Results: Twenty-five observational studies were included in the systematic review. Most studies were based on small sample sizes. The studies were categorized after outcome measures into five groups: Clinical process related outcome metrics (n = 2), direct observational colonoscopy assessment (n = 8), simulator based metrics (n = 11), automatic computerized metrics (n = 2), and self-assessment (n = 1). Validity score varied among the studies and only five studies presented sufficient evidence to recommend the tool for clinical assessment. Conclusions: The objectives vary throughout the presented tools. Some tools are global tools where others focus on procedural technical skill assessment or even part-task skills. There is a tendency in the most recent studies towards more specific assessment of technical skills. The majority of assessment methods lack sufficient validity evidence.

[1]  Steven M. Downing,et al.  Assessment in Health Professions Education , 2009 .

[2]  R. Sedlack.  Training to competency in colonoscopy: assessing and defining competency standards. , 2011, Gastrointestinal endoscopy.

[3]  K. Parakh.  Assessment in medical education. , 2007, The New England journal of medicine.

[4]  H. McKenna.  The Delphi technique: a worthwhile research approach for nursing? , 1994, Journal of advanced nursing.

[5]  E. Kuipers,et al.  Competence Measurement During Colonoscopy Training: The Use of Self-Assessment of Performance Measures , 2012, The American Journal of Gastroenterology.

[6]  S. Downing.  Validity: on the meaningful interpretation of assessment data , 2003, Medical education.

[7]  J. Norcini,et al.  Setting standards on educational tests , 2003, Medical education.

[8]  C. Thompson,et al.  Development and initial validation of an endoscopic part-task training box , 2014, Endoscopy.

[9]  L. Konge,et al.  Assessment of colonoscopy by use of magnetic endoscopic imaging: design and validation of an automated tool. , 2015, Gastrointestinal endoscopy.

[10]  D. Cook,et al.  What is the validity evidence for assessments of clinical teaching? , 2005, Journal of General Internal Medicine.

[11]  G. Fried,et al.  How should we establish the clinical case numbers required to achieve proficiency in flexible endoscopy? , 2010, American journal of surgery.

[12]  Michael Fordis,et al.  Accuracy of physician self-assessment compared with observed measures of competence: a systematic review. , 2006, JAMA.

[13]  G. Fried,et al.  Fundamentals of endoscopic surgery: creation and validation of the hands-on test , 2013, Surgical Endoscopy.

[14]  W. McGaghie,et al.  Simulations in Assessment , 2009, Assessment in Health Professions Education.

[15]  S. Sarker,et al.  Procedural performance in gastrointestinal endoscopy: an assessment and self-appraisal tool. , 2008, American journal of surgery.

[16]  J. R. Barton,et al.  The validity and reliability of a Direct Observation of Procedural Skills assessment tool: assessing colonoscopic skills of senior endoscopists. , 2012, Gastrointestinal endoscopy.

[17]  R. Reznick,et al.  Teaching and testing technical skills. , 1993, American journal of surgery.

[18]  B. Jacobson,et al.  Reliability of adenoma detection rate is based on procedural volume. , 2013, Gastrointestinal endoscopy.

[19]  Douglas K. Rex,et al.  Quality Indicators for Colonoscopy , 2006, Gastrointestinal endoscopy.

[20]  G. Fried,et al.  ASGE's assessment of competency in endoscopy evaluation tools for colonoscopy and EGD. , 2014, Gastrointestinal endoscopy.

[21]  I. Kim,et al.  Should Assessment of Quality Indicator of Colonoscopy Be Varied Depending on the Colonoscopic Technique Level? , 2016, Digestive Diseases and Sciences.

[22]  S. Downing.  Threats to the validity of clinical teaching assessments: What about rater error? , 2005, Medical education.

[23]  Yoon Tae Jeen,et al.  An adequate level of training for technical competence in screening and diagnostic colonoscopy: a prospective multicenter evaluation of the learning curve. , 2008, Gastrointestinal endoscopy.

[24]  E. Kuipers,et al.  Performance measures for lower gastrointestinal endoscopy: a European Society of Gastrointestinal Endoscopy (ESGE) quality improvement initiative , 2017, United European gastroenterology journal.

[25]  R. Sedlack.  Assessing fellow skills: practice what you preach, measure what you teach. , 2015, Gastrointestinal endoscopy.

[26]  Erik J. Schoon,et al.  Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy , 2007, Surgical Endoscopy.

[27]  E. M. Ritter,et al.  Simulated Colonoscopy Objective Performance Evaluation (SCOPE): a non-computer-based tool for assessment of endoscopic skills , 2013, Surgical Endoscopy.

[28]  Pichamol Jirapinyo,et al.  Validation of an endoscopic part-task training box as a skill assessment tool. , 2015, Gastrointestinal endoscopy.

[29]  F. Bazzoli,et al.  Colonic gallstone ileus treated with radiologically guided extracorporeal shock wave lithotripsy followed by endoscopic extraction , 2012, Endoscopy.

[30]  C. Noesgaard,et al.  Comparison of Self- and Faculty-Directed Learning of Psychomotor Skills , 1998, Advances in health sciences education : theory and practice.

[31]  C Senore,et al.  European guidelines for quality assurance in colorectal cancer screening and diagnosis. First Edition – Quality assurance in endoscopy in colorectal cancer screening and diagnosis , 2012, Endoscopy.

[32]  J. Pearl,et al.  Validity evidence for the Simulated Colonoscopy Objective Performance Evaluation scoring system. , 2014, American journal of surgery.

[33]  P. Pfau,et al.  Surgical resident’s training in colonoscopy: numbers, competency, and perceptions , 2010, Surgical Endoscopy.

[34]  Syed G. Shah,et al.  Effect of real-time magnetic endoscope imaging on the teaching and acquisition of colonoscopy skills: results from a single trainee. , 2003, Endoscopy.

[35]  D. McNamara,et al.  Towards continuous improvement of endoscopy standards: validation of a colonoscopy assessment form , 2012, Colorectal disease : the official journal of the Association of Coloproctology of Great Britain and Ireland.

[36]  Raúl San José Estépar,et al.  Evaluation of colonoscopy technical skill levels by use of an objective kinematic-based system. , 2011, Gastrointestinal endoscopy.

[37]  Robert E Sedlack,et al.  The Mayo Colonoscopy Skills Assessment Tool: validation of a unique instrument to assess colonoscopy skills in trainees. , 2010, Gastrointestinal endoscopy.

[38]  Stephan Riek,et al.  Construct validation of a physical model colonoscopy simulator. , 2012, Gastrointestinal endoscopy.

[39]  Benjamin K. Poulose,et al.  Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy , 2010, Surgical Endoscopy.

[40]  C. Hassan,et al.  Efficacy and cost-effectiveness of screening colonoscopy according to the adenoma detection rate , 2015, United European gastroenterology journal.

[41]  Christopher D. Jensen,et al.  Variation in Adenoma Detection Rate and the Lifetime Benefits and Cost of Colorectal Cancer Screening: A Microsimulation Model. , 2015, JAMA.

[42]  G. Ginsberg,et al.  Poor discriminatory function for endoscopic skills on a computer-based simulator. , 2009, Gastrointestinal endoscopy.

[43]  B. Enestvedt,et al.  ASGE's assessment of competency in endoscopy evaluation tools for colonoscopy and EGD. , 2014, Gastrointestinal endoscopy.

[44]  G. Hoff,et al.  An explorative study from the Norwegian Quality Register Gastronet comparing self-estimated versus registered quality in colonoscopy performance , 2016, Endoscopy international open.

[45]  G. Fried,et al.  Colonoscopy performance correlates with scores on the FES™ manual skills test , 2014, Surgical Endoscopy.

[46]  Steven M. Downing,et al.  Validation of a Colonoscopy Simulation Model for Skills Assessment , 2007, The American Journal of Gastroenterology.

[47]  R. Aggarwal,et al.  Assessing Technical Competence in Surgical Trainees: A Systematic Review. , 2015, Annals of surgery.

[48]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. , 2010, International journal of surgery.

[49]  R. Reznick,et al.  Gastrointestinal Endoscopy Competency Assessment Tool: development of a procedure-specific assessment tool for colonoscopy. , 2014, Gastrointestinal endoscopy.

[50]  C. Walsh,et al.  Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy. , 2012, The Cochrane database of systematic reviews.

[51]  L. Konge,et al.  Combining different methods improves assessment of competence in colonoscopy , 2017, Scandinavian journal of gastroenterology.

[52]  R. Reznick,et al.  Gastrointestinal Endoscopy Competency Assessment Tool: reliability and validity evidence. , 2015, Gastrointestinal endoscopy.

[53]  Mark Benson,et al.  Colonoscopy training in gastroenterology fellowships: determining competence. , 2010, Gastrointestinal endoscopy.

[54]  Siwan Thomas-Gibson,et al.  Training and transfer of colonoscopy skills: a multinational, randomized, blinded, controlled trial of simulator versus bedside training. , 2010, Gastrointestinal endoscopy.