Evaluation of colonoscopy technical skill levels by use of an objective kinematic-based system.

BACKGROUND Colonoscopy requires training and experience to ensure accuracy and safety. Currently, no objective, validated process exists to determine when an endoscopist has attained technical competence. Kinematics data describing movements of laparoscopic instruments have been used in surgical skill assessment to define expert surgical technique. We have developed a novel system to record kinematics data during colonoscopy and quantitatively assess colonoscopist performance. OBJECTIVE To use kinematic analysis of colonoscopy to quantitatively assess endoscopic technical performance. DESIGN Prospective cohort study. SETTING Tertiary-care academic medical center. POPULATION This study involved physicians who perform colonoscopy. INTERVENTION Application of a kinematics data collection system to colonoscopy evaluation. MAIN OUTCOME MEASUREMENTS Kinematics data, validated task load assessment instrument, and technical difficulty visual analog scale. RESULTS All 13 participants completed the colonoscopy to the terminal ileum on the standard colon model. Attending physicians reached the terminal ileum quicker than fellows (median time, 150.19 seconds vs 299.86 seconds; p<.01) with reduced path lengths for all 4 sensors, decreased flex (1.75 m vs 3.14 m; P=.03), smaller tip angulation, reduced absolute roll, and lower curvature of the endoscope. With performance of attending physicians serving as the expert reference standard, the mean kinematic score increased by 19.89 for each decrease in postgraduate year (P<.01). Overall, fellows experienced greater mental, physical, and temporal demand than did attending physicians. LIMITATION Small cohort size. CONCLUSION Kinematic data and score calculation appear useful in the evaluation of colonoscopy technical skill levels. The kinematic score appears to consistently vary by year of training. Because this assessment is nonsubjective, it may be an improvement over current methods for determination of competence. Ongoing studies are establishing benchmarks and characteristic profiles of skill groups based on kinematics data.

[1]  Raúl San José Estépar,et al.  EUS with CT improves efficiency and structure identification over conventional EUS. , 2007, Gastrointestinal endoscopy.

[2]  Rajesh Aggarwal,et al.  Proving the Effectiveness of Virtual Reality Simulation for Training in Laparoscopic Surgery , 2007, Annals of surgery.

[3]  K. Vosburgh,et al.  Assessing Technical Skill in Surgery and Endoscopy: A Set of Metrics and an Algorithm (C-PASS) to Assess Skills in Surgical and Endoscopic Procedures , 2007, Surgical innovation.

[4]  Chetan S Modi,et al.  Computer-simulation training for knee and shoulder arthroscopic surgery. , 2010, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[5]  Petros Faloutsos,et al.  Support vector machines improve the accuracy of evaluation for the performance of laparoscopic training tasks , 2009, Surgical Endoscopy.

[6]  Paolo Dario,et al.  Modelling and Evaluation of Surgical Performance Using Hidden Markov Models , 2006, IEEE Transactions on Biomedical Engineering.

[7]  Antony J. Hodgson,et al.  Feasibility of Using Intraoperatively-Acquired Quantitative Kinematic Measures to Monitor Development of Laparoscopic Skill , 2007, MMVR.

[8]  Yoon Tae Jeen,et al.  An adequate level of training for technical competence in screening and diagnostic colonoscopy: a prospective multicenter evaluation of the learning curve. , 2008, Gastrointestinal endoscopy.

[9]  G. Fried,et al.  Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. , 2004, Surgery.

[10]  Blake Hannaford,et al.  The Red DRAGON: A Multi-Modality System for Simulation and Training in Minimally Invasive Surgery , 2007, MMVR.

[11]  A. G. Gallagher,et al.  Construct validation of the ProMIS simulator using a novel laparoscopic suturing task , 2005, Surgical Endoscopy And Other Interventional Techniques.

[12]  Michelle A. Anderson,et al.  Renewal of and proctoring for endoscopic privileges. , 2008, Gastrointestinal endoscopy.

[13]  Rajesh Aggarwal,et al.  An Evaluation of the Feasibility, Validity, and Reliability of Laparoscopic Skills Assessment in the Operating Room , 2007, Annals of surgery.