Surgical Skill Assessment Using Motion Quality and Smoothness.

OBJECTIVES This article presents a quantitative technique to assess motion quality and smoothness during the performance of micromanipulation tasks common to surgical maneuvers. The objective is to investigate the effectiveness of the jerk index, a derivative of acceleration with respect to time, as a kinetostatic measure for assessment of surgical performance. DESIGN A surgical forceps was instrumented with a position tracker and accelerometer that allowed measurement of position and acceleration relative to tool motion. Participants were asked to perform peg-in-hole tasks on a modified O'Connor Dexterity board and a Tweezer Dexterity pegboard (placed inside a skull). Normalized jerk index was calculated for each individual task to compare smoothness of each group. SETTING This study was conducted at Project neuroArm, Cumming School of Medicine, the University of Calgary. PARTICIPANTS Four groups of participants (surgeons, surgery residents, engineers, and gamers) participated in the tests. RESULTS Results showed that the surgeons exhibited better jerk index performance in all tasks. Moreover, the residents experienced motions closer to the surgeons compared to the engineers and gamers. One-way analysis of variance test indicated a significant difference between the mean values of normalized jerk indices among 4 groups during the performance of all tasks. Moreover, the mean value of the normalized jerk index significantly varied for each group from one task to another. CONCLUSIONS Normalized jerk index as an independent parameter with respect to time and amplitude is an indicator of motion smoothness and can be used to assess hand motion dexterity of surgeons. Furthermore, the method provides a quantifiable metrics for trainee assessment and proficiency, particularly relevant as surgical training shifts toward a competency-based paradigm.

[1]  Naoki Hirabayashi,et al.  Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room , 2012, Surgery Today.

[2]  Yaser Maddahi,et al.  Performance Evaluation of a Surgical Telerobotic System Using Kinematic Indices of the Master Hand-Controller , 2014, EuroHaptics.

[3]  Teodor P Grantcharov,et al.  Training tomorrow’s surgeons: what are we looking for and how can we achieve it? , 2009, ANZ journal of surgery.

[4]  Jonathan Sherbino,et al.  The role of assessment in competency-based medical education , 2010, Medical teacher.

[5]  A. Darzi,et al.  Objective assessment of technical skills in surgery , 2003, BMJ : British Medical Journal.

[6]  Melina C Vassiliou,et al.  A global assessment tool for evaluation of intraoperative laparoscopic skills. , 2005, American journal of surgery.

[7]  Ilaria Carpinella,et al.  Quantitative assessment of upper limb motor function in Multiple Sclerosis using an instrumented Action Research Arm Test , 2014, Journal of NeuroEngineering and Rehabilitation.

[8]  Aggarwal Statistical Methods: Concepts, Application and Computation , 2012 .

[9]  D. Stangl,et al.  Encyclopedia of Statistics in Behavioral Science , 2008 .

[10]  J. Dankelman,et al.  Objective classification of residents based on their psychomotor laparoscopic skills , 2009, Surgical Endoscopy.

[11]  Nariman Sepehri,et al.  Quantifying force and positional frequency bands in neurosurgical tasks , 2016, Journal of Robotic Surgery.

[12]  Paolo Dario,et al.  Defining metrics for objective evaluation of surgical performances in laparoscopic training , 2005 .

[13]  T. Nakamura,et al.  Clinical validity of measuring jerk-cost of jaw movement during speech: effect of mouthguard design on smoothness of jaw movements , 2004, SICE 2004 Annual Conference.

[14]  Nariman Sepehri,et al.  Calibration of wheeled mobile robots with differential drive mechanisms: an experimental approach , 2012, Robotica.

[15]  Teodor P Grantcharov,et al.  Assessment of technical surgical skills. , 2002, The European journal of surgery = Acta chirurgica.

[16]  Makoto Hashizume,et al.  Analysis of hand motion differentiates expert and novice surgeons. , 2014, The Journal of surgical research.

[17]  Melina C Vassiliou,et al.  Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. , 2010, American journal of surgery.

[18]  K. Takada,et al.  Reliability and sensitivity of jerk-cost measurement for evaluating irregularity of chewing jaw movements. , 2006, Physiological measurement.

[19]  R. Reznick,et al.  Teaching surgical skills--changes in the wind. , 2006, The New England journal of medicine.

[20]  T. Judkins,et al.  Objective evaluation of expert and novice performance during robotic surgical training tasks , 2009, Surgical Endoscopy.

[21]  Stephane Cotin,et al.  Metrics for Laparoscopic Skills Trainers: The Weakest Link! , 2002, MICCAI.

[22]  Jos Uunk,et al.  Can the Maximum Entropy Principle Be Explained as a Consistency Requirement? , 1997 .

[23]  Editors-in-chief,et al.  Encyclopedia of statistics in behavioral science , 2005 .

[24]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[25]  Tadashi Masuda,et al.  Evaluation of the age-related changes in movement smoothness in the lower extremity joints during lifting. , 2010, Gait & posture.

[26]  J. Dankelman,et al.  The influence of experience and camera holding on laparoscopic instrument movements measured with the TrEndo tracking system , 2007, Surgical Endoscopy.

[27]  Dagmar Sternad,et al.  Sensitivity of Smoothness Measures to Movement Duration, Amplitude, and Arrests , 2009, Journal of motor behavior.

[28]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[29]  Ahnryul Choi,et al.  Kinematic evaluation of movement smoothness in golf: relationship between the normalized jerk cost of body joints and the clubhead , 2014, Biomedical engineering online.

[30]  E. Verdaasdonk,et al.  Objective assessment of technical surgical skills , 2010, The British journal of surgery.

[31]  Patrick Olivier,et al.  Automated surgical OSATS prediction from videos , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[32]  Louis B. Rosenberg Virtual haptic overlays enhance performance in telepresence tasks , 1995, Other Conferences.