Objective assessment based on motion-related metrics and technical performance in laparoscopic suturing

PurposeThe aim of this study is to present the construct and concurrent validity of a motion-tracking method of laparoscopic instruments based on an optical pose tracker and determine its feasibility as an objective assessment tool of psychomotor skills during laparoscopic suturing.MethodsA group of novice ($${<}10$$<10 laparoscopic procedures), intermediate (11–100 laparoscopic procedures) and experienced ($${>}100$$>100 laparoscopic procedures) surgeons performed three intracorporeal sutures on an ex vivo porcine stomach. Motion analysis metrics were recorded using the proposed tracking method, which employs an optical pose tracker to determine the laparoscopic instruments’ position. Construct validation was measured for all 10 metrics across the three groups and between pairs of groups. Concurrent validation was measured against a previously validated suturing checklist. Checklists were completed by two independent surgeons over blinded video recordings of the task.ResultsEighteen novices, 15 intermediates and 11 experienced surgeons took part in this study. Execution time and path length travelled by the laparoscopic dissector presented construct validity. Experienced surgeons required significantly less time ($$p<0.008$$p<0.008), travelled less distance using both laparoscopic instruments ($$p<0.013$$p<0.013) and made more efficient use of the work space ($$p<0.018$$p<0.018) compared with novice and intermediate surgeons. Concurrent validation showed strong correlation between both the execution time and path length and the checklist score ($$r =-0.712$$r=-0.712 and $$r=-0.731$$r=-0.731, $$p<0.001$$p<0.001).ConclusionsThe suturing performance was successfully assessed by the motion analysis method. Construct and concurrent validity of the motion-based assessment method has been demonstrated for the execution time and path length metrics. This study demonstrates the efficacy of the presented method for objective evaluation of psychomotor skills in laparoscopic suturing. However, this method does not take into account the quality of the suture. Thus, future works will focus on developing new methods combining motion analysis and qualitative outcome evaluation to provide a complete performance assessment to trainees.