Instrument Motion Metrics for Laparoscopic Skills Assessment in Virtual Reality and Augmented Reality.

OBJECTIVE To determine the construct and concurrent validity of instrument motion metrics for laparoscopic skills assessment in virtual reality and augmented reality simulators. STUDY DESIGN Evaluation study. SAMPLE POPULATION Veterinarian students (novice, n = 14) and veterinarians (experienced, n = 11) with no or variable laparoscopic experience. METHODS Participants' minimally invasive surgery (MIS) experience was determined by hospital records of MIS procedures performed in the Teaching Hospital. Basic laparoscopic skills were assessed by 5 tasks using a physical box trainer. Each participant completed 2 tasks for assessments in each type of simulator (virtual reality: bowel handling and cutting; augmented reality: object positioning and a pericardial window model). Motion metrics such as instrument path length, angle or drift, and economy of motion of each simulator were recorded. RESULTS None of the motion metrics in a virtual reality simulator showed correlation with experience, or to the basic laparoscopic skills score. All metrics in augmented reality were significantly correlated with experience (time, instrument path, and economy of movement), except for the hand dominance metric. The basic laparoscopic skills score was correlated to all performance metrics in augmented reality. The augmented reality motion metrics differed between American College of Veterinary Surgeons diplomates and residents, whereas basic laparoscopic skills score and virtual reality metrics did not. CONCLUSION Our results provide construct validity and concurrent validity for motion analysis metrics for an augmented reality system, whereas a virtual reality system was validated only for the time score.

[1]  Alan M. Wood,et al.  Motion analysis , 1986 .

[2]  A. Cuschieri,et al.  Randomised study of influence of two-dimensional versus three-dimensional imaging on performance of laparoscopic cholecystectomy , 1998, The Lancet.

[3]  A. Cuschieri,et al.  Task performance in endoscopic surgery is influenced by location of the image display. , 1998, Annals of surgery.

[4]  J. Sackier,et al.  A method of objectively evaluating improvements in laparoscopic skills , 1998, Surgical Endoscopy.

[5]  G. Fried,et al.  Development of a model for training and evaluation of laparoscopic skills. , 1998, American journal of surgery.

[6]  A. Cuschieri,et al.  Influence of the optical axis-to-target view angle on endoscopic task performance , 1999, Surgical Endoscopy.

[7]  G. Fried,et al.  Comparison of laparoscopic performance in vivo with performance measured in a laparoscopic simulator , 1999, Surgical Endoscopy.

[8]  Daniel B. Jones,et al.  Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills , 2002, Surgical Endoscopy And Other Interventional Techniques.

[9]  A. Darzi,et al.  Motion analysis , 1986 .

[10]  A. Park,et al.  Transfer of training in acquiring laparoscopic skills. , 2001, Journal of the American College of Surgeons.

[11]  Gerald B Healy,et al.  The college should be instrumental in adapting simulators to education. , 2002, Bulletin of the American College of Surgeons.

[12]  G. Fried,et al.  Evaluating laparoscopic skills , 2003, Surgical Endoscopy And Other Interventional Techniques.

[13]  Christos Trantakis,et al.  Fundamentals of Force Feedback and Application to a Surgery Simulator , 2003, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[14]  G. Fried,et al.  Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. , 2004, Journal of the American College of Surgeons.

[15]  G. Fried,et al.  Proving the Value of Simulation in Laparoscopic Surgery , 2004, Annals of surgery.

[16]  R. Reznick,et al.  Assessing competency in surgery: where to begin? , 2004, Surgery.

[17]  Mandayam A Srinivasan,et al.  Virtual-reality-based laparoscopic surgical training: The role of simulation fidelity in haptic feedback , 2004, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[18]  T. Grantcharov,et al.  Objective assessment of laparoscopic skills using a virtual reality stimulator , 2005, Surgical Endoscopy.

[19]  A. Duffy,et al.  Construct validity for the LAPSIM laparoscopic surgical simulator , 2005, Surgical Endoscopy And Other Interventional Techniques.

[20]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[21]  T. Jebara,et al.  The LapSim: a learning environment for both experts and novices. , 2005, Studies in health technology and informatics.

[22]  G. Fried,et al.  The MISTELS program to measure technical skill in laparoscopic surgery , 2006, Surgical Endoscopy And Other Interventional Techniques.

[23]  K. Conlon,et al.  Construct validation of a novel hybrid surgical simulator , 2006, Surgical Endoscopy And Other Interventional Techniques.

[24]  James R Korndorffer,et al.  Simulator training for laparoscopic suturing using performance goals translates to the operating room. , 2005, Journal of the American College of Surgeons.

[25]  G. Fried,et al.  Characterizing the learning curve for a basic laparoscopic drill , 2005, Surgical Endoscopy And Other Interventional Techniques.

[26]  G. Fried,et al.  Validity of the MISTELS simulator for laparoscopy training in urology. , 2005, Journal of endourology.

[27]  R. Clayman,et al.  Construct validity testing of a laparoscopic surgical simulator. , 2006, Journal of the American College of Surgeons.

[28]  Ravidner Sidhu,et al.  Self-assessment during a 2-day laparoscopic colectomy course: can surgeons judge how well they are learning new skills? , 2006, American journal of surgery.

[29]  P. Andreatta,et al.  Construct validity of the LapSim laparoscopic surgical simulator. , 2006, American journal of surgery.

[30]  E. M. Ritter,et al.  Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS) , 2007, Surgical Endoscopy.

[31]  S. Botden,et al.  Augmented versus Virtual Reality Laparoscopic Simulation: What Is the Difference? , 2007, World journal of surgery.

[32]  G. Fried,et al.  FLS simulator performance predicts intraoperative laparoscopic skill , 2007, Surgical Endoscopy.

[33]  S. Botden,et al.  The importance of haptic feedback in laparoscopic suturing training and the additive value of virtual reality simulation , 2008, Surgical Endoscopy.

[34]  M. Pellen,et al.  Construct validity of the ProMIS laparoscopic simulator , 2008, Surgical Endoscopy.

[35]  G. Maddern,et al.  A Systematic Review of Skills Transfer After Surgical Simulation Training , 2008, Annals of surgery.

[36]  S. Botden,et al.  What is going on in augmented reality simulation in laparoscopic surgery? , 2008, Surgical Endoscopy.

[37]  R. Moldovanu,et al.  Training on a virtual reality simulator--is it really possible a correct evaluation of the surgeons' experience? , 2009, Revista medico-chirurgicala a Societatii de Medici si Naturalisti din Iasi.

[38]  G. Maddern,et al.  The LapSim virtual reality simulator: promising but not yet proven , 2011, Surgical Endoscopy.

[39]  B. Fransson,et al.  Assessment of laparoscopic skills before and after simulation training with a canine abdominal model. , 2010, Journal of the American Veterinary Medical Association.

[40]  A. Scherpbier,et al.  Virtual reality laparoscopic nephrectomy simulator is lacking in construct validity. , 2010, Journal of endourology.

[41]  B. Fransson,et al.  A laparoscopic surgical skills assessment tool for veterinarians. , 2010, Journal of veterinary medical education.

[42]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[43]  E. Kuhry,et al.  Limitations of haptic feedback devices on construct validity of the LapSim® virtual reality simulator , 2013, Surgical Endoscopy.

[44]  J. Torkington,et al.  Is motion analysis a valid tool for assessing laparoscopic skill? , 2013, Surgical Endoscopy.

[45]  Effect of two instrument designs on laparoscopic skills performance. , 2012, Veterinary surgery : VS.

[46]  B. Fransson,et al.  Effects of two training curricula on basic laparoscopic skills and surgical performance among veterinarians. , 2012, Journal of the American Veterinary Medical Association.

[47]  R. Aggarwal,et al.  Virtual reality training for surgical trainees in laparoscopic surgery. , 2013, The Cochrane database of systematic reviews.

[48]  F. Sánchez-Margallo,et al.  Development and evaluation of a canine laparoscopic simulator for veterinary clinical training. , 2014, Journal of veterinary medical education.

[49]  Ravikiran Singapogu,et al.  A perspective on the role and utility of haptic feedback in laparoscopic skills training. , 2014, Critical reviews in biomedical engineering.

[50]  P. Hewett,et al.  Virtual Reality Versus Box Laparoscopic Simulators in Trainee Selection and Aptitude Testing , 2014, Surgical laparoscopy, endoscopy & percutaneous techniques.

[51]  P. Constable,et al.  Relationships among video gaming proficiency and spatial orientation, laparoscopic, and traditional surgical skills of third-year veterinary students. , 2014, Journal of the American Veterinary Medical Association.

[52]  K. Gurusamy,et al.  Laparoscopic surgical box model training for surgical trainees with no prior laparoscopic experience. , 2014, The Cochrane database of systematic reviews.

[53]  J. Delisle,et al.  Transfer of skills on LapSim virtual reality laparoscopic simulator into the operating room in urology , 2015, Urology annals.

[54]  Jason Park,et al.  Does laparoscopic simulation predict intraoperative performance? A comparison between the Fundamentals of Laparoscopic Surgery and LapVR evaluation metrics. , 2015, American journal of surgery.