Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator

BackgroundThe SIMENDO is an affordable virtual reality simulator designed to train basic psychomotor skills for endoscopic surgery. This study aimed first to establish construct validity by determining which parameters can discriminate groups with different experience levels, and second to establish the extent to which training is useful by determining when inexperienced groups reach expert level.MethodsThe study participants were divided into four groups according to their experience with endoscopic procedures: experienced group (group A, >50 procedures performed, n = 15), intermediate group (group B, 1–50 procedures performed, n = 18), endoscope navigation group (group C, endoscope navigation experience, n = 14), and novice group (group D, no endoscopic experience, n = 14). Each participant performed three repetitions of six consecutive exercises. The parameters studied were task time, path length of the instruments, and number of errors (collisions). Some participants continued training up to 10 repetitions to get insight in the learning curve.ResultsGroup A (expert) outperformed all the other groups (B, C, and D) in terms of total median task time (p < 0.05), groups C and D in terms of path length, and group D in terms of collision frequency in the first two repetitions. Group B (intermediate) outperformed group D (novice) in total time and endoscope path length for all repetitions, and group C (camera navigation) outperformed group D (novice) in the first repetition. Less experienced groups D and C did not reach expert level for the task time within 10 repetitions, and group B reached it after the eighth repetition (p < 0.05).ConclusionThe study was able to establish construct validity for the training program with the simulator under study. The learning curve showed that training with this simulator is useful for subjects with or without limited endoscopic experience. Furthermore, previous endoscopic camera navigation already improves motor skills to more than the basic level.

[1]  H. Lönroth,et al.  The transfer of basic skills learned in a laparoscopic simulator to the operating room , 2002, Surgical Endoscopy And Other Interventional Techniques.

[2]  C D Smith,et al.  Assessing laparoscopic manipulative skills. , 2001, American journal of surgery.

[3]  A. Duffy,et al.  Construct validity for the LAPSIM laparoscopic surgical simulator , 2005, Surgical Endoscopy And Other Interventional Techniques.

[4]  J. Dankelman,et al.  Validation of a new basic virtual reality simulator for training of basic endoscopic skills , 2006, Surgical Endoscopy And Other Interventional Techniques.

[5]  R. Satava,et al.  Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training , 2005, Annals of surgery.

[6]  T. Grantcharov,et al.  Randomized clinical trial of virtual reality simulation for laparoscopic skills training , 2004, The British journal of surgery.

[7]  R. M. Satava,et al.  Discriminative validity of the Minimally Invasive Surgical Trainer in Virtual Reality (MIST-VR) using criteria levels based on expert performance , 2004, Surgical Endoscopy And Other Interventional Techniques.

[8]  J. J. Jakimowicz,et al.  Consensus guidelines for validation of virtual reality surgical simulators , 2005, Surgical Endoscopy And Other Interventional Techniques.

[9]  A. Darzi,et al.  Motion analysis , 1986 .

[10]  K. Moorthy,et al.  Laparoscopic skills training and assessment , 2004, The British journal of surgery.

[11]  R. Satava,et al.  Virtual reality as a metric for the assessment of laparoscopic psychomotor skills , 2002, Surgical Endoscopy And Other Interventional Techniques.

[12]  Alan M. Wood,et al.  Motion analysis , 1986 .

[13]  P. Ackerman.  Individual differences in skill learning: An integration of psychometric and information processing perspectives. , 1987 .

[14]  M Schijven,et al.  Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. , 2003, Surgical endoscopy.

[15]  G. Fried,et al.  Relationship between objective assessment of technical skills and subjective in-training evaluations in surgical residents. , 2004, Journal of the American College of Surgeons.

[16]  A. G. Gallagher,et al.  Construct validation of the ProMIS simulator using a novel laparoscopic suturing task , 2005, Surgical Endoscopy And Other Interventional Techniques.

[17]  A. Darzi,et al.  Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. , 1998, Studies in health technology and informatics.