Construct Validity

Background: This study was undertaken to establish construct validity of the Xitact LS500, a virtual reality laparoscopic cholecystectomy simulator. The primary research statement is: “The clip-and-cut task on the Xitact LS500 virtual reality laparoscopic cholecystectomy simulator mimics the surgical procedure of the clipping and cutting of the cystic duct and artery during the laparoscopic cholecystectomy adequately.” Methods: According to the level of experience of the surgeon, an “expert group opinion” was formed resulting from 37 surgeons having performed over 100 laparoscopic cholecystectomies, and a “novice group opinion” was formed resulting of 37 surgeons having no experience at all with performing laparoscopic cholecystectomy. Participants received an instructed hands-on “tour” on the Xitact simulator and performed three formal simulation runs. Results: The “novice group” is younger and more surgeons are female. Performance scores in the “expert” group are significantly higher on the second (p value 0.011) and third (p value 0.005) run, compared to the novices’ scores. Experts are significantly faster on completion of all three runs. There is an increase in score over runs in both groups, which is statistically significant in the “expert group.” Less than one-third of surgeons in either group are able to correctly predict their performance score as generated by Xitact. Both “experts” and “novices” feel it is useful to train with Xitact LS500 in the surgical curriculum. Conclusions: Three hypotheses, formulated to operationalize the primary research statement, could be answered affirmatively. Although further validation studies are needed, the Xitact LS500 simulator seems to be able to discriminate between expert and novice surgeons in this research setting, and thus the construct for this setting is considered to be valid.

[1]  A. Gallagher,et al.  A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition. , 2000, American journal of surgery.

[2]  D A Rogers,et al.  A virtual reality module for intravenous catheter placement. , 1999, American journal of surgery.

[3]  M S Wilson,et al.  MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. , 1997, Annals of the Royal College of Surgeons of England.

[4]  D. Karras.  Statistical methodology: II. Reliability and validity assessment in study design, Part B. , 1997, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[5]  A A Nelson,et al.  Research design: measurement, reliability, and validity. , 1980, American journal of hospital pharmacy.

[6]  A. Gallagher,et al.  Objective Psychomotor Skills Assessment of Experienced, Junior, and Novice Laparoscopists with Virtual Reality , 2001, World Journal of Surgery.

[7]  H. Lönroth,et al.  The transfer of basic skills learned in a laparoscopic simulator to the operating room , 2002, Surgical Endoscopy And Other Interventional Techniques.

[8]  K. Gaberson,et al.  Measurement reliability and validity. , 1997, AORN journal.

[9]  A. Darzi,et al.  Skill transfer from virtual reality to a real laparoscopic task , 2001, Surgical Endoscopy.

[10]  R Reznick,et al.  Exporting a technical skills evaluation technology to other sites. , 2001, American journal of surgery.

[11]  I. C. McManus,et al.  An objective assessment of surgeons' psychomotor skills: validation of the MISTVR laparoscopic simulator , 1998 .

[12]  C Sutton,et al.  Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. , 1999, Annals of the Royal College of Surgeons of England.

[13]  S. Paterson-Brown,et al.  Feasibility, reliability and validity of a new assessment form for use with basic surgical trainees. , 2001, American journal of surgery.

[14]  A. Darzi,et al.  Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. , 1998, Studies in health technology and informatics.

[15]  T Saito,et al.  Virtual reality in surgical education. , 1995, Computers in biology and medicine.

[16]  A. Gallagher,et al.  Virtual Reality Training in Laparoscopic Surgery: A Preliminary Assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR) , 1999, Endoscopy.

[17]  A Darzi,et al.  Virtual reality and laparoscopic surgery , 1994, The British journal of surgery.

[18]  J. Jakimowicz,et al.  The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance , 2002, Surgical Endoscopy And Other Interventional Techniques.

[19]  R. Reznick,et al.  Testing technical skill via an innovative "bench station" examination. , 1997, American journal of surgery.

[20]  G. Fried,et al.  Evaluation of laparoscopic skills: a 2-year follow-up during residency training. , 1999, Canadian journal of surgery. Journal canadien de chirurgie.

[21]  R. Reznick,et al.  Teaching and testing technical skills. , 1993, American journal of surgery.

[22]  Teodor P. Grantcharov,et al.  An objective method for the evaluation of laparoscopic surgical skills , 2001 .

[23]  C. D. Smith,et al.  A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons , 2001, Surgical Endoscopy.

[24]  P J Baldwin,et al.  Validity of surgical simulation for the assessment of operative skill , 2001, The British journal of surgery.

[25]  M. Schijven,et al.  Face-, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator , 2002, Surgical Endoscopy And Other Interventional Techniques.