Virtual Reality Simulators for Dermatologic Surgery: Measuring Their Validity as a Teaching Tool

Surgical simulation is increasingly being considered for training, testing, and possibly credentialing in medicine and surgery. At the University of Washington we have been developing a virtual reality (VR) suturing simulator. In the course of development it must be realized that expensive new technologies should bear the burden of proof of their effectiveness and reliability before they are put into training programs. The purpose of this article is to define the concept of surgical skill and to discuss how it can be measured in the context of validating VR surgical simulators. Specific measures of validity and reliability are reviewed and discussed.

[1]  A. Steiber,et al.  Surgery interns' experience with surgical procedures as medical students. , 1990, American journal of surgery.

[2]  T M Krummel,et al.  End user analysis of a force feedback virtual reality based surgical simulator. , 2000, Studies in health technology and informatics.

[3]  S. Seki.  Techniques for better suturing , 1988, The British journal of surgery.

[4]  M. Tuggy,et al.  Virtual Reality Flexible Sigmoidoscopy Simulator Training: Impact on Resident Performance , 1998, The Journal of the American Board of Family Medicine.

[5]  A A Giachino,et al.  Objective comparison of manual dexterity in physicians and surgeons. , 1989, Canadian journal of surgery. Journal canadien de chirurgie.

[6]  J. Sackier.  Evaluation of technical surgical skills. Lessons from minimal access surgery. , 1998, Surgical endoscopy.

[7]  S. Seki.  Suturing techniques of surgeons utilizing two different needle-holder grips. , 1988, American Journal of Surgery.

[8]  J Spierdijk,et al.  Does training on an anaesthesia simulator lead to improvement in performance? , 1994, British journal of anaesthesia.

[9]  R. Reznick,et al.  Reliability and construct validity of a structured technical skills assessment form. , 1994, American journal of surgery.

[10]  H Leclère,et al.  Learning surgical technical skills. , 1995, Canadian journal of surgery. Journal canadien de chirurgie.

[11]  G. Regehr,et al.  Computer-assisted learning versus a lecture and feedback seminar for teaching a basic surgical technical skill. , 1998, American journal of surgery.

[12]  K. Park,et al.  Skin simulation for minor surgical procedures. , 1994, Journal of the Royal College of Surgeons of Edinburgh.

[13]  D A Rogers,et al.  A virtual reality module for intravenous catheter placement. , 1999, American journal of surgery.

[14]  K. Fish,et al.  Testing Internal Consistency and Construct Validity During Evaluation of Performance in a Patient Simulator , 1998, Anesthesia and analgesia.

[15]  M. Raibert,et al.  Measuring and developing suturing technique with a virtual reality surgical simulator. , 1999, Journal of the American College of Surgeons.

[16]  R. Steadman,et al.  Patient simulator competency testing: ready for takeoff? , 1998, Anesthesia and analgesia.

[17]  R. Reznick,et al.  Testing technical skill via an innovative "bench station" examination. , 1997, American journal of surgery.

[18]  B. Goldstein,et al.  The use of live pigs in the surgical training of dermatology residents. , 1989, The Journal of dermatologic surgery and oncology.

[19]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[20]  Boyle De,et al.  Tie and suture training board. , 1968 .

[21]  D. E. Boyle,et al.  Tie and suture training board. , 1968, Surgery.

[22]  S. Seki,et al.  Accuracy of suture placement , 1987, The British journal of surgery.

[23]  J. Pickleman,et al.  Age, gender, lateral dominance, and prediction of operative skill among general surgery residents. , 1985, Surgery.

[24]  S Weghorst,et al.  Virtual reality for dermatologic surgery: virtually a reality in the 21st century. , 2000, Journal of the American Academy of Dermatology.

[25]  A Cuschieri,et al.  Ergonomic evaluation of laparoscopic bowel suturing. , 1998, American journal of surgery.

[26]  D. Maclellan,et al.  Formal teaching of basic surgical skills. , 1995, The Australian and New Zealand journal of surgery.

[27]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[28]  Max D. Miller.  EDUCATION, TRAINING, AND PROFICIENCY OF PROCEDURAL SKILLS , 1997 .

[29]  A. Lossing,et al.  A prospective controlled trial of teaching basic surgical skills with 4th year medical students. , 1992, Medical teacher.

[30]  M. Miller,et al.  Office procedures. Education, training, and proficiency of procedural skills. , 1997, Primary care.

[31]  F. Ling,et al.  COMPUTER‐ASSISTED VIDEO EVALUATION OF SURGICAL SKILLS , 1995, Obstetrics and gynecology.

[32]  P. Maguire,et al.  Assessing clinical competence. , 1989, BMJ.

[33]  A Darzi,et al.  Early experience and validation work with Procedicus VA--the Prosolvia virtual reality shoulder arthroscopy trainer. , 1999, Studies in health technology and informatics.

[34]  J. Sackier.  Evaluation of technical surgical skills , 1998, Surgical Endoscopy.

[35]  M. Bridges,et al.  The financial impact of teaching surgical residents in the operating room. , 1999, American journal of surgery.

[36]  A. L. Schueneman,et al.  Neuropsychologic predictors of operative skill among general surgery residents. , 1984, Surgery.

[37]  J. Kopta,et al.  An approach to the evaluation of operative skills. , 1971, Surgery.

[38]  G. Fried,et al.  Development of a model for training and evaluation of laparoscopic skills. , 1998, American journal of surgery.

[39]  S Weghorst,et al.  Fast finite element modeling for surgical simulation. , 1999, Studies in health technology and informatics.

[40]  H. Ellis.  Teaching surgeons to stitch. , 1993, The Australian and New Zealand journal of surgery.

[41]  A. Darzi,et al.  Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. , 1998, Studies in health technology and informatics.

[42]  A McCarthy,et al.  Virtual arthroscopy training: do the "virtual skills" developed match the real skills required? , 1999, Studies in health technology and informatics.

[43]  S Weghorst,et al.  Validation of the Madigan ESS simulator. , 1998, Studies in health technology and informatics.

[44]  G. Fried,et al.  The effect of practice on performance in a laparoscopic simulator , 1998, Surgical Endoscopy.

[45]  J. Hamdorf,et al.  Acquiring surgical skills , 2000, The British journal of surgery.