A Review of Surgical Simulation With Attention to Validation Methodology

The use of simulation technology for teaching and evaluating surgical skills has gained considerable attention in recent years. This is driven by interest in quality of care, concerns over increasing operative complexity, constraints on the use of animal models, limited available patient material, medicolegal pressures, and fiscal mandates for cost-effective performance. Traditional mechanical models are yielding to techniques dependent on electronic technology, including virtual reality. Data to support the validity of simulation techniques for surgical training, assessment, and certification represent only a fraction of the literature available on the subject. Literature searches were conducted in MEDLINE and ERIC, covering the period from 1966 to the present. The electronic and bioengineering literature was not surveyed due to the extensive literature on technology development, distinct from assessment of context specific validity. The search results and the bibliographies of key review articles were examined to identify articles that contained original data, measured performance between cohorts, defined performance measures, and described a standard against which performance was compared. Most of the literature pertaining to simulation techniques for surgical training has been published within the past 5 years and consist of review, opinion, and feasibility articles. There is an emerging body of evidence to establish the validity of simulation techniques for assessing surgical skills. Further refinement of simulation techniques, identification of specific performance measures, longitudinal evaluations, and comparison to practice outcomes are still needed to establish the validity and the value of surgical simulation for teaching and assessing surgical skills prior to considering implementation for certification purposes.

[1]  Steven L Dawson,et al.  A critical approach to medical simulation. , 2002, Bulletin of the American College of Surgeons.

[2]  A. Gallagher,et al.  Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons , 2001, Surgical Endoscopy.

[3]  Richard M. Satava Metrics for Objective Assessment of Surgical Skills Workshop , 2001 .

[4]  W. McGaghie,et al.  Simulation technology for health care professional skills training and assessment. , 1999, JAMA.

[5]  B. Hannaford,et al.  Skills evaluation in minimally invasive surgery using force/torque signatures , 2000, Surgical Endoscopy.

[6]  J Halpenny,et al.  The Training of the Surgeon. , 1918, Canadian Medical Association journal.

[7]  J. Jakimowicz,et al.  Construct Validity , 2018, Definitions.

[8]  G. Fried,et al.  Evaluating laparoscopic skills , 2003, Surgical Endoscopy And Other Interventional Techniques.

[9]  A C Dumay,et al.  Endoscopic surgery simulation in a virtual environment. , 1995, Computers in biology and medicine.

[10]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[11]  G. Fried,et al.  Comparison of laparoscopic performance in vivo with performance measured in a laparoscopic simulator , 1999, Surgical Endoscopy.

[12]  T. Grantcharov,et al.  Laparoscopic performance after one night on call in a surgical department: prospective study , 2001, BMJ : British Medical Journal.

[13]  Richard M Satava,et al.  Virtual reality surgical simulator: the first steps. 1993. , 2006, Clinical orthopaedics and related research.

[14]  A. Darzi,et al.  The role of the Basic Surgical Skills course in the acquisition and retention of laparoscopic skill , 2001, Surgical Endoscopy.

[15]  P. Maurette,et al.  [To err is human: building a safer health system]. , 2002, Annales francaises d'anesthesie et de reanimation.

[16]  William M. K. Trochim,et al.  Research methods knowledge base , 2001 .

[17]  R. M. Satava,et al.  Evaluation of structured and quantitative training methods for teaching intracorporeal knot tying , 2001, Surgical Endoscopy And Other Interventional Techniques.

[18]  S Weghorst,et al.  Issues in validation of a dermatologic surgery simulator. , 2001, Studies in health technology and informatics.

[19]  C Vanchieri,et al.  Virtual reality: will practice make perfect? , 1999, Journal of the National Cancer Institute.

[20]  G. Fried,et al.  Proving the Value of Simulation in Laparoscopic Surgery , 2004, Annals of surgery.

[21]  T Saito,et al.  Virtual reality in surgical education. , 1995, Computers in biology and medicine.

[22]  D. Wilkins,et al.  The assessment of surgical skills and a simple knot-tying exercise. , 2001, Annals of the Royal College of Surgeons of England.

[23]  Blake Hannaford,et al.  Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skills , 2001, IEEE Transactions on Biomedical Engineering.

[24]  W. K. Whittick Email submissions from outside the United Kingdom , 1999, BMJ : British Medical Journal.

[25]  A. Darzi,et al.  The use of electromagnetic motion tracking analysis to objectively measure open surgical skill in the laboratory-based model. , 2001, Journal of the American College of Surgeons.

[26]  M. Raibert,et al.  Measuring and developing suturing technique with a virtual reality surgical simulator. , 1999, Journal of the American College of Surgeons.

[27]  A. Gallagher,et al.  Objective Psychomotor Skills Assessment of Experienced, Junior, and Novice Laparoscopists with Virtual Reality , 2001, World Journal of Surgery.

[28]  M F Whiteside,et al.  Halstedian Technique Revisited: Innovations in Teaching Surgical Skills , 1989, Annals of surgery.

[29]  A. Darzi,et al.  Skill transfer from virtual reality to a real laparoscopic task , 2001, Surgical Endoscopy.

[30]  Daniel B. Jones,et al.  Laparoscopic training on bench models: better and more cost effective than operating room experience? , 2000, Journal of the American College of Surgeons.

[31]  C. Marano,et al.  To err is human. Building a safer health system , 2005 .

[32]  Evaluating laparoscopic skills. , 1999, Canadian journal of surgery. Journal canadien de chirurgie.

[33]  T. Krummel,et al.  Virtual reality: surgical application--challenge for the new millennium. , 2001, Journal of the American College of Surgeons.

[34]  A Darzi,et al.  Objective assessment of surgical dexterity using simulators. , 1999, Hospital medicine.

[35]  Richard M Satava,et al.  Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures. , 2003, Journal of the American College of Surgeons.

[36]  R. M. Satava,et al.  Metrics for objective Assessment , 2003, Surgical Endoscopy And Other Interventional Techniques.

[37]  M. Schijven,et al.  Face-, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator , 2002, Surgical Endoscopy And Other Interventional Techniques.

[38]  R. Reznick,et al.  Objective structured assessment of technical skill (OSATS) for surgical residents , 1997, The British journal of surgery.

[39]  A. Darzi,et al.  Assessing operative skill , 1999, BMJ.

[40]  H C FALK,et al.  The training of a surgeon. , 1958, The Journal of the Albert Einstein Medical Center, Philadelphia.

[41]  J. Rosen,et al.  Virtual reality in surgical training. , 2000, Surgical oncology clinics of North America.

[42]  G. Ahlberg,et al.  Does training in a virtual reality simulator improve surgical performance? , 2001, Surgical Endoscopy And Other Interventional Techniques.

[43]  C. D. Smith,et al.  A computer-based laparoscopic skills assessment device differentiates experienced from novice laparoscopic surgeons , 2001, Surgical Endoscopy.

[44]  P J Baldwin,et al.  Validity of surgical simulation for the assessment of operative skill , 2001, The British journal of surgery.

[45]  A Darzi,et al.  The role of simulation in surgical training. , 2000, Annals of the Royal College of Surgeons of England.

[46]  R W Barnes,et al.  Surgical handicraft: teaching and learning surgical skills. , 1987, American journal of surgery.

[47]  C Sutton,et al.  Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human-computer interface. , 1999, Annals of the Royal College of Surgeons of England.

[48]  P. Ström,et al.  Validation and learning in the Procedicus KSA virtual reality surgical simulator , 2003, Surgical Endoscopy And Other Interventional Techniques.

[49]  J. Shah,et al.  Can tonic accommodation predict surgical performance? , 2002, Surgical Endoscopy And Other Interventional Techniques.

[50]  A. Darzi,et al.  Effect of sleep deprivation on surgeons' dexterity on laparoscopy simulator , 1998, The Lancet.