Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection

Purpose   Virtual reality simulator technology together with novel metrics could advance our understanding of expert neurosurgical performance and modify and improve resident training and assessment. This pilot study introduces innovative metrics that can be measured by the state-of-the-art simulator to assess performance. Such metrics cannot be measured in an operating room and have not been used previously to assess performance.Methods   Three sets of performance metrics were assessed utilizing the NeuroTouch platform in six scenarios with simulated brain tumors having different visual and tactile characteristics. Tier 1 metrics included percentage of brain tumor resected and volume of simulated “normal” brain tissue removed. Tier 2 metrics included instrument tip path length, time taken to resect the brain tumor, pedal activation frequency, and sum of applied forces. Tier 3 metrics included sum of forces applied to different tumor regions and the force bandwidth derived from the force histogram.Results   The results outlined are from a novice resident in the second year of training and an expert neurosurgeon. The three tiers of metrics obtained from the NeuroTouch simulator do encompass the wide variability of technical performance observed during novice/expert resections of simulated brain tumors and can be employed to quantify the safety, quality, and efficiency of technical performance during simulated brain tumor resection. Tier 3 metrics derived from force pyramids and force histograms may be particularly useful in assessing simulated brain tumor resections.Conclusion   Our pilot study demonstrates that the safety, quality, and efficiency of novice and expert operators can be measured using metrics derived from the NeuroTouch platform, helping to understand how specific operator performance is dependent on both psychomotor ability and cognitive input during multiple virtual reality brain tumor resections.

[1]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[2]  F. Charbel,et al.  Learning Retention of Thoracic Pedicle Screw Placement Using a High-Resolution Augmented Reality Simulator With Haptic Feedback , 2011, Neurosurgery.

[3]  Fady Charbel,et al.  Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. , 2006, Studies in health technology and informatics.

[4]  Rajesh Aggarwal,et al.  An Evidence-Based Virtual Reality Training Program for Novice Laparoscopic Surgeons , 2006, Annals of surgery.

[5]  Leif Hedman,et al.  Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. , 2007, American journal of surgery.

[6]  Laurent Salomon,et al.  Skill assessment of urological laparoscopic surgeons: can criterion levels of surgical performance be determined using the pelvic box trainer? , 2005, European urology.

[7]  J D Gray,et al.  Global rating scales in residency education , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[8]  Charles Wheatstone.  On some remarkable and hitherto unobserved phenomena of binocular vision. , 1962 .

[9]  Nicholas Gélinas-Phaneuf,et al.  Surgical Expertise in Neurosurgery: Integrating Theory Into Practice. , 2013, Neurosurgery.

[10]  Charles Wheatstone,et al.  Contributions to the Physiology of Vision. , 1837 .

[11]  A. Gawande,et al.  The incidence and nature of surgical adverse events in Colorado and Utah in 1992. , 1999, Surgery.

[12]  J. Birkmeyer,et al.  Surgical skill and complication rates after bariatric surgery. , 2013, The New England journal of medicine.

[13]  J. Gray,et al.  Improving in-training evaluation programs , 1998, Journal of General Internal Medicine.

[14]  C. Wheatstone.  XVIII. Contributions to the physiology of vision. —Part the first. On some remarkable, and hitherto unobserved, phenomena of binocular vision , 1962, Philosophical Transactions of the Royal Society of London.

[15]  Stefan Wolfsberger,et al.  Virtual endoscopy in neurosurgery: a review. , 2013, Neurosurgery.

[16]  R. Brydges,et al.  Developing criteria for proficiency-based training of surgical technical skills using simulation: changes in performances as a function of training year. , 2008, Journal of the American College of Surgeons.

[17]  J. Dungan,et al.  Effect of virtual reality training on laparoscopic surgery: randomised controlled trial , 2010 .

[18]  Henry Samuel M Hubert.  Part the First , 2019, Antonio Latini’s “The Modern Steward, or The Art of Preparing Banquets Well”.

[19]  Olivier Comas,et al.  The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. , 2013, Neurosurgery.

[20]  G. Fried,et al.  The effect of practice on performance in a laparoscopic simulator , 1998, Surgical Endoscopy.

[21]  N. John,et al.  Web-based surgical simulation for ventricular catheterization. , 2000, Neurosurgery.

[22]  Mohammed A Almekhlafi,et al.  Simulation and augmented reality in endovascular neurosurgery: lessons from aviation. , 2013, Neurosurgery.

[23]  V. Pazos,et al.  The Development of a Virtual Simulator for Training Neurosurgeons to Perform and Perfect Endoscopic Endonasal Transsphenoidal Surgery. , 2013, Neurosurgery.

[24]  P. Ferroli,et al.  Advanced 3-dimensional planning in neurosurgery. , 2013, Neurosurgery.

[25]  R. Satava.  Virtual reality surgical simulator , 1993, Surgical Endoscopy.

[26]  A. Wall,et al.  Book ReviewTo Err is Human: building a safer health system Kohn L T Corrigan J M Donaldson M S Washington DC USA: Institute of Medicine/National Academy Press ISBN 0 309 06837 1 $34.95 , 2000 .

[27]  C. W. Cummings,et al.  Competency in surgical residency training: defining and raising the bar. , 2007, Academic medicine : journal of the Association of American Medical Colleges.

[28]  Sandeep Aggarwal,et al.  Surgical skill and complication rates after bariatric surgery. Birkmeyer JD, Finks JF, O'Reilly A, Oerline M, Carlin AM, Nunn AR, et al. Michigan Bariatric Surgery Collaborative. N Engl J Med. 2013;369:1434–1442 , 2014 .

[29]  Robert DiRaddo,et al.  NeuroTouch: A Physics-Based Virtual Simulator for Cranial Microneurosurgery Training , 2012, Neurosurgery.

[30]  J. Sackier,et al.  A method of objectively evaluating improvements in laparoscopic skills , 1998, Surgical Endoscopy.

[31]  Sébastien Delorme,et al.  Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. , 2013, World neurosurgery.

[32]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[33]  Vincent Mora,et al.  Assessing performance in brain tumor resection using a novel virtual reality simulator , 2013, International Journal of Computer Assisted Radiology and Surgery.

[34]  W L Nowinski,et al.  Planning and simulation of neurosurgery in a virtual reality environment. , 2000, Neurosurgery.

[35]  R. Reznick,et al.  Teaching surgical skills--changes in the wind. , 2006, The New England journal of medicine.

[36]  N. Charness,et al.  Expert Performance Its Structure and Acquisition , 2002 .

[37]  D. Gaba,et al.  A comprehensive anesthesia simulation environment: re-creating the operating room for research and training. , 1988, Anesthesiology.

[38]  Fady T Charbel,et al.  Accuracy of ventriculostomy catheter placement using a head- and hand-tracked high-resolution virtual reality simulator with haptic feedback. , 2007, Journal of neurosurgery.

[39]  Daniel B. Jones,et al.  Surgical skills training and simulation. , 2009, Current problems in surgery.

[40]  L Adams,et al.  Interdisciplinary primary care summer preceptorships , 1996, Academic medicine : journal of the Association of American Medical Colleges.

[41]  J. Grant,et al.  Competency-based training: who benefits? , 2012, Postgraduate Medical Journal.

[42]  B. Challacombe,et al.  The assessment of surgical competency in the UK. , 2009, International journal of surgery.