Open surgery training simulator using Haptics and augmented reality technologies

As a proof of concept, a neurosurgical procedure called ventriculostomy is simulated. This surgical procedure consists of the insertion of a catheter in the brain ventricles for draining excess spinal fluid and reducing intracranial pressure. While performing the surgery, neurosurgeons must rely on their fine eye-hand coordination and sense of touch to properly orient and introduce the catheter, as a subtle puncturing sensation is felt when the catheter cannulates the ventricles.

[1]  Robert Riener,et al.  Haptic device for a ventricular shunt insertion simulator. , 2006, Studies in health technology and informatics.

[2]  Fady T Charbel,et al.  Accuracy of ventriculostomy catheter placement using a head- and hand-tracked high-resolution virtual reality simulator with haptic feedback. , 2007, Journal of neurosurgery.

[3]  W L Nowinski,et al.  Planning and simulation of neurosurgery in a virtual reality environment. , 2000, Neurosurgery.

[4]  F. Charbel,et al.  VIRTUAL REALITY IN NEUROSURGICAL EDUCATION: PART‐TASK VENTRICULOSTOMY SIMULATION WITH DYNAMIC VISUAL AND HAPTIC FEEDBACK , 2007, Neurosurgery.

[5]  Cristian Luciano,et al.  Manufacturing Simulation in a Flexible System , 1995 .

[6]  G. Dawe,et al.  Design of the ImmersiveTouch TM : a High-Performance Haptic Augmented Virtual Reality System , 2005 .

[7]  R W Webster,et al.  A prototype haptic suturing simulator. , 2001, Studies in health technology and informatics.

[8]  P. Banerjee,et al.  Applying Augmented Reality and Haptics to Evaluate Dynamic Prototypes of Mobile Devices , 2009 .

[9]  Antonio Bernardo,et al.  A Three-dimensional Interactive Virtual Dissection Model to Simulate Transpetrous Surgical Avenues , 2003, Neurosurgery.

[10]  U. Spetzger,et al.  Virtual placement of frontal ventricular catheters using frameless neuronavigation: an "unbloody training" for young neurosurgeons. , 2000, Minimally invasive neurosurgery : MIN.

[11]  O V Larsen,et al.  The Virtual Brain Project--development of a neurosurgical simulator. , 2001, Studies in health technology and informatics.

[12]  N. John,et al.  Web-based surgical simulation for ventricular catheterization. , 2000, Neurosurgery.

[13]  S. Constantini,et al.  Ventricular catheter placement in children with hydrocephalus and small ventricles: the use of a frameless neuronavigation system , 2002, Child's Nervous System.

[14]  Pat P. Banerjee,et al.  GPU-based elastic-object deformation for enhancement of existing haptic applications , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[15]  Alan Liu,et al.  A Survey of Surgical Simulation: Applications, Technology, and Education , 2003, Presence: Teleoperators & Virtual Environments.

[16]  D. Turner,et al.  Relative risks of ventriculostomy infection and morbidity , 2005, Acta Neurochirurgica.

[17]  Christian Duriez,et al.  Realistic haptic rendering of interacting deformable objects in virtual environments , 2008, IEEE Transactions on Visualization and Computer Graphics.

[18]  Vincenzo Liberatore,et al.  Virtual environment-based training simulator for endoscopic third ventriculostomy. , 2006, Studies in health technology and informatics.

[19]  T. Struffert,et al.  Virtual MRI Endoscopy: Detection of Anomalies of the Ventricular Anatomy and its Possible Role as a Presurgical Planning Tool for Endoscopic Third Ventriculostomy , 2001, Acta Neurochirurgica.

[20]  N W John,et al.  Surgical simulators using the WWW. , 2000, Studies in health technology and informatics.

[21]  S Kobayashi,et al.  Simulation of the surgical manipulation involved in clipping a basilar artery aneurysm: concepts of virtual clipping. Technical note. , 2000, Journal of neurosurgery.

[22]  Thomas Sangild Sørensen,et al.  Haptic feedback for the GPU-based surgical simulator. , 2006, Studies in health technology and informatics.

[23]  John Kenneth Salisbury,et al.  Haptic Rendering - Beyond Visual Computing , 2004, IEEE Computer Graphics and Applications.

[24]  R. Kikinis,et al.  Computer-assisted interactive three-dimensional planning for neurosurgical procedures. , 1996, Neurosurgery.

[25]  Shaojie Zhang,et al.  Virtual exercise environment for promoting active lifestyle for people with lower body disabilities , 2010, 2010 International Conference on Networking, Sensing and Control (ICNSC).

[26]  Sanjay Mehrotra,et al.  Realistic cross-platform haptic applications using freely-available libraries , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[27]  Maxine D. Brown,et al.  The ImmersaDesk and Infinity Wall projection-based virtual reality displays , 1997, COMG.

[28]  Sanjay Mehrotra,et al.  A Framework for Efficient and More Realistic Haptics Applications , 2003 .

[29]  J. Caffrey,et al.  Virtual Reality Neurosurgery: A Simulator Blueprint , 2004, Neurosurgery.

[30]  Domenico Prattichizzo,et al.  A GPU-friendly Method for Haptic and Graphic Rendering of Deformable Objects , 2004 .

[31]  Thomas A. DeFanti,et al.  Haptics-based virtual reality periodontal training simulator , 2009, Virtual Reality.

[32]  Andrew E. Johnson,et al.  Developing the PARIS : Using the CAVE to Prototype a New VR Display , 2000 .

[33]  Ole Vilhelm Larsen,et al.  Simulating the puncture of the human ventricle , 2002 .

[34]  Dorothee P. Auer,et al.  Virtual endoscopy for planning and simulation of minimally invasive neurosurgery. , 1998, Neurosurgery.

[35]  M. Apuzzo,et al.  Virtual Reality Surgery: Neurosurgery and the Contemporary Landscape , 2003, Neurosurgery.

[36]  R Ravi,et al.  Intracranial pressure monitoring , 2003 .

[37]  Pat P. Banerjee,et al.  Automating the Extraction of 3D Models from Medical Images for Virtual Reality and Haptic Simulations , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[38]  Cristian Luciano,et al.  Virtual Reality and Haptic Interface for Cellular Injection Simulation , 2007, MMVR.

[39]  Pat P. Banerjee,et al.  Prototyping flexible touch screen devices using collocated haptic-graphic elastic-object deformation on the GPU , 2010, Virtual Reality.

[40]  Jack McLaughlin,et al.  Haptic Workbench: a multisensory virtual environment , 1999, Electronic Imaging.

[41]  Kup-Sze Choi,et al.  Interactive deformation of soft tissues with haptic feedback for medical learning , 2003, IEEE Transactions on Information Technology in Biomedicine.

[42]  F. Bootz,et al.  [Virtual training in head- and neurosurgery]. , 2005, Laryngo- rhino- otologie.

[43]  Dinesh K. Pai,et al.  A unified treatment of elastostatic contact simulation for real time haptics , 2005, SIGGRAPH Courses.

[44]  Sanjay Mehrotra,et al.  3D Animation of Telecollaborative Anthropomorphic Avatars , 2001, CACM.

[45]  Mark C Preul,et al.  Interactive stereoscopic virtual reality: a new tool for neurosurgical education. Technical note. , 2002, Journal of neurosurgery.

[46]  Randima Fernando,et al.  GPU Gems: Programming Techniques, Tips and Tricks for Real-Time Graphics , 2004 .

[47]  Ole Vilhelm Larsen,et al.  Modelling of interaction between a spatula and a human brain , 2004, Medical Image Anal..

[48]  D Hellwig,et al.  Relationships of virtual reality neuroendoscopic simulations to actual imaging. , 2000, Minimally invasive neurosurgery : MIN.

[49]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[50]  Pat Banerjee,et al.  Reconfigurable driving platforms in CAVE , 2003, International Conference On Virtual Reality and Its Applications in Industry.

[51]  Cristian Luciano,et al.  Virtual ventriculostomy with 'shifted ventricle': neurosurgery resident surgical skill assessment using a high-fidelity haptic/graphic virtual reality simulator , 2009, Neurological research.

[52]  F. Okuyama.  Human visual accommodation and vergence eye movement while viewing stereoscopic display and actual target , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[53]  Pat P. Banerjee,et al.  Avatar kinematics modeling for telecollaborative virtual environments , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[54]  M. Cusimano.  Virtual reality surgery:neurosurgery and the contemporary landscape a three-dimensional interactive virtual dissection model to simulate transpetrous surgical avenues. , 2003, Neurosurgery.

[55]  I. A. Jones,et al.  A virtual reality surgery simulation of cutting and retraction in neurosurgery with force-feedback , 2006, Comput. Methods Programs Biomed..

[56]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[57]  Fady Charbel,et al.  Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. , 2006, Studies in health technology and informatics.

[58]  Robert Riener,et al.  BrainTrain: brain simulator for medical VR application. , 2005, Studies in health technology and informatics.

[59]  Rüdiger Westermann,et al.  Interactive Simulation and Rendering of Heterogeneous Deformable Bodies , 2005 .

[60]  A Darzi,et al.  The PreOp flexible sigmoidoscopy trainer. Validation and early evaluation of a virtual reality based system. , 2002, Surgical endoscopy.

[61]  Nobuyuki Hiruma,et al.  Accommodation Response to Binocular Stereoscopic TV Images and Their Viewing Conditions , 1993 .

[62]  Pat P. Banerjee,et al.  Haptic interaction with volumetric datasets using surface-based haptic libraries , 2010, 2010 IEEE Haptics Symposium.

[63]  Cristian Luciano,et al.  Real Time Control of a Tutorial Flexible Manufacturing Cell , 1995 .

[64]  Dinesh K. Pai,et al.  DyRT: dynamic response textures for real time deformation simulation with graphics hardware , 2002, SIGGRAPH.

[65]  Domenico Prattichizzo,et al.  Real-time soft-finger grasping of physically based quasi-rigid objects , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[66]  Daniel J. Sandin,et al.  Line of Sight Method for Tracker Calibration in Projection-Based VR Systems , 1998 .

[67]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[68]  Thomas Sangild Sørensen,et al.  GPU accelerated surgical simulators for complex morphology , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[69]  C.J. Luciano,et al.  Virtual reality environment for real time simulation, control and monitoring of robotic manufacturing flexible systems , 1997, 1997 8th International Conference on Advanced Robotics. Proceedings. ICAR'97.

[70]  R. Chesnut,et al.  Intracranial pressure. Monitoring and management. , 1994, Neurosurgery clinics of North America.