An augmented reality simulator for ultrasound guided needle placement training

Details are presented of a low cost augmented-reality system for the simulation of ultrasound guided needle insertion procedures (tissue biopsy, abscess drainage, nephrostomy etc.) for interventional radiology education and training. The system comprises physical elements; a mannequin, a mock ultrasound probe and a needle, and software elements; generating virtual ultrasound anatomy and allowing data collection. These two elements are linked by a pair of magnetic 3D position sensors. Virtual anatomic images are generated based on anatomic data derived from full body CT scans of live humans. Details of the novel aspects of this system are presented including; image generation, registration and calibration.

[1]  R. Satava,et al.  Virtual Reality Training Improves Operating Room Performance: Results of a Randomized, Double-Blinded Study , 2002, Annals of surgery.

[2]  R Poss,et al.  Development of a virtual reality arthroscopic knee simulator. , 2000, The Journal of bone and joint surgery. American volume.

[3]  Ken Brodlie,et al.  A model for virtual suturing in vascular surgery , 2004, Proceedings Theory and Practice of Computer Graphics, 2004..

[4]  P. Gorman,et al.  A prototype haptic lumbar puncture simulator. , 2000, Studies in health technology and informatics.

[5]  Jim A. Reekers,et al.  Simulation Devices in Interventional Radiology: Caveat Emptor , 2006, Cardiovascular and Interventional Radiology.

[6]  T. Krummel,et al.  Virtual reality and simulation: training the future emergency physician. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[7]  Thomas Berlage,et al.  REGISTRATION OF 3D ULTRASOUND IMAGES TO SURFACE MODELS OF THE HEART , 1997 .

[8]  Matthew T. Freedman,et al.  Optimizing prostate needle biopsy through 3D simulation , 1998, Medical Imaging.

[9]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  D. Magee,et al.  A computer based simulator for ultrasound guided needle insertion procedures , 2005 .

[11]  Thomas Berlage,et al.  Computer-based training in two-dimensional echocardiography using an echocardiography simulator. , 2005, Journal of the American Society of Echocardiography : official publication of the American Society of Echocardiography.

[12]  Derek R. Magee,et al.  Combining 3D Deformable Models and Level Set Methods for the Segmentation of Abdominal Aortic Aneurysms , 2001, BMVC.

[13]  M. Schijven,et al.  Face-, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator , 2002, Surgical Endoscopy And Other Interventional Techniques.

[14]  Ken Goldberg,et al.  Simulating needle insertion and radioactive seed implantation for prostate brachytherapy. , 2003, Studies in health technology and informatics.

[15]  P N Kizakevich,et al.  Virtual medical trainer. Patient assessment and trauma care simulator. , 1998, Studies in health technology and informatics.

[16]  D. Kessel,et al.  Simulators in catheter-based interventional radiology: training or computer games? , 2006, Clinical radiology.

[17]  Guang-Zhong Yang,et al.  Image-Based Modelling of Soft Tissue Deformation , 2003, MICCAI.

[18]  Septimiu E. Salcudean,et al.  Needle Insertion Modelling for the Interactive Simulation of Percutaneous Procedures , 2002, MICCAI.

[19]  A Darzi,et al.  Early experience and validation work with Procedicus VA--the Prosolvia virtual reality shoulder arthroscopy trainer. , 1999, Studies in health technology and informatics.

[20]  Ken Perlin,et al.  [Computer Graphics]: Three-Dimensional Graphics and Realism , 2022 .

[21]  S. Dawson,et al.  Procedural simulation: a primer. , 2006, Journal of vascular and interventional radiology : JVIR.

[22]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[23]  C. Chui,et al.  Real-time interactive simulator for percutaneous coronary revascularization procedures. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[24]  M Schijven,et al.  Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. , 2003, Surgical endoscopy.

[25]  Aleksandar Zivanovic,et al.  Ensuring the usability of a knee arthroscopy simulator. , 2004, Studies in health technology and informatics.

[26]  James H. Anderson,et al.  Computer Environment for Interventional Neuroradiology Procedures , 2001 .

[27]  M. Bro-Nielsen,et al.  VR simulation of abdominal trauma surgery. , 1998, Studies in health technology and informatics.

[28]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods/ J. A. Sethian , 1999 .

[29]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[30]  Venkat Devarajan,et al.  StapSim: a virtual reality-based stapling simulator for laparoscopic hemiorrhaphy. , 2004, Studies in health technology and informatics.

[31]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[32]  A. Darzi,et al.  The PreOp flexible sigmoidoscopy trainer , 2002, Surgical Endoscopy And Other Interventional Techniques.

[33]  L. Tafra,et al.  The learning curve and sentinel node biopsy. , 2001, American journal of surgery.

[34]  Darwyn R. Peachey,et al.  Solid texturing of complex surfaces , 1985, SIGGRAPH.

[35]  Peter J. Hunter,et al.  A virtual environment and model of the eye for surgical simulation , 1994, SIGGRAPH.

[36]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[37]  A Darzi,et al.  The PreOp flexible sigmoidoscopy trainer. Validation and early evaluation of a virtual reality based system. , 2002, Surgical endoscopy.