Using X3D for medical training simulations

Nowadays medical training simulators play an important role in education and further training of surgeons. With Virtual Reality based training systems it is possible to simulate a surgery under realistic conditions. Input data for the visualization of anatomic structures is tomographic image data. For the visualization of medical datasets direct volume rendering is the method of choice. In this paper we introduce a system based on the new X3D extension proposal of the Medical Working Group for a volume rendering component, with some extensions for controlling the speed vs. quality trade-off. For a convincing and instructive training simulation, our implementation delivers high performance combined with high quality visualization of medical datasets. Furthermore, it integrates haptic force-feedback devices to assure realistic interactions.

[1]  Nigel W. John,et al.  The impact of Web3D technologies on medical education and training , 2007, Comput. Educ..

[2]  A Zielke,et al.  [A virtual reality simulator for objective assessment of surgeons' laparoscopic skill]. , 2005, Der Chirurg; Zeitschrift fur alle Gebiete der operativen Medizen.

[3]  Simon Stegmaier,et al.  A simple and flexible volume rendering framework for graphics-hardware-based raycasting , 2005, Fourth International Workshop on Volume Graphics, 2005..

[4]  J. Jakimowicz,et al.  Virtual reality surgical laparoscopic simulators , 2003, Surgical Endoscopy And Other Interventional Techniques.

[5]  James J. Troy,et al.  Six degree-of-freedom haptic rendering using voxel sampling , 1999, SIGGRAPH.

[6]  Henning Scharsach.  Advanced GPU Raycasting , 2005 .

[7]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[8]  David S. Ebert,et al.  Volume illustration: non-photorealistic rendering of volume models , 2000 .

[9]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[10]  K. Moorthy,et al.  Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback , 2004, Surgical Endoscopy And Other Interventional Techniques.

[11]  Patrick Dähne,et al.  Utilizing X3D for immersive environments , 2004, Web3D '04.

[12]  Markus Hadwiger,et al.  Fast Third-Order Texture Filtering , 2005 .

[13]  Marc Alexa,et al.  Volume visualization in VRML , 2001, Web3D '01.

[14]  Wolfgang Heidrich,et al.  Interleaved Sampling , 2001, Rendering Techniques.

[15]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[16]  Morten Bro-Nielsen,et al.  Real‐time Volumetric Deformable Models for Surgery Simulation using Finite Elements and Condensation , 1996, Comput. Graph. Forum.

[17]  Thomas Ertl,et al.  Smart Hardware-Accelerated Volume Rendering , 2003, VisSym.

[18]  Wolfgang Straßer,et al.  Interactive Lighting Models and Pre-Integration for Volume Rendering on PC Graphics Accelerators , 2002, Graphics Interface.

[19]  N W John,et al.  Medical volume rendering over the WWW using VRML and JAVA. , 1998, Studies in health technology and informatics.

[20]  M S Wilson,et al.  MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance. , 1997, Annals of the Royal College of Surgeons of England.

[21]  Uwe G. Kühnapfel,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000, Computers & graphics.

[22]  Patrick Dähne,et al.  Enhancing X3D for advanced MR appliances , 2007, Web3D '07.

[23]  Markus Hadwiger,et al.  Perspective Isosurface and Direct Volume Rendering for Virtual Endoscopy Applications , 2006, EuroVis.

[24]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, Eurographics.

[25]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[26]  Marc Levoy,et al.  Display of surfaces from volume data , 1988, IEEE Computer Graphics and Applications.

[27]  Ulrich Neumann,et al.  Accelerating Volume Reconstruction With 3D Texture Hardware , 1994 .

[28]  Alan D. Hudson,et al.  MedX3D: Standards Enabled Desktop Medical 3D , 2008, MMVR.

[29]  Karljohan E. Lundin Palmerius,et al.  Direct Volume Haptics for Visualization , 2007 .

[30]  U. Ku,et al.  Endoscopic surgery training using virtual reality and deformable tissue simulation , 2000 .

[31]  Martin Kraus,et al.  High-quality pre-integrated volume rendering using hardware-accelerated pixel shading , 2001, HWWS '01.

[32]  David S. Ebert,et al.  Volume Illustration: Nonphotorealistic Rendering of Volume Models , 2001, IEEE Trans. Vis. Comput. Graph..