Biomedical Modeling in Tele-Immersion

The major goal of this research is to develop a networked collaborative surgical system for tele-immersive consultation, surgical pre-planning, implant design, post operative evaluation and education. Tele-immersion enables users in different locations to collaborate in a shared, virtual, or simulated environment as if they are in the same room. The process of implant design begins with CT data of the patient and the Personal Augmented Reality Immersive System (PARISTM). The implant is designed by medical professionals in tele-immersive collaboration. In the PARIS augmented reality system the user's hands and the virtual images appear superimposed in the same volume so the user can see what he is doing. A haptic device supplies the sense of touch by applying forces to a stylus that the medical modeler uses to form the implant. After the virtual model of the implant is designed, the data is sent via network to a stereolithography rapid prototyping system that creates the physical implant model. After implant surgery, the patient undergoes a postoperative CT scan and results are evaluated and reviewed over the tele-immersive consultation system.

[1]  Thomas Ertl,et al.  Parallel volume rendering using PC graphics hardware , 2001, Proceedings Ninth Pacific Conference on Computer Graphics and Applications. Pacific Graphics 2001.

[2]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[3]  James T. Kajiya,et al.  Ray tracing volume densities , 1984, SIGGRAPH.

[4]  Jason Leigh,et al.  New tools for sculpting cranial implants in a shared haptic augmented reality environment. , 2006, Studies in health technology and informatics.

[5]  Hui Chen,et al.  Real-time haptic sculpting in virtual volume space , 2002, VRST '02.

[6]  Anders Ynnerman,et al.  Proxy-based Haptic Feedback from Volumetric Density Data , 2002 .

[7]  Robert A. Ellis,et al.  Proceedings of the 11th annual conference on Computer graphics and interactive techniques , 1984, SIGGRAPH.

[8]  Michael J. Ackerman,et al.  Accessing the Visible Human Project , 1995, D Lib Mag..

[9]  Arie E. Kaufman,et al.  Haptic sculpting of dynamic surfaces , 1999, SI3D.

[10]  Zhuming Ai,et al.  Haptic Rendering of Volumetric Data for Cranial Implant Modeling , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[11]  Rashid Ansari,et al.  Adaptive Networking for Tele-Immersion , 2001, EGVE/IPT.

[12]  Taku Komura,et al.  Computing inverse kinematics with linear programming , 2005, VRST '05.

[13]  Hervé Delingette,et al.  Surgery Simulation and Soft Tissue Modeling , 2003, Lecture Notes in Computer Science.

[14]  F Dech,et al.  Radiological tele-immersion for next generation networks. , 2000, Studies in health technology and informatics.

[15]  Jason Leigh,et al.  Global Tele-Immersion Better Than Being There , 1997 .

[16]  Andrew E. Johnson,et al.  Designing cranial implants in a haptic augmented reality environment , 2004, CACM.

[17]  M. Bauer,et al.  Interactive volume on standard PC graphics hardware using multi-textures and multi-stage rasterization , 2000, Workshop on Graphics Hardware.

[18]  Hiroo Iwata,et al.  Volume haptization , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[19]  M Dujovny,et al.  Stereolithography for Posterior Fossa Cranioplasty , 1998, Skull base surgery.

[20]  Karl Heinz Höhne,et al.  Realistic Haptic Interaction in Volume Sculpting for Surgery Simulation , 2003, IS4TH.

[21]  F Dech,et al.  Manipulation of volumetric patient data in a distributed virtual reality environment. , 2001, Studies in health technology and informatics.

[22]  Brian Cabral,et al.  Accelerated volume rendering and tomographic reconstruction using texture mapping hardware , 1994, VVS '94.

[23]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[24]  Julie Dorsey,et al.  Virtual Sculpting with Haptic Displacement Maps , 2002, Graphics Interface.