Adaptive techniques for real-time haptic and visual simulation of bone dissection

Bone dissection is an important component of many surgical procedures. In this paper we discuss adaptive techniques for providing real-time haptic and visual feedback during a virtual bone dissection simulation. The simulator is being developed as a component of a training system for temporal bone surgery. We harness the difference in complexity and frequency requirements of the visual and haptic simulations by modeling the system as a collection of loosely coupled concurrent components. The haptic component exploits a multi-resolution representation of the first two moments of the bone characteristic function to rapidly compute contact forces and determine bone erosion. The visual component uses a time-critical particle system evolution method to simulate secondary visual effects, such as bone debris accumulation, blooding, irrigation, and suction.

[1]  Karl Heinz Höhne,et al.  Haptic volume interaction with anatomic models at sub-voxel resolution , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[2]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[3]  J. Edward Colgate,et al.  Issues in the haptic display of tool use , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[4]  Karl Heinz Höhne,et al.  Volume Based Planning and Rehearsal of Surgical Interventions , 2000 .

[5]  Stephane Cotin,et al.  Real Time Volumetric Deformable Models for Surgery Simulation , 1996, VBC.

[6]  Blake Hannaford,et al.  Stable haptic interaction with virtual environments , 1999, IEEE Trans. Robotics Autom..

[7]  S. Timoshenko,et al.  Theory of elasticity , 1975 .

[8]  Alejandro M. García-Alonso,et al.  Solving the collision detection problem , 1994, IEEE Computer Graphics and Applications.

[9]  W. Eric L. Grimson,et al.  Volumetric object modeling for surgical simulation , 1998, Medical Image Anal..

[10]  Gregory J. Wiet,et al.  Virtual temporal bone dissection: a case study , 2001, Proceedings Visualization, 2001. VIS '01..

[11]  Andrea Giachetti,et al.  A multiprocessor decoupled system for the simulation of temporal bone surgery , 2002 .

[12]  W. H. Reid,et al.  The Theory of Elasticity , 1960 .

[13]  James J. Troy,et al.  Six degree-of-freedom haptic rendering using voxel sampling , 1999, SIGGRAPH.

[14]  R B Loftin,et al.  Building a virtual reality temporal bone dissection simulator. , 1997, Studies in health technology and informatics.

[15]  J. Andreas Bærentzen,et al.  Octree–based Volume Sculpting , 1998 .

[16]  Arie E. Kaufman,et al.  Volume sculpting , 1995, I3D '95.

[17]  D Stredney,et al.  Virtual temporal bone dissection simulation. , 2000, Studies in health technology and informatics.

[18]  Jessica K. Hodgins,et al.  Animating Sand, Mud, and Snow , 1999, Comput. Graph. Forum.

[19]  Andrea Giachetti,et al.  An integrated simulator for surgery of the petrous bone. , 2001, Studies in health technology and informatics.

[20]  Ronald N. Perry,et al.  Adaptively sampled distance fields: a general representation of shape for computer graphics , 2000, SIGGRAPH.

[21]  John F. Hughes,et al.  Sculpting: an interactive volumetric modeling technique , 1991, SIGGRAPH.

[22]  N. Tayama,et al.  Three-dimensional reconstruction of the temporal bone from histologic sections. , 1988, Archives of otolaryngology--head & neck surgery.

[23]  Kimerly Powell,et al.  Temporal bone dissection simulation--an update. , 2002, Studies in health technology and informatics.

[24]  Sarah F. Frisken.  Using Linked Volumes to Model Object Collisions, Deformation, Cutting, Carving, and Joining , 1999, IEEE Trans. Vis. Comput. Graph..

[25]  K. B. Shimoga,et al.  Finger Force and Touch Feedback Issues in Dexterous Telemanipulation , 1992, Proceedings. Fourth Annual Conference on Intelligent Robotic Systems for Space Exploration.

[26]  Arie E. Kaufman,et al.  Collision detection for volumetric objects , 1997 .

[27]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[28]  Dinesh K. Pai,et al.  A unified treatment of elastostatic contact simulation for real time haptics , 2005, SIGGRAPH Courses.

[29]  Andrea Giachetti,et al.  Mastoidectomy simulation with combined visual and haptic feedback. , 2002, Studies in health technology and informatics.

[30]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[31]  Randy E. Ellis,et al.  Numerical Methods for the Force Reflection of Contact , 1997 .

[32]  Xin Li,et al.  Modeling soil: realtime dynamic models for soil slippage and manipulation , 1993, SIGGRAPH.

[33]  W. C. Leliever,et al.  Temporal Bone Surgical Dissection Manual , 1983 .

[34]  Marie-Paule Cani,et al.  Practical volumetric sculpting , 2000, The Visual Computer.

[35]  P. Schmalbrock,et al.  Virtual Temporal Bone Dissection: An Interactive Surgical Simulator , 2002, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[36]  Andrea Giachetti,et al.  Real-Time Haptic and Visual Simulation of Bone Dissection , 2002, Presence: Teleoperators & Virtual Environments.