Haptic Rendering of Volume Data with Collision Determination Guarantee Using Ray Casting and Implicit Surface Representation

Haptic exploration adds an additional dimension to working with 3D data: a sense of touch. This is especially useful in areas such as medical simulation, training and pre-surgical planning, as well as in museum display, sculpting, CAD, military applications, assistive technology for blind and visually impaired, entertainment and others. There exist different surface- and voxel-based haptic rendering methods. Unaddressed practical problems for almost all of them are that no guarantees for collision detection could be given and/or that a special topological structure of objects is required. Here we present a novel and robust approach based on employing the ray casting technique to collision detection, which does not have the aforementioned drawbacks while guaranteeing nearly constant time complexity independent of data resolution. This is especially important for such delicate procedures as pre-operation planning. A collision response in the presented prototype system is rigid and operates on voxel data, and no precalculation is needed. Additionally, our collision response uses an implicit surface representation "on the fly", which can be used with dynamically changing objects.

[1]  Min Chen,et al.  Manipulating, Deforming and Animating Sampled Object Representations , 2007, Comput. Graph. Forum.

[2]  Frederick P. Brooks,et al.  Project GROPE-HapticDisplays for Scientific Visualization , 1990 .

[3]  Ming Wan,et al.  Quasi-Static Approximation for 6 Degrees-of-Freedom Haptic Rendering , 2003, IEEE Visualization.

[4]  Ming C. Lin,et al.  Stable and responsive six-degree-of-freedom haptic manipulation using implicit integration , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[5]  Nitish Swarup,et al.  Haptic interaction with deformable objects using real-time dynamic simulation , 1995 .

[6]  Mashhuda Glencross Session details: Exploiting perception in high-fidelity virtual environments , 2006, SIGGRAPH 2006.

[7]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[8]  Nigel W. John,et al.  Simulation of ultrasound guided needle puncture using patient specific data with 3D textures and volume haptics , 2008, Comput. Animat. Virtual Worlds.

[9]  Rüdiger Westermann,et al.  Acceleration techniques for GPU-based volume rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[10]  Ian R. Summers,et al.  A vibrotactile approach to tactile rendering , 2006, The Visual Computer.

[11]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[12]  Hiroshi Oyama,et al.  An interaction model between multiple deformable objects for realistic haptic force feedback in surgical simulations , 2002 .

[13]  Timo Ropinski,et al.  Accelerating Volume Raycasting using Occlusion Frustums , 2008, VG/PBG@SIGGRAPH.

[14]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[15]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[16]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[17]  Ming C. Lin,et al.  Haptic display of interaction between textured models , 2004, IEEE Visualization 2004.

[18]  Marc Levoy,et al.  Efficient ray tracing of volume data , 1990, TOGS.

[19]  Christian Duriez,et al.  Realistic haptic rendering of interacting deformable objects in virtual environments , 2008, IEEE Transactions on Visualization and Computer Graphics.

[20]  Roman Vlasov,et al.  Ray casting for collision detection in haptic rendering of volume data , 2012, I3D '12.

[21]  Boeing Phantom,et al.  Voxel-Based 6-DOF Haptic Rendering Improvements , 2006 .

[22]  Yoshitaka Adachi,et al.  Intermediate representation for stiff virtual objects , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[23]  Rene Weller,et al.  A unified approach for physically-based simulations and haptic rendering , 2009, Sandbox@SIGGRAPH.

[24]  Ming Wan,et al.  Quasi-static approach approximation for 6 degrees-of-freedom haptic rendering , 2003, IEEE Visualization, 2003. VIS 2003..

[25]  John Kenneth Salisbury,et al.  Constraint-based six degree-of-freedom haptic rendering of volume-embedded isosurfaces , 2011, 2011 IEEE World Haptics Conference.

[26]  Ming C. Lin,et al.  A modular haptic rendering algorithm for stable and transparent 6-DOF manipulation , 2006, IEEE Transactions on Robotics.

[27]  Ming C. Lin,et al.  A perceptually-inspired force model for haptic texture rendering , 2004, APGV '04.

[28]  George Baravdish,et al.  Higher Precision in Volume Haptics through Subdivision of Proxy Movements , 2008, EuroHaptics.

[29]  Jernej Barbic,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2007) Flipping with Physics: Motion Editing for Acrobatics , 2022 .

[30]  Gaurav S. Sukhatme,et al.  An implicit-based haptic rendering technique , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[32]  Dinesh Manocha,et al.  Six degree-of-freedom haptic display of polygonal models , 2000, Proceedings Visualization 2000. VIS 2000 (Cat. No.00CH37145).

[33]  Diego Gutierrez,et al.  Exploiting perception in high-fidelity virtual environments (Additional presentations from the 24th course are available on the citation page) , 2006, SIGGRAPH Courses.

[34]  C. Rezk-Salama,et al.  Advanced illumination techniques for GPU volume raycasting , 2008, SIGGRAPH ASIA Courses.

[35]  Suvranu De,et al.  Physically Realistic Virtual Surgery Using the Point-Associated Finite Field (PAFF) Approach , 2006, PRESENCE: Teleoperators and Virtual Environments.

[36]  Peter Willemsen,et al.  Six degree-of-freedom haptic rendering of complex polygonal models , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[37]  Miguel A. Otaduy,et al.  Volume haptic rendering with dynamically extracted isosurface , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[38]  Guido Böttcher,et al.  Haptic Interaction with Deformable Objects , 2011 .

[39]  Pat P. Banerjee,et al.  GPU-based elastic-object deformation for enhancement of existing haptic applications , 2007, 2007 IEEE International Conference on Automation Science and Engineering.

[40]  Cagatay Basdogan,et al.  Haptics in minimally invasive surgical simulation and training , 2004, IEEE Computer Graphics and Applications.

[41]  Dennis Allerkamp,et al.  Haptic two-finger contact with textiles , 2008, The Visual Computer.

[42]  Doug L. James,et al.  Real-time reduced large-deformation models and distributed contact for computer graphics and haptics , 2007 .

[43]  Timo Ropinski,et al.  Efficient Shadows for GPU-based Volume Raycasting , 2011 .

[44]  Jernej Barbic,et al.  Six-DoF Haptic Rendering of Contact Between Geometrically Complex Reduced Deformable Models , 2008, IEEE Transactions on Haptics.

[45]  Markus H. Gross,et al.  Transparent Rendering of Tool Contact with Compliant Environments , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[46]  Elaine Cohen,et al.  Six degree-of-freedom haptic rendering using spatialized normal cone search , 2005, IEEE Transactions on Visualization and Computer Graphics.

[47]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[48]  Miguel A. Otaduy,et al.  Haptic rendering of complex deformations through handle-space force linearization , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[49]  Franz-Erich Wolter,et al.  YaDiV—an open platform for 3D visualization and 3D segmentation of medical data , 2011, The Visual Computer.

[50]  Hiroshi Oyama,et al.  Haptic Force Feedback with an Interaction Model between Multiple Deformable Objects for Surgical Simulations , 2002 .

[51]  Karl-Ingo Friese,et al.  Entwicklung einer Plattform zur 3D-Visualisierung und -Segmentierung medizinischer Daten: YaDiV - Yet another Dicom Viewer , 2010 .

[52]  Markus H. Gross,et al.  Interactive Haptic Rendering of High-Resolution Deformable Objects , 2007, HCI.

[53]  Dennis Allerkamp,et al.  Multi-rate coupling of physical simulations for haptic interaction with deformable objects , 2010, The Visual Computer.

[54]  Ming C. Lin,et al.  6-dof haptic rendering using contact levels of detail and haptic textures , 2004 .

[55]  Suvranu De,et al.  Using the PhysX engine for physics‐based virtual surgery with force feedback , 2009, The international journal of medical robotics + computer assisted surgery : MRCAS.

[56]  Yeong-Hwa Chang,et al.  Development scheme of haptic-based system for interactive deformable simulation , 2010, Comput. Aided Des..

[57]  Markus Hadwiger,et al.  Real-time volume graphics , 2006, SIGGRAPH '04.

[58]  Christian Duriez,et al.  Signorini's contact model for deformable objects in haptic simulations , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[59]  J. Edward Colgate,et al.  Issues in the haptic display of tool use , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[60]  Dennis Allerkamp,et al.  Tactile Perception of Textiles in a Virtual-Reality System , 2010, Cognitive Systems Monographs.