Comparison of Algorithms for Haptic Interaction With Isosurfaces Extracted From Volumetric Datasets

Combinations of graphics and haptics libraries are used in medical simulations for simultaneous visualization and tactile interaction with complex 3D anatomy models. The minimum frame rate of 1 kHz for haptics rendering makes it a nontrivial problem when dealing with complex and highly detailed polygonal models. Multiple haptics algorithms based on polygonal mesh rendering, volume haptics, and intermediate representation are evaluated in terms of their servoloop rendering time, client thread rendering time, and quality of force feedback. Algorithms include OpenHaptics' Feedback Buffer and Depth Buffer, GodObject and Ruspini renderers in h3d, chai3d implementation in h3d, ScalarSurfaceFriction mode in Volume Haptics ToolKit (vhtk), and the authors' intermediate representation algorithm based on volumetric data. The latter, in combination with surface graphics visualization, is found to deliver the best rendering time, to detect all collisions and to provide correct haptic feedback where other algorithms fail.

[1]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[2]  Karl Heinz Höhne,et al.  Haptic volume interaction with anatomic models at sub-voxel resolution , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[3]  William Schroeder,et al.  The Visualization Toolkit: An Object-Oriented Approach to 3-D Graphics , 1997 .

[4]  Pheng-Ann Heng,et al.  Direct haptic rendering of isosurface by intermediate representation , 2000, VRST '00.

[5]  Sarah Gibson,et al.  Beyond Volume Rendering: Visualization, Haptic Exploration, and Physical Modeling of Voxel-based Objects , 1995 .

[6]  Cagatay Basdogan,et al.  A Ray-Based Haptic Rendering Technique for Displaying Shape and Texture of 3D Objects in Virtual Environments , 1997, Dynamic Systems and Control.

[7]  Reinhard Männer,et al.  Haptic Volume Rendering with an Intermediate Local Representation , 1999 .

[8]  Anders Ynnerman,et al.  The Orthogonal Constraints Problem with the Constraint Approach to Proxy-based Volume Haptics and a Solution , 2005 .

[9]  Cagatay Basdogan,et al.  Three-Degree-Of-Freedom Rendering , 2007 .

[10]  Hiroo Iwata,et al.  Volume haptization , 1993, Proceedings of 1993 IEEE Research Properties in Virtual Reality Symposium.

[11]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[12]  Ricardo S. Avila,et al.  A haptic interaction method for volume visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[13]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[14]  Fady Charbel,et al.  Second generation haptic ventriculostomy simulator using the ImmersiveTouch system. , 2006, Studies in health technology and informatics.

[15]  Thenkurussi Kesavadas,et al.  Experimental Evaluation of Shared Control for Rehabilitation of Fine Motor Skills , 2009, J. Comput. Inf. Sci. Eng..

[16]  Anders Ynnerman,et al.  Proxy-based Haptic Feedback from Volumetric Density Data , 2002 .

[17]  Weihang Zhu,et al.  The OpenHaptics/spl trade/ toolkit: a library for adding 3D Touch/spl trade/ navigation and haptics to graphics applications , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[18]  Anders Ynnerman,et al.  Haptic Rendering of Dynamic Volumetric Data , 2008, IEEE Transactions on Visualization and Computer Graphics.

[19]  Karljohan E. Lundin Palmerius,et al.  Direct Volume Haptics for Visualization , 2007 .

[20]  Yoshitaka Adachi,et al.  Intermediate representation for stiff virtual objects , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[21]  Anders Ynnerman,et al.  General proxy-based haptics for volume visualization , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[22]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[23]  John Kenneth Salisbury,et al.  Visuohaptic simulation of bone surgery for training and evaluation , 2006, IEEE Computer Graphics and Applications.

[24]  Anders Ynnerman,et al.  Enabling design and interactive selection of haptic modes , 2007, Virtual Reality.

[25]  Dan Morris,et al.  Standardized Evaluation of Haptic Rendering Systems , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[26]  Karljohan E. Lundin Palmerius,et al.  Fast and High Precision Volume Haptics , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[27]  Pat P. Banerjee,et al.  Haptic interaction with volumetric datasets using surface-based haptic libraries , 2010, 2010 IEEE Haptics Symposium.

[28]  Pat P. Banerjee,et al.  Automating the Extraction of 3D Models from Medical Images for Virtual Reality and Haptic Simulations , 2007, 2007 IEEE International Conference on Automation Science and Engineering.