Haptic rendering of objects with rigid and deformable parts

In many haptic applications, the user interacts with the virtual environment through a rigid tool. Tool-based interaction is suitable in many applications, but the constraint of using rigid tools is not applicable to some situations, such as the use of catheters in virtual surgery, or of a rubber part in an assembly simulation. Rigid-tool-based interaction is also unable to provide force feedback regarding interaction through the human hand, due to the soft nature of human flesh. In this paper, we address some of the computational challenges of haptic interaction through deformable tools, which forms the basis for direct-hand haptic interaction. We describe a haptic rendering algorithm that enables interactive contact between deformable objects, including self-collisions and friction. This algorithm relies on a deformable tool model that combines rigid and deformable components, and we present the efficient simulation of such a model under robust implicit integration.

[1]  J. Edward Colgate,et al.  Factors affecting the Z-Width of a haptic display , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[2]  Michael Ortega-Binderberger,et al.  A Six Degree-of-Freedom God-Object Method for Haptic Display of Rigid Bodies with Surface Properties , 2007, IEEE Transactions on Visualization and Computer Graphics.

[3]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[4]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[5]  Elaine Cohen,et al.  6-DOF Haptic Rendering Using Spatialized Normal Cone Search , 2005 .

[6]  Dinesh Manocha,et al.  Six-Degree-of-Freedom Haptic Rendering Using Incremental and Localized Computations , 2003, Presence: Teleoperators & Virtual Environments.

[7]  Ming C. Lin,et al.  A modular haptic rendering algorithm for stable and transparent 6-DOF manipulation , 2006, IEEE Transactions on Robotics.

[8]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[9]  Elizabeth A. Croft,et al.  Local Model of Interaction for Haptic Manipulation of Rigid Virtual Worlds , 2005, Int. J. Robotics Res..

[10]  Dinesh K. Pai,et al.  Staggered projections for frictional contact in multibody systems , 2008, SIGGRAPH Asia '08.

[11]  Christian Duriez,et al.  Signorini's contact model for deformable objects in haptic simulations , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Vincent Hayward,et al.  Multirate haptic simulation achieved by coupling finite element meshes through Norton equivalents , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[13]  John Kenneth Salisbury,et al.  Dynamic local models for stable multi-contact haptic interaction with deformable objects , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[14]  Matthias Teschner,et al.  Non-iterative Computation of Contact Forces for Deformable Objects , 2007, J. WSCG.

[15]  Haruhisa Kawasaki,et al.  Development of five-fingered haptic interface: HIRO-II , 2005, ICAT '05.

[16]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[17]  Brian Mirtich,et al.  A Survey of Deformable Modeling in Computer Graphics , 1997 .

[18]  Ming C. Lin,et al.  Sensation preserving simplification for haptic rendering , 2003, SIGGRAPH Courses.

[19]  Gabriel Zachmann,et al.  Collision Detection for Deformable Objects , 2004, Comput. Graph. Forum.

[20]  Miguel A. Otaduy,et al.  Haptic rendering of complex deformations through handle-space force linearization , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[21]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[22]  Manuel Ferre,et al.  Efficient human hand kinematics for manipulation tasks , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Stephane Cotin,et al.  Contact Model for Haptic Medical Simulations , 2008, ISBMS.

[24]  Markus H. Gross,et al.  Implicit Contact Handling for Deformable Objects , 2009, Comput. Graph. Forum.

[25]  J. Edward Colgate,et al.  Issues in the haptic display of tool use , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[26]  Andrew Nealen,et al.  Physically Based Deformable Models in Computer Graphics , 2006, Comput. Graph. Forum.

[27]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[28]  Jorge Barrio,et al.  MasterFinger: Multi-finger Haptic Interface for Collaborative Environments , 2008, EuroHaptics.

[29]  Markus H. Gross,et al.  Transparent Rendering of Tool Contact with Compliant Environments , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[30]  C. Karen Liu,et al.  Eurographics/ Acm Siggraph Symposium on Computer Animation (2008) Synthesis of Interactive Hand Manipulation , 2022 .

[31]  Elaine Cohen,et al.  Six degree-of-freedom haptic rendering using spatialized normal cone search , 2005, IEEE Transactions on Visualization and Computer Graphics.

[32]  Ahmed A. Shabana,et al.  Dynamics of Multibody Systems , 2020 .

[33]  Markus H. Gross,et al.  Interactive Virtual Materials , 2004, Graphics Interface.

[34]  Dinesh K. Pai,et al.  Musculotendon simulation for hand animation , 2008, ACM Trans. Graph..

[35]  Miguel. A. Otaduy,et al.  Sensation preserving "Simplication for haptic rendering" , 2003 .

[36]  Dinesh Manocha,et al.  Collision and Proximity Queries , 2004, Handbook of Discrete and Computational Geometry, 2nd Ed..

[37]  Jernej Barbic,et al.  Six-DoF Haptic Rendering of Contact Between Geometrically Complex Reduced Deformable Models , 2008, IEEE Transactions on Haptics.

[38]  Grigore C. Burdea,et al.  The Rutgers Master II-new design force-feedback glove , 2002 .

[39]  Tsuneya Kurihara,et al.  Modeling deformable human hands from medical images , 2004, SCA '04.

[40]  Jernej Barbic,et al.  Real-Time subspace integration for St. Venant-Kirchhoff deformable models , 2005, ACM Trans. Graph..

[41]  Ming C. Lin,et al.  Haptic Rendering : Foundations, Algorithms, and Applications , 2008 .

[42]  Hervé Delingette,et al.  Anisotropic elasticity and force extrapolation to improve realism of surgery simulation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[43]  Joseph O'Rourke,et al.  Handbook of Discrete and Computational Geometry, Second Edition , 1997 .

[44]  H. Delingette,et al.  Anisotropic Elasticity and Forces Extrapolation to Improve Realism ofSurgery , 2000 .

[45]  Domenico Prattichizzo,et al.  Real-time soft-finger grasping of physically based quasi-rigid objects , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[46]  Brian Mirtich,et al.  Fast and Accurate Computation of Polyhedral Mass Properties , 1996, J. Graphics, GPU, & Game Tools.

[47]  Christian Duriez,et al.  Realistic haptic rendering of interacting deformable objects in virtual environments , 2008, IEEE Transactions on Visualization and Computer Graphics.

[48]  Miguel A. Otaduy,et al.  Toward Haptic Rendering of Full-Hand Touch , 2009, CEIG.

[49]  Yoshitaka Adachi,et al.  Intermediate representation for stiff virtual objects , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[50]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[51]  James J. Troy,et al.  Six degree-of-freedom haptic rendering using voxel sampling , 1999, SIGGRAPH.

[52]  Eitan Grinspun,et al.  Robust treatment of simultaneous collisions , 2008, ACM Trans. Graph..