Haptic interaction with global deformations

Force feedback coupled with a real-time physically realistic graphic display provides a human operator with an artificial sense of presence in a virtual environment. Furthermore, it allows a human operator to interact with the virtual environment through "touch". We describe a haptic simulation system that allows a human operator to perform real-time interaction with soft 3D objects that go through large global deformations. We model and simulate such a global deformation using geometrically nonlinear finite element methods (FEM). We also introduce an efficient method that computes the force feedback, in real-time, by simulating the collision between the virtual "proxy" and the deformable object. To perceptually satisfy a human operator, haptics requires a much higher update frequency (at least 1000 Hz) than graphics. We update the graphics using full simulation and interpolate the fully simulated states at a higher frequency to render haptics. The interpolation is made possible by intentionally delaying the display (both graphics and haptics) by one full simulation cycle.

[1]  John Canny,et al.  Impulse-Based Dynamic Simulation , 1995 .

[2]  Demetri Terzopoulos,et al.  Physically based models with rigid and deformable components , 1988, IEEE Computer Graphics and Applications.

[3]  J. Reddy An introduction to the finite element method , 1989 .

[4]  Bernd Girod,et al.  Anatomy-based facial tissue modeling using the finite element method , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[5]  O. C. Zienkiewicz,et al.  The finite element method, fourth edition; volume 2: solid and fluid mechanics, dynamics and non-linearity , 1991 .

[6]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[7]  Brian Mirtich,et al.  A Survey of Deformable Modeling in Computer Graphics , 1997 .

[8]  John F. Canny,et al.  Impulse-based simulation of rigid bodies , 1995, I3D '95.

[9]  J. Z. Zhu,et al.  The finite element method , 1977 .

[10]  Oussama Khatib,et al.  Haptic interaction in virtual environments , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[11]  Yoshitaka Adachi,et al.  Intermediate representation for stiff virtual objects , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[12]  James M. Van Verth,et al.  Adding force feedback to graphics systems: issues and solutions , 1996, SIGGRAPH.

[13]  John Kenneth Salisbury,et al.  A constraint-based god-object method for haptic display , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[14]  Xavier Provot,et al.  Deformation Constraints in a Mass-Spring Model to Describe Rigid Cloth Behavior , 1995 .

[15]  Oussama Khatib,et al.  The haptic display of complex graphical environments , 1997, SIGGRAPH.

[16]  Andrew P. Witkin,et al.  Dynamic simulation of non-penetrating flexible bodies , 1992, SIGGRAPH.

[17]  H. Westergaard,et al.  Theory of Elasticity and Plasticity , 1966 .

[18]  Frederick P. Brooks,et al.  Feeling and seeing: issues in force display , 1990, I3D '90.

[19]  Demetri Terzopoulos,et al.  Physically-based facial modelling, analysis, and animation , 1990, Comput. Animat. Virtual Worlds.

[20]  David Baraff,et al.  Interactive simulation of solid rigid bodies , 1995, IEEE Computer Graphics and Applications.

[21]  Demetri Terzopoulos,et al.  Modeling inelastic deformation: viscolelasticity, plasticity, fracture , 1988, SIGGRAPH.

[22]  Keith Waters,et al.  A muscle model for animation three-dimensional facial expression , 1987, SIGGRAPH.

[23]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[24]  Vernon L. Chi,et al.  Surface modification tools in a virtual environment interface to a scanning probe microscope , 1995, I3D '95.

[25]  O. C. Zienkiewicz,et al.  The Finite Element Method: Basic Formulation and Linear Problems , 1987 .

[26]  Steven D. Pieper,et al.  Interactive graphics for plastic surgery: a task-level analysis and implementation , 1992, I3D '92.

[27]  David Zeltzer,et al.  Pump it up: computer animation of a biomechanically based model of muscle using the finite element method , 1992, SIGGRAPH.

[28]  Andrew Witkin An Introduction to Physically Based Modeling: Differential Equation Basics , 1997 .

[29]  Oussama Khatib,et al.  DYNAMIC MODELS FOR HAPTIC RENDERING SYSTEMS , 1998 .

[30]  George Celniker,et al.  Deformable curve and surface finite-elements for free-form shape design , 1991, SIGGRAPH.

[31]  Andrew P. Witkin,et al.  Large steps in cloth simulation , 1998, SIGGRAPH.

[32]  C. Truesdell Review: H. M. Westergaard, Theory of elasticity and plasticity , 1953 .

[33]  Pierre Baconnier,et al.  Physically‐Based Deformations Constrained in Displacements and Volume , 1996, Comput. Graph. Forum.

[34]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[35]  F. Brooks,et al.  Force display in molecular docking , 1990 .