A study of level-of-detail in haptic rendering

This paper presents an initial study of an approach to reduce computational overhead in haptic rendering of physically based models. Haptic rendering refers to the notion of adding physical properties and behavior, specifically a sense of touch or force feedback, to models of objects. In this way, a user through a haptic feedback device can feel interaction forces while visually observing the objects. Physically based modeling is particularly important when representing deformable objects. In this paper, an approach based on a mass-spring damper system is used in modeling deformable objects. Deformation due to interaction forces is obtained by solving a set of differential equations, a process that is in general computationally demanding. To reduce this demand, the notion of level-of-detail in haptic rendering is introduced. Here the interplay between the graphical mesh and the haptic mesh as a function of various levels of subdivision is studied. The approach we describe is to adjust model parameters such that the user feels the same reaction force for a given deformation, regardless of the level of local subdivision.A preliminary user study with simple objects suggests there can be a local subdivision threshold such that the user cannot distinguish between global subdivision and the local subdivision introduced by the level-of-detail algorithm. This conclusion is beneficial for haptic rendering of deformable objects. Similar conclusions were obtained for haptic rendering of rigid objects. These results can be used as a guideline for other approaches to modeling deformable objects, such as finite element representations.

[1]  Frank Tendick,et al.  Multirate simulation for high fidelity haptic interaction with deformable objects in virtual environments , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[2]  Eric R. Ziegel,et al.  Probability and Statistics for Engineering and the Sciences , 2004, Technometrics.

[3]  Mary Hegarty,et al.  A Virtual Environment Testbed for Training Laparoscopic Surgical Skills , 2000, Presence: Teleoperators & Virtual Environments.

[4]  S. Jackson,et al.  ‘Action binding’: dynamic interactions between vision and touch , 2001, Trends in Cognitive Sciences.

[5]  Suvranu De,et al.  An integral equation based multiresolution modeling scheme for multimodal medical simulations , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[6]  Hong Qin,et al.  A novel FEM-based dynamic framework for subdivision surfaces , 2000, Comput. Aided Des..

[7]  Bernd Girod,et al.  Anatomy-based facial tissue modeling using the finite element method , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[8]  Shahram Payandeh,et al.  On interacting with physics-based models of graphical objects , 2004, Robotica.

[9]  Mathieu Desbrun,et al.  Dynamic real-time deformations using space & time adaptive sampling , 2001, SIGGRAPH.

[10]  M A Srinivasan,et al.  Development and evaluation of an epidural injection simulator with force feedback for medical training. , 2001, Studies in health technology and informatics.

[11]  Naokazu Yokoya,et al.  Elastic Object Manipulation with Force Feedback Using Coarse-to-fine Representation of Mass-Spring Models in Virtual Environment , 2001 .

[12]  Christian Laugier,et al.  Towards a realistic echographic simulator with force feedback , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[13]  Charles T. Loop,et al.  Smooth Subdivision Surfaces Based on Triangles , 1987 .

[14]  Markus H. Gross,et al.  Simulating facial surgery using finite element models , 1996, SIGGRAPH.

[15]  Hong Qin,et al.  A novel FEM-based dynamic framework for subdivision surfaces , 1999, SMA '99.

[16]  M A Srinivasan,et al.  A meshless numerical technique for physically based real time medical simulations. , 2001, Studies in health technology and informatics.

[17]  R. Klatzky,et al.  Tactile roughness perception with a rigid link interposed between skin and surface , 1999, Perception & psychophysics.

[18]  M. Sabin,et al.  Behaviour of recursive division surfaces near extraordinary points , 1978 .

[19]  Richard E. Parent,et al.  Layered construction for deformable animated characters , 1989, SIGGRAPH.

[20]  Herve Delingette,et al.  Real-Time Elastic Deformations of Soft Tissues for Surgery Simulation , 1999, IEEE Trans. Vis. Comput. Graph..

[21]  R. Larsen An introduction to mathematical statistics and its applications / Richard J. Larsen, Morris L. Marx , 1986 .

[22]  Matthew Ming-Fai Yuen,et al.  Cloth simulation using multilevel meshes , 2001, Comput. Graph..

[23]  Mandayam A. Srinivasan,et al.  Force Shading for Haptic Shape Perception , 1996, Dynamic Systems and Control.

[24]  Dinesh K. Pai,et al.  ArtDefo: accurate real time deformable objects , 1999, SIGGRAPH.

[25]  Hiroo Iwata,et al.  Haptic interfaces , 2002 .

[26]  Sarah A. Douglas,et al.  Application-based evaluation of haptic interfaces , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[27]  John F. Canny,et al.  Haptic interaction with global deformations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[28]  Peter Schröder,et al.  Interpolating Subdivision for meshes with arbitrary topology , 1996, SIGGRAPH.

[29]  Hui Zhang,et al.  On cutting and dissection of virtual deformable objects , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[30]  Frank Tendick,et al.  Adaptive Nonlinear Finite Elements for Deformable Body Simulation Using Dynamic Progressive Meshes , 2001, Comput. Graph. Forum.

[31]  Leif Kobbelt,et al.  Interpolatory Subdivision on Open Quadrilateral Nets with Arbitrary Topology , 1996, Comput. Graph. Forum.

[32]  Peter J. Hunter,et al.  A virtual environment and model of the eye for surgical simulation , 1994, SIGGRAPH.

[33]  Philip H. Ramsey Nonparametric Statistical Methods , 1974, Technometrics.

[34]  Gavin S. P. Miller,et al.  The motion dynamics of snakes and worms , 1988, SIGGRAPH.

[35]  M. A. Srinivassan The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[36]  Vincent Hayward,et al.  Force can overcome object geometry in the perception of shape through active touch , 2001, Nature.

[37]  E. Catmull,et al.  Recursively generated B-spline surfaces on arbitrary topological meshes , 1978 .

[38]  Ian Oakley,et al.  Putting the feel in ’look and feel‘ , 2000, CHI.

[39]  P. Meseure,et al.  Deformable Body Simulation with adaptive subdivision and cuttings , 1997 .

[40]  Terry Hewitt,et al.  Adaptive refinement for mass/spring simulations , 1996 .

[41]  Jian Zhang,et al.  Haptic subdivision: an approach to defining level-of-detail in haptic rendering , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.