A physically-based haptic rendering for telemanipulation with visual information: Macro and micro applications

This paper presents a haptic rendering technique for a telemanipulation system of deformable objects using image processing techniques and physically based modeling. The interaction forces between an instrument driven by a haptic device and a deformable object are inferred in real time based on a continuum mechanics model of the object, which consists of a boundary element model and a prior knowledge of the objectpsilas mechanical properties. These models allow users to feel reaction forces during manipulation tasks through a haptic device. Macro- and micro-scale experimental systems, equipped with a telemanipulation system and a commercial haptic display, were developed and tested using silicone (macro-scale) and zebrafish embryos (micro-scale). The developed algorithm can be used with a needle operation robot or a cellular injection system.

[1]  Masatoshi Ishikawa,et al.  Real-time system for virtually touching objects in the real world using modality transformation from images to haptic information , 1999, Systems and Computers in Japan.

[2]  Gaurav S. Sukhatme,et al.  A haptic-rendering technique based on hybrid surface representation , 2004, IEEE Computer Graphics and Applications.

[3]  Didier Y. R. Stainier,et al.  Zebrafish genetics and vertebrate heart formation , 2001, Nature Reviews Genetics.

[4]  B. Nelson,et al.  Mechanical analysis of chorion softening in prehatching stages of zebrafish embryos , 2006, IEEE Transactions on NanoBioscience.

[5]  Cagatay Basdogan,et al.  Efficient Point-Based Rendering Techniques for Haptic Display of Virtual Objects , 1999, Presence.

[6]  John Kenneth Salisbury,et al.  Haptic Rendering - Beyond Visual Computing , 2004, IEEE Computer Graphics and Applications.

[7]  Pasi Kallio,et al.  Manipulation of Living Biological Cells : Challenges in Automation , 2003 .

[8]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[9]  Alois Knoll,et al.  Haptic Feedback in a Telepresence System for Endoscopic Heart Surgery , 2007, PRESENCE: Teleoperators and Virtual Environments.

[10]  Cagatay Basdogan,et al.  Haptic Manipulation of Microspheres Using Optical Tweezers , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[11]  John F. Canny,et al.  Haptic interaction with global deformations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Dinesh K. Pai,et al.  Multiresolution green's function methods for interactive simulation of large-scale elastostatic objects , 2003, TOGS.

[13]  Jaydev P. Desai,et al.  A vision-based approach for estimating contact forces: Applications to robot-assisted surgery , 2005 .

[14]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[15]  Mehdi Ammi,et al.  Evaluation of 3D Pseudo-Haptic Rendering using Vision for Cell Micromanipulation , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Bradley J. Nelson,et al.  Biological Cell Injection Using an Autonomous MicroRobotic System , 2002, Int. J. Robotics Res..