Real-time haptic rendering of slowly deformable bodies based on two dimensional visual information for telemanipulation

This paper presents a real-time haptic rendering technique for deformable objects based on visual information about the intervention between a tool and a real object in a remote place. A user can feel the artificial reaction force through a haptic device in real-time when a slave system exerts manipulation tasks on a deformable object. Models of the deformable object and the manipulator are created from the captured image obtained with a CCD camera and the objects are recognized using image processing techniques. The force at a rate of 1 kHz for stable haptic interaction is deduced by extrapolating forces at a low update rate. The rendering algorithm developed was tested and validated on a test platform consisting of a one-dimensional indentation device and an off-the shelf force feedback device.

[1]  Oussama Khatib,et al.  A Haptic Teleoperation Approach Based on Contact Force Control , 2006, Int. J. Robotics Res..

[2]  John Kenneth Salisbury,et al.  Haptic rendering: programming touch interaction with virtual objects , 1995, I3D '95.

[3]  Jaydev P. Desai,et al.  A Novel Approach to Robotic Cardiac Surgery Using Haptics and Vision , 2002 .

[4]  Hervé Delingette,et al.  Improving realism of a surgery simulator: linear anisotropic elasticity, complex interactions and force extrapolation , 2002, Comput. Animat. Virtual Worlds.

[5]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[6]  Gaurav S. Sukhatme,et al.  A haptic-rendering technique based on hybrid surface representation , 2004, IEEE Computer Graphics and Applications.

[7]  Xinyu Liu,et al.  Real-Time High-Accuracy Micropipette Aspiration for Characterizing Mechanical Properties of Biological Cells , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[8]  Cagatay Basdogan,et al.  Haptics in minimally invasive surgical simulation and training , 2004, IEEE Computer Graphics and Applications.

[9]  Mubarak Shah,et al.  A Fast algorithm for active contours and curvature estimation , 1992, CVGIP Image Underst..

[10]  Masatoshi Ishikawa,et al.  Real-time system for virtually touching objects in the real world using modality transformation from images to haptic information , 1999, Systems and Computers in Japan.

[11]  John F. Canny,et al.  Haptic interaction with global deformations , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Yanhong Luo,et al.  Fusing force and vision feedback for manipulating deformable objects , 2001, J. Field Robotics.