Integration of a tactile display in teleoperation of a soft robotic finger using model based tactile feedback

Tactile feedback is a key modality in object exploration and manipulation. However it has not been satisfactorily addressed in master-slave teleoperation. One of the reasons is that current tactile displays do not satisfy the stringent performance and design requirements for integration in master haptic devices. This paper presents the integration of a compact, high performance tactile display in a teleoperation setup. In this scenario the tactile display provides tactile feedback while remote objects are being contacted through a soft robotic finger. The display is mounted on a force feedback master device, which controls a manipulator equipped with a force sensor and a soft finger. Force feedback and tactile feedback are combined in a hybrid approach. Force feedback on the master reflects the measured remote interaction forces while tactile feedback is model based. This hybrid feedback method can provide force and tactile information in cases of highly structured teleoperation scenes where tactile sensing is absent or rudimentary while accurate environment models exist. An experiment is presented where users teleoperated the robot finger in a 3D contour following task with and without tactile feedback. Subjects' performances indicate an improvement in teleoperation when both tactile and force feedback are present.

[1]  Nikolaos G. Tsagarakis,et al.  A portable fingertip tactile feedback array - transmission system reliability and modelling , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[2]  Y. Shen,et al.  Haptic tactile feedback in teleoperation of a multifingered robot hand , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[3]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[4]  Nikolaos G. Tsagarakis,et al.  A compact tactile display suitable for integration in VR and teleoperation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  Christopher R. Wagner,et al.  A compliant tactile display for teletaction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  Nikolaos G. Tsagarakis,et al.  Free to Touch: A Portable Tactile Display For 3D Surface Texture Exploration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Jérémy Streque,et al.  New Magnetic Microactuator Design Based on PDMS Elastomer and MEMS Technologies for Tactile Display , 2010, IEEE Transactions on Haptics.

[8]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[9]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[10]  Satoshi Tadokoro,et al.  Alternative Display of Friction Represented by Tactile Stimulation without Tangential Force , 2008, EuroHaptics.

[11]  Øyvind Stavdahl,et al.  Design and Performance of a Prototype Tactile Shape Display for Minimally Invasive Surgery , 2008 .

[12]  Susumu Tachi,et al.  Efficient object exploration and object presentation in TeleTA, Teleoperation system with Tactile feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[13]  Hervé Delingette,et al.  Integrating Tactile and Force Feedback with Finite Element Models , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[14]  Robert D. Howe,et al.  Tactile Display of High-Frequency Information in Teleoperation and Virtual Environments. , 1995 .

[15]  Robert D. Howe,et al.  A tactile shape sensing and display system for teleoperated manipulation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[16]  Jun-Young Lee,et al.  Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display , 2009, IEEE Computer Graphics and Applications.

[17]  S. Kawamura,et al.  Analysis of stiffness of human fingertip and comparison with artificial fingers , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[18]  Dong-Soo Kwon,et al.  A compact broadband tactile display and its effectiveness in the display of tactile form , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.