A High Performance Tactile Feedback Display and Its Integration in Teleoperation

This paper presents the development of a compact tactile display and its integration in teleoperation. The system's operation is based on the display of surface shape to an area of the fingertip through a 4 × 4 array of tactors moving perpendicularly to the skin surface. The tactors are spring loaded and are actuated remotely by dc motors through a flexible tendon transmission. This novel implementation of conventional actuation principles achieves a compact design with superior performance compared to devices of a similar footprint, demonstrating an excellent combination of tactor spatiotemporal resolution, force, and amplitude. The display's ergonomic design and high performance make it suitable for integration on haptic devices for tactile feedback in VR and in Teleoperation. This paper presents the design, control, and performance of the tactile display and of the transmission system. It also demonstrates its integration on an Omega7 force feedback device for the teleoperation of an LWR KUKA manipulator. An experiment is presented where users teleoperated the stylus of the robot in a 3D contour following task with and without tactile feedback. In this experiment, force feedback from the slave is fused with model-based local tactile feedback. Subjects' performances indicate an improvement in teleoperation when both tactile and force feedback are present.

[1]  Erik Millán,et al.  Impostors, Pseudo-instancing and Image Maps for GPU Crowd Rendering , 2007, Int. J. Virtual Real..

[2]  S. Kawamura,et al.  Analysis of stiffness of human fingertip and comparison with artificial fingers , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[3]  Jérémy Streque,et al.  New Magnetic Microactuator Design Based on PDMS Elastomer and MEMS Technologies for Tactile Display , 2010, IEEE Transactions on Haptics.

[4]  Catherine E. Lewis,et al.  Tactile Feedback Induces Reduced Grasping Force in Robot-Assisted Surgery , 2009, IEEE Transactions on Haptics.

[5]  Nikolaos G. Tsagarakis,et al.  Effect of the tactile array density on the discrimination of edge patterns: Implications for tactile systems design , 2009, 2009 International Conference on Advanced Robotics.

[6]  Robert D. Howe,et al.  A tactile shape sensing and display system for teleoperated manipulation , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[7]  Giorgio Metta,et al.  A tactile sensor for the fingertips of the humanoid robot iCub , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Hong Z. Tan,et al.  Edge sharpness perception with force and contact location information , 2011, 2011 IEEE World Haptics Conference.

[9]  Takashi Maeno,et al.  Development of a Grounded Haptic Device and a 5-Fingered Robot Hand for Dexterous Teleoperation , 2004 .

[10]  Mandayam A. Srinivasan,et al.  Tangential versus normal displacements of skin: relative effectiveness for producing tactile sensations , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[11]  Robert D. Howe,et al.  Multi-channel vibrotactile display for teleoperated assembly , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  O. Ducloux,et al.  Vibrotactile using micromachined electromagnetic actuators array , 2006 .

[13]  Parris S. Wellman,et al.  TEMPORAL BANDWIDTH REQUIREMENTS FOR TACTILE SHAPE DISPLAYS , 1997 .

[14]  Massimo Bergamasco,et al.  From Physics-based Simulation to the Touching of Textiles: The HAPTEX Project , 2007, Int. J. Virtual Real..

[15]  Kenneth O. Johnson,et al.  A dense array stimulator to generate arbitrary spatio-temporal tactile stimuli , 2007, Journal of Neuroscience Methods.

[16]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[17]  Pierre Letier,et al.  EXOSTATION : Haptic exoskeleton based control station , 2010, 2010 IEEE International Conference on Robotics and Automation.

[18]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[19]  Ronald S. Fearing,et al.  Human tactile spatial sensitivity for tactile feedback , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[20]  Vincent Hayward,et al.  Tactile Display Device Using Distributed Lateral Skin Stretch , 2000, Dynamic Systems and Control: Volume 2.

[21]  Hiroyuki Shinoda,et al.  Necessary spatial resolution for realistic tactile feeling display , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[22]  Dong-Soo Kwon,et al.  A compact broadband tactile display and its effectiveness in the display of tactile form , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[23]  Jérôme Szewczyk,et al.  A low-cost highly-portable tactile display based on shape memory alloy micro-actuators , 2005, IEEE Symposium on Virtual Environments, Human-Computer Interfaces and Measurement Systems, 2005..

[24]  Y. Shen,et al.  Haptic tactile feedback in teleoperation of a multifingered robot hand , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[25]  Nikolaos G. Tsagarakis,et al.  SLIP AESTHEASIS: a portable 2D slip/skin stretch display for the fingertip , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[26]  Hyoukryeol Choi,et al.  Development of Soft-Actuator-Based Wearable Tactile Display , 2008, IEEE Transactions on Robotics.

[27]  Robert D. Howe,et al.  Tactile Display of High-Frequency Information in Teleoperation and Virtual Environments. , 1995 .

[28]  Gerd Hirzinger,et al.  Learning techniques in a dataglove based telemanipulation system for the DLR hand , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[29]  Christopher R. Wagner,et al.  A compliant tactile display for teletaction , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[30]  Jun-Young Lee,et al.  Ubi-Pen: A Haptic Interface with Texture and Vibrotactile Display , 2009, IEEE Computer Graphics and Applications.

[31]  Aude Billard,et al.  A survey of Tactile Human-Robot Interactions , 2010, Robotics Auton. Syst..

[32]  D. Beebe,et al.  A microfabricated electrostatic haptic display for persons with visual impairments. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[33]  Haruhisa Kawasaki,et al.  Dexterous anthropomorphic robot hand with distributed tactile sensor: Gifu hand II , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[34]  Allan M. Smith,et al.  Deployment of fingertip forces in tactile exploration , 2002, Experimental Brain Research.

[35]  Vincent Hayward,et al.  Local Surface Orientation Dominates Haptic Curvature Discrimination , 2009, IEEE Transactions on Haptics.

[36]  H. Shinoda,et al.  High resolution tactile display using acoustic radiation pressure , 2004, SICE 2004 Annual Conference.

[37]  Susan J. Lederman,et al.  Design and Performance of a Tactile Shape Display Using RC Servomotors (Short Paper) , 2004 .

[38]  Allison M. Okamura,et al.  Methods for haptic feedback in teleoperated robot-assisted surgery , 2004 .

[39]  Susumu Tachi,et al.  Efficient object exploration and object presentation in TeleTA, Teleoperation system with Tactile feedback , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[40]  Mandayam A. Srinivasan,et al.  Human fingerpad under indentation I: static and dynamic force response , 1995 .

[41]  Øyvind Stavdahl,et al.  Design and Performance of a Prototype Tactile Shape Display for Minimally Invasive Surgery , 2008 .

[42]  Antonio Frisoli,et al.  A Fingertip Haptic Display for Improving Curvature Discrimination , 2008, PRESENCE: Teleoperators and Virtual Environments.

[43]  F. Vidal-Verdu,et al.  Graphical Tactile Displays for Visually-Impaired People , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.