Humanoid Multimodal Tactile-Sensing Modules

In this paper, we present a new generation of active tactile modules (i.e., HEX-O-SKIN), which are developed in order to approach multimodal whole-body-touch sensation for humanoid robots. To better perform like humans, humanoid robots need the variety of different sensory modalities in order to interact with their environment. This calls for certain robustness and fault tolerance as well as an intelligent solution to connect the different sensory modalities to the robot. Each HEX-O-SKIN is a small hexagonal printed circuit board equipped with multiple discrete sensors for temperature, acceleration, and proximity. With these sensors, we emulate the human sense of temperature, vibration, and light touch. Off-the-shelf sensors were utilized to speed up our development cycle; however, in general, we can easily extend our design with new discrete sensors, thereby making it flexible for further exploration. A local controller on each HEX-O-SKIN preprocesses the sensor signals and actively routes data through a network of modules toward the closest PC connection. Local processing decreases the necessary network and high-level processing bandwidth, while a local analog-to-digital conversion and digital-data transfers are less sensitive to electromagnetic interference. With an active data-routing scheme, it is also possible to reroute the data around broken connections-yielding robustness throughout the global structure while minimizing wirings. To support our approach, multiple HEX-O-SKIN are embedded into a rapid-prototyped elastomer skin material and redundantly connected to neighboring modules by just four ports. The wiring complexity is shifted to each HEX-O-SKIN such that a power and data connection between two modules is reduced to four noncrossing wires. Thus, only a very simple robot-specific base frame is needed to support and wire the HEX-O-SKIN to a robot. The potential of our multimodal sensor modules is demonstrated experimentally on a robot platform.

[1]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[2]  Gregory J. Gerling,et al.  The effect of fingertip microstructures on tactile edge perception , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[3]  Yasuo Kuniyoshi,et al.  A tactile distribution sensor which enables stable measurement under high and dynamic stretch , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[4]  Masayuki Inaba,et al.  Development of functional whole-body flesh with distributed three-axis force sensors to enable close interaction by humanoids , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Heinz Wörn,et al.  Tactile sensing for an anthropomorphic robotic hand: Hardware and signal processing , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  J. Engel,et al.  Polymer micromachined multimodal tactile sensors , 2005 .

[7]  Yonggang Huang,et al.  Stretchable and Foldable Silicon Integrated Circuits , 2008, Science.

[8]  J Edwards,et al.  Extracting textural features from tactile sensors , 2008, Bioinspiration & biomimetics.

[9]  Hiroyuki Shinoda,et al.  A sensor skin using wire-free tactile sensing elements based on optical connection , 2002, Proceedings of the 41st SICE Annual Conference. SICE 2002..

[10]  Shuo-Hung Chang,et al.  An integrated flexible temperature and tactile sensing array using PI-copper films ☆ , 2008 .

[11]  Hiroyuki Shinoda,et al.  A Sensitive Skin Using Wireless Tactile Sensing Elements , 2001 .

[12]  R.S. Dahiya,et al.  System approach: A paradigm for robotic tactile sensing , 2008, 2008 10th IEEE International Workshop on Advanced Motion Control.

[13]  Cynthia Breazeal,et al.  A Sensitive Skin for Robotic Companions Featuring Temperature, Force, and Electric Field Sensors , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Chia-Hsien Lin,et al.  Signal processing and fabrication of a biomimetic tactile sensor array with thermal, force and microvibration modalities , 2009, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[15]  Mark R. Cutkosky,et al.  A robust, low-cost and low-noise artificial skin for human-friendly robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Masayuki Inaba,et al.  Development of soft sensor exterior embedded with multi-axis deformable tactile sensor system , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[17]  Jivko Sinapov,et al.  Vibrotactile Recognition of Surface Textures by a Humanoid Robot , 2009 .

[18]  F. Castelli An integrated tactile-thermal robot sensor with capacitive tactile array , 1995, IAS '95. Conference Record of the 1995 IEEE Industry Applications Conference Thirtieth IAS Annual Meeting.

[19]  Sungchul Kang,et al.  Development of tactile sensor for detecting contact force and slip , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Yasutoshi Makino,et al.  Large Area Sensor Skin based on Two-Dimensional Signal Transmission Technology , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[21]  H. Shinoda,et al.  3D shape measuring sheet utilizing gravitational and geomagnetic fields , 2008, 2008 SICE Annual Conference.

[22]  G. Debrégeas,et al.  The Role of Fingerprints in the Coding of Tactile Information Probed with a Biomimetic Sensor , 2009, Science.

[23]  Hiroyuki Shinoda,et al.  Digital tactile sensing elements communicating through conductive skin layers , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[24]  T. Hoshi,et al.  - 1-A Tactile Sensing Element for a Whole Body Robot Skin , 2005 .

[25]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[26]  Takao Someya,et al.  A large-area, flexible pressure sensor matrix with organic field-effect transistors for artificial skin applications. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[27]  J. Heo,et al.  Tactile sensor arrays using fiber Bragg grating sensors , 2006 .

[28]  V. Maheshwari,et al.  High-Resolution Thin-Film Device to Sense Texture by Touch , 2006, Science.

[29]  Yoji Umetani,et al.  Identification of Incipient Slip Phenomena Based on The Circuit Output Signals of PVDF Film Strips E , 2004 .

[30]  M. Shimojo,et al.  A tactile sensor sheet using pressure conductive rubber with electrical-wires stitched method , 2004, IEEE Sensors Journal.

[31]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[32]  Gerardo Barroeta Pérez,et al.  S.N.A.K.E.: A Dynamically Reconfigurable Artificial Sensate Skin , 2006 .

[33]  J. Lima,et al.  A large area force sensor for smart skin applications , 2002, Proceedings of IEEE Sensors.

[34]  Lucia Beccai,et al.  A miniaturized and flexible optoelectronic sensing system for tactile skin , 2007 .

[35]  V. Lumelsky,et al.  Sensitive skin , 2000, IEEE Sensors Journal.

[36]  T. Shimizu,et al.  A new type of tactile sensor detecting contact force and hardness of an object , 2002, Technical Digest. MEMS 2002 IEEE International Conference. Fifteenth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.02CH37266).

[37]  R. Andrew Russell,et al.  A robust, sensitive and economical tactile sensor for a robotic manipulator , 2002 .

[38]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[39]  Yasuo Kuniyoshi,et al.  Wearable motion capture suit with full-body tactile sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[40]  Joseph A. Paradiso,et al.  Z-Tiles: building blocks for modular, pressure-sensing floorspaces , 2004, CHI EA '04.

[41]  Frank Clemens,et al.  Textile Pressure Sensor Made of Flexible Plastic Optical Fibers , 2008, Sensors.

[42]  Yasuo Kuniyoshi,et al.  Conformable and scalable tactile sensor skin for curved surfaces , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[43]  Kazumi Kobayashi,et al.  Relationship between the Structure of Human Finger Tissue and the Location of Tactile Receptors , 1998 .