Evaluation of a Large Scale Event Driven Robot Skin

This letter evaluates and describes the large-scale integration of our multi-modal event-driven robot skin system on our humanoid robot H1 (REEM-C, PAL robotics). The robot skin is powered by the robot and all processing of tactile perception and control are executed onboard the robot. The robot skin system largely covers the humanoid and employs 1260 skin cells in 47 skin patches, in total 7560 multi-modal tactile sensors. The robot skin system is driven by events, i.e., the occurrence of novel information drives the acquisition, transmission, and processing of information rather than the synchronous sampling clock as in clock-driven systems. The event-driven robot skin system enables efficient multi-modal large area tactile perception, which is a prerequisite for realizing reactive whole-body control. We analyze the new robot skin system and evaluate its performance in clock-driven mode and event-driven mode. This analysis includes modeling the required CPU load and investigating the scaling of the system in multi-core systems. We evaluate the robot skin system with an experiment, where a large number of skin cells is activated ($>$680 cells), and a large number of events is generated. The obtained results demonstrate the superior performance of the event-driven system. In the clock-driven mode, the robot skin system constantly produces 315 000 packets/s, while in event-driven mode the system at most produces 40 000 packets/s (13%). The CPU load reduces from constantly 270% to at most 100% (37%). In clock-driven mode, the PC drops on average 80 000 packets/s (25% of all packets), while in event-driven mode, the package loss is practically neglectable. This efficient large-scale robot skin enables the complete onboard integration into a humanoid robot without the need for additional external power or processing capabilities.

[1]  Helge J. Ritter,et al.  A highly sensitive 3D-shaped tactile sensor , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[2]  Gordon Cheng,et al.  Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot , 2015, Adv. Robotics.

[3]  Zhiwei Luo,et al.  Development of the Tactile Sensor System of a Human-Interactive Robot “RI-MAN” , 2008, IEEE Transactions on Robotics.

[4]  Maurizio Valle,et al.  Asynchronous, event-driven readout of POSFET devices for tactile sensing , 2014, 2014 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  Gordon Cheng,et al.  A Comprehensive Realization of Robot Skin: Sensors, Sensing, Control, and Applications , 2019, Proceedings of the IEEE.

[6]  Michael Strohmayr,et al.  Artificial Skin in Robotics , 2012 .

[7]  T. Someya,et al.  Conformable, flexible, large-area networks of pressure and thermal sensors with organic transistor active matrixes. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Gordon Cheng,et al.  Whole-Body Active Compliance Control for Humanoid Robots with Robot Skin , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[9]  G.E. Loeb,et al.  A robust micro-vibration sensor for biomimetic fingertips , 2008, 2008 2nd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[10]  Gordon Cheng,et al.  Event-based signaling for large-scale artificial robotic skin - realization and performance evaluation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Giorgio Metta,et al.  Methods and Technologies for the Implementation of Large-Scale Robot Tactile Sensors , 2011, IEEE Transactions on Robotics.

[12]  Tamim Asfour,et al.  ARMAR-III: An Integrated Humanoid Platform for Sensory-Motor Control , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[13]  Gordon Cheng,et al.  Enhancing Biped Locomotion on Unknown Terrain Using Tactile Feedback , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[14]  V. Lumelsky,et al.  Sensitive skin , 2000, IEEE Sensors Journal.

[15]  Chiara Bartolozzi,et al.  Event-driven encoding of off-the-shelf tactile sensors for compression and latency optimisation for robotic skin , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[17]  Shigeki Sugano,et al.  A New Silicone Structure for uSkin—A Soft, Distributed, Digital 3-Axis Skin Sensor and Its Integration on the Humanoid Robot iCub , 2018, IEEE Robotics and Automation Letters.

[18]  Chiara Bartolozzi,et al.  The Event-Driven Software Library for YARP—With Algorithms and iCub Applications , 2018, Front. Robot. AI.

[19]  Yasuo Kuniyoshi,et al.  Conformable and scalable tactile sensor skin for curved surfaces , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[20]  Shigeki Sugano,et al.  Design of human symbiotic robot TWENDY-ONE , 2009, 2009 IEEE International Conference on Robotics and Automation.

[21]  Vladimir J. Lumelsky,et al.  Proximity sensing in robot manipulator motion planning: system and implementation issues , 1989, IEEE Trans. Robotics Autom..

[22]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[23]  Shigeki Sugano,et al.  An Adjustable Force Sensitive Sensor with an Electromagnet for a Soft, Distributed, Digital 3-axis Skin Sensor , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Giulio Sandini,et al.  An embedded artificial skin for humanoid robots , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[25]  22 The Somatosensory System : Receptors and Central Pathways , 2015 .

[26]  Á. Tar,et al.  Development of a low cost 3D optical compliant tactile force sensor , 2011, 2011 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[27]  Fulvio Mastrogiovanni,et al.  A real-time data acquisition and processing framework for large-scale robot skin , 2015, Robotics Auton. Syst..

[28]  Giorgio Metta,et al.  A Flexible and Robust Large Scale Capacitive Tactile System for Robots , 2013, IEEE Sensors Journal.

[29]  Fulvio Mastrogiovanni,et al.  A real-time distributed architecture for large-scale tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.