Classification of components of affective touch using rapidly-manufacturable soft sensor skins

Affective touches play an important role in everyday communication because a significant amount of human interactions are through physical contacts. To facilitate robust, safe human-robot interactions (HRIs), we require robots with soft skins that can interpret affective touches. In this paper, we describe the fabrication of rapidly manufacturable, soft sensor skins using liquid metal embedded silicone elastomer as a resistive element and trained a recurrent neural network (RNN) to distinguish between a variety of pokes and rubs from human users. On a $2 \times 2$ sensor array, we obtained an average classification accuracy of 97% for ten different types of pokes and rubs, demonstrating that the combination of a soft sensor and machine learning can classify the interactions. Our approach is a step towards intelligent soft robots that can understand social interactions through touches.

[1]  T. Field Touch for Socioemotional and Physical Well-Being: A Review. , 2010 .

[2]  Massimo Totaro,et al.  Toward Perceptive Soft Robots: Progress and Challenges , 2018, Advanced science.

[3]  D. Rus,et al.  Design, fabrication and control of soft robots , 2015, Nature.

[4]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[5]  Alin Albu-Schäffer,et al.  Soft robotics , 2008, IEEE Robotics & Automation Magazine.

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Aikaterini Fotopoulou,et al.  The soothing function of touch: affective touch reduces feelings of social exclusion , 2017, Scientific Reports.

[8]  Oussama Khatib,et al.  A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics , 2018, Science Robotics.

[9]  Karon E. MacLean,et al.  The Role of Affective Touch in Human-Robot Interaction: Human Intent and Expectations in Touching the Haptic Creature , 2012, Int. J. Soc. Robotics.

[10]  Sungho Jo,et al.  Deep Full-Body Motion Network for a Soft Wearable Motion Sensing Suit , 2019, IEEE/ASME Transactions on Mechatronics.

[11]  Michael T. Tolley,et al.  Design Considerations for 3D Printed, Soft, Multimaterial Resistive Sensors for Soft Robotics , 2019, Front. Robot. AI.

[12]  Jamie Paik,et al.  An Any-Resolution Distributed Pressure Localization Scheme Using a Capacitive Soft Sensor Skin , 2018 .

[13]  R. F. Shepherd,et al.  Soft optoelectronic sensory foams with proprioception , 2018, Science Robotics.

[14]  Jonathan Rossiter,et al.  Bodily Aware Soft Robots: Integration of Proprioceptive and Exteroceptive Sensors , 2017, ICRA.

[15]  Cecilia Laschi,et al.  Soft robot perception using embedded soft sensors and recurrent neural networks , 2019, Science Robotics.

[16]  José Carlos Castillo,et al.  Detecting and Classifying Human Touches in a Social Robot Through Acoustic Sensing and Machine Learning , 2017, Sensors.

[17]  Daniela Rus,et al.  Exploration of underwater life with an acoustically controlled soft robotic fish , 2018, Science Robotics.

[18]  Oliver Brock,et al.  Soft Hands for Reliable Grasping Strategies , 2015 .

[19]  Oliver Kroemer,et al.  Soft Magnetic Skin for Continuous Deformation Sensing , 2019, Adv. Intell. Syst..

[20]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[21]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[22]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[23]  Henrik I. Christensen,et al.  Custom soft robotic gripper sensor skins for haptic object visualization , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Allison M. Okamura,et al.  A soft robot that navigates its environment through growth , 2017, Science Robotics.

[25]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[26]  Fumiya Iida,et al.  Electronic Skins for Intelligent Soft Robots , 2020 .

[27]  G. Whitesides Soft Robotics. , 2018, Angewandte Chemie.

[28]  J. A. E. Hughes,et al.  An anthropomorphic soft skeleton hand exploiting conditional models for piano playing , 2018, Science Robotics.

[29]  Robert J. Wood,et al.  A Resilient, Untethered Soft Robot , 2014 .