Toward Perceptive Soft Robots: Progress and Challenges

Abstract In the past few years, soft robotics has rapidly become an emerging research topic, opening new possibilities for addressing real‐world tasks. Perception can enable robots to effectively explore the unknown world, and interact safely with humans and the environment. Among all extero‐ and proprioception modalities, the detection of mechanical cues is vital, as with living beings. A variety of soft sensing technologies are available today, but there is still a gap to effectively utilize them in soft robots for practical applications. Here, the developments in soft robots with mechanical sensing are summarized to provide a comprehensive understanding of the state of the art in this field. Promising sensing technologies for mechanically perceptive soft robots are described, categorized, and their pros and cons are discussed. Strategies for designing soft sensors and criteria to evaluate their performance are outlined from the perspective of soft robotic applications. Challenges and trends in developing multimodal sensors, stretchable conductive materials and electronic interfaces, modeling techniques, and data interpretation for soft robotic sensing are highlighted. The knowledge gap and promising solutions toward perceptive soft robots are discussed and analyzed to provide a perspective in this field.

[1]  Xinwu Liang,et al.  Shape Detection Algorithm for Soft Manipulator Based on Fiber Bragg Gratings , 2016, IEEE/ASME Transactions on Mechatronics.

[2]  Rebecca K. Kramer,et al.  Soft Material Characterization for Robotic Applications , 2015 .

[3]  Jonathan Rossiter,et al.  Proprioceptive Flexible Fluidic Actuators Using Conductive Working Fluids , 2017, Soft robotics.

[4]  Oliver Brand,et al.  3D‐Integrated and Multifunctional All‐Soft Physical Microsystems Based on Liquid Metal for Electronic Skin Applications , 2018 .

[5]  Zhong Lin Wang,et al.  High-resolution electroluminescent imaging of pressure distribution using a piezoelectric nanowire LED array , 2013, Nature Photonics.

[6]  Michael Krieg,et al.  Feeling force: physical and physiological principles enabling sensory mechanotransduction. , 2015, Annual review of cell and developmental biology.

[7]  Ross A. Knepper,et al.  A Helping Hand: Soft Orthosis with Integrated Optical Strain Sensors and EMG Control , 2016, IEEE Robotics & Automation Magazine.

[8]  Jonathan Rossiter,et al.  The TacTip Family: Soft Optical Tactile Sensors with 3D-Printed Biomimetic Morphologies , 2018, Soft robotics.

[9]  Carmel Majidi,et al.  Soft-matter capacitors and inductors for hyperelastic strain sensing and stretchable electronics , 2013 .

[10]  LuoMing,et al.  Toward Modular Soft Robotics: Proprioceptive Curvature Sensing and Sliding-Mode Control of Soft Bidirectional Bending Modules. , 2017 .

[11]  Robert J. Wood,et al.  Untethered soft robotics , 2018 .

[12]  TotaroMassimo,et al.  Integrated Simultaneous Detection of Tactile and Bending Cues for Soft Robotics. , 2017 .

[13]  R. Dahiya,et al.  Printable stretchable interconnects , 2017 .

[14]  Chuan Wang,et al.  CNT-based sensor arrays for local strain measurements in soft pneumatic actuators , 2017, International Journal of Intelligent Robotics and Applications.

[15]  Sarah S. Bedair,et al.  Bubble inductors: Pneumatic tuning of a stretchable inductor , 2018 .

[16]  Yei Hwan Jung,et al.  Stretchable silicon nanoribbon electronics for skin prosthesis , 2014, Nature Communications.

[17]  Massimo Totaro,et al.  Soft Robotics Mechanosensing , 2017 .

[18]  Daniel M. Vogt,et al.  Soft Somatosensitive Actuators via Embedded 3D Printing , 2018, Advanced materials.

[19]  Daniel M. Vogt,et al.  Capacitive Soft Strain Sensors via Multicore–Shell Fiber Printing , 2015, Advanced materials.

[20]  M. Kaltenbrunner,et al.  An ultra-lightweight design for imperceptible plastic electronics , 2013, Nature.

[21]  Shuichi Wakimoto,et al.  Flexible displacement sensor using injected conductive paste , 2008 .

[22]  Gordon Cheng,et al.  Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot , 2015, Adv. Robotics.

[23]  Mariangela Manti,et al.  Stiffening in Soft Robotics: A Review of the State of the Art , 2016, IEEE Robotics & Automation Magazine.

[24]  Carmel Majidi,et al.  Autonomous Selection of Closing Posture of a Robotic Hand Through Embodied Soft Matter Capacitive Sensors , 2017, IEEE Sensors Journal.

[25]  Matteo Cianchetti,et al.  Soft robotics: Technologies and systems pushing the boundaries of robot abilities , 2016, Science Robotics.

[26]  B Mazzolai,et al.  A plant-inspired robot with soft differential bending capabilities , 2016, Bioinspiration & biomimetics.

[27]  Hyosang Lee,et al.  Soft Nanocomposite Based Multi-point, Multi-directional Strain Mapping Sensor Using Anisotropic Electrical Impedance Tomography , 2017, Scientific Reports.

[28]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[29]  Luciano Colombo,et al.  Stretchable nanocomposite electrodes with tunable mechanical properties by supersonic cluster beam implantation in elastomers , 2015 .

[30]  Z. Jane Wang,et al.  Novel Tactile Sensor Technology and Smart Tactile Sensing Systems: A Review , 2017, Sensors.

[31]  Caofeng Pan,et al.  Self‐Powered High‐Resolution and Pressure‐Sensitive Triboelectric Sensor Matrix for Real‐Time Tactile Mapping , 2016, Advanced materials.

[32]  Lingfeng Chen,et al.  Soft Robotics: Academic Insights and Perspectives Through Bibliometric Analysis , 2018, Soft robotics.

[33]  Kaspar Althoefer,et al.  Implementation of Tactile Sensing for Palpation in Robot-Assisted Minimally Invasive Surgery: A Review , 2014, IEEE Sensors Journal.

[34]  Yao Sun,et al.  A novel pneumatic soft sensor for measuring contact force and curvature of a soft gripper , 2017 .

[35]  Fumiya Iida,et al.  Soft Robotics: Challenges and Perspectives , 2011, FET.

[36]  Xiaoping Lou,et al.  FBG based shape sensing of a silicone octopus tentacle model for soft robotics , 2018, Optik.

[37]  Cagdas D. Onal,et al.  A precise embedded curvature sensor module for soft-bodied robots , 2015 .

[38]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[39]  Filip Ilievski,et al.  Multigait soft robot , 2011, Proceedings of the National Academy of Sciences.

[40]  Tong Lu,et al.  Soft Bionics Hands with a Sense of Touch Through an Electronic Skin , 2017 .

[41]  T. Someya,et al.  A large-area wireless power-transmission sheet using printed organic transistors and plastic MEMS switches. , 2007, Nature materials.

[42]  C. David Remy,et al.  Contraction Sensing With Smart Braid McKibben Muscles , 2016, IEEE/ASME Transactions on Mechatronics.

[43]  Daniel M. Vogt,et al.  Batch Fabrication of Customizable Silicone‐Textile Composite Capacitive Strain Sensors for Human Motion Tracking , 2017 .

[44]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.

[45]  Octavian Postolache,et al.  Tactile Sensors for Robotic Applications , 2013 .

[46]  Insang You,et al.  Material approaches to stretchable strain sensors. , 2015, Chemphyschem : a European journal of chemical physics and physical chemistry.

[47]  Yonghua Chen,et al.  Innovative Design of Embedded Pressure and Position Sensors for Soft Actuators , 2018, IEEE Robotics and Automation Letters.

[48]  Ju-Hyuck Lee,et al.  Micropatterned P(VDF‐TrFE) Film‐Based Piezoelectric Nanogenerators for Highly Sensitive Self‐Powered Pressure Sensors , 2015 .

[49]  WangMichael Yu,et al.  Multi-Axis Soft Sensors Based on Dielectric Elastomer , 2016 .

[50]  Yong-Young Noh,et al.  Toward Printed Integrated Circuits based on Unipolar or Ambipolar Polymer Semiconductors , 2013, Advanced materials.

[51]  Anibal T. de Almeida,et al.  Fabrication and characterization of bending and pressure sensors for a soft prosthetic hand , 2018 .

[52]  Huichan Zhao,et al.  Flexible and stretchable sensors for fluidic elastomer actuated soft robots , 2017 .

[53]  Yong-Lae Park,et al.  A Soft Strain Sensor Based on Ionic and Metal Liquids , 2013, IEEE Sensors Journal.

[54]  M. Maharbiz,et al.  A highly elastic, capacitive strain gauge based on percolating nanotube networks. , 2012, Nano letters.

[55]  Kaspar Althoefer,et al.  Highly dexterous 2‐module soft robot for intra‐organ navigation in minimally invasive surgery , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[56]  Hiroyuki Shinoda,et al.  Wireless tactile sensing element using stress-sensitive resonator , 2000 .

[57]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[58]  K. Johnson Contact Mechanics: Frontmatter , 1985 .

[59]  Choon Chiang Foo,et al.  Stretchable, Transparent, Ionic Conductors , 2013, Science.

[60]  Eduardo Torres-Jara,et al.  Contact Behavior of Soft Spherical Tactile Sensors , 2014, IEEE Sensors Journal.

[61]  Stéphanie P. Lacour,et al.  Extremely robust and conformable capacitive pressure sensors based on flexible polyurethane foams and stretchable metallization , 2013 .

[62]  Bin Li,et al.  Mutual capacitance of liquid conductors in deformable tactile sensing arrays , 2016 .

[63]  Jung Woo Lee,et al.  Self-assembled three dimensional network designs for soft electronics , 2017, Nature Communications.

[64]  Hongwei Zhu,et al.  Recent advances in wearable tactile sensors: Materials, sensing mechanisms, and device performance , 2017 .

[65]  Boris Murmann,et al.  Skin electronics from scalable fabrication of an intrinsically stretchable transistor array , 2018, Nature.

[66]  Tetsuya Akagi,et al.  Development of Compact Flexible Displacement Sensors Using Ultrasonic Sensor for Wearable Actuators , 2016 .

[67]  T. Arie,et al.  Fully printed flexible fingerprint-like three-axis tactile and slip force and temperature sensors for artificial skin. , 2014, ACS nano.

[68]  Fionnuala Connolly,et al.  Automatic design of fiber-reinforced soft actuators for trajectory matching , 2016, Proceedings of the National Academy of Sciences.

[69]  John A. Rogers,et al.  Highly Sensitive Skin‐Mountable Strain Gauges Based Entirely on Elastomers , 2012 .

[70]  R. Rahimi,et al.  A sewing-enabled stitch-and-transfer method for robust, ultra-stretchable, conductive interconnects , 2014 .

[71]  A DaltorioKathryn,et al.  Peristaltic Locomotion of a Modular Mesh-Based Worm Robot: Precision, Compliance, and Friction , 2015 .

[72]  Robert J. Wood,et al.  An integrated design and fabrication strategy for entirely soft, autonomous robots , 2016, Nature.

[73]  Jia-Jia Li,et al.  Wearable Wide-Range Strain Sensors Based on Ionic Liquids and Monitoring of Human Activities , 2017, Sensors.

[74]  Jonathan Rossiter,et al.  Soft Robotics: Trends, Applications and Challenges: Proceedings of the Soft Robotics Week, April 25-30, 2016, Livorno, Italy , 2017 .

[75]  G. Whitesides,et al.  Eutectic Gallium‐Indium (EGaIn): A Liquid Metal Alloy for the Formation of Stable Structures in Microchannels at Room Temperature , 2008 .

[76]  Giorgio Metta,et al.  A Flexible and Robust Large Scale Capacitive Tactile System for Robots , 2013, IEEE Sensors Journal.

[77]  Helen Shen,et al.  Meet the soft, cuddly robots of the future , 2016, Nature.

[78]  U. Chung,et al.  Highly Stretchable Resistive Pressure Sensors Using a Conductive Elastomeric Composite on a Micropyramid Array , 2014, Advanced materials.

[79]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[80]  Kaspar Althoefer,et al.  Soft and Stretchable Sensor Using Biocompatible Electrodes and Liquid for Medical Applications , 2015, Soft robotics.

[81]  Gregory de Boer,et al.  Robust and high-performance soft inductive tactile sensors based on the Eddy-current effect , 2018 .

[82]  Kaspar Althoefer,et al.  Macrobend optical sensing for pose measurement in soft robot arms , 2015 .

[83]  I. Park,et al.  Stretchable, Skin‐Mountable, and Wearable Strain Sensors and Their Potential Applications: A Review , 2016 .

[84]  E. O. Polat,et al.  Energy‐Autonomous, Flexible, and Transparent Tactile Skin , 2017 .

[85]  L. Beccai,et al.  Flexible Three‐Axial Force Sensor for Soft and Highly Sensitive Artificial Touch , 2014, Advanced materials.

[86]  Benjamin C. K. Tee,et al.  25th Anniversary Article: The Evolution of Electronic Skin (E‐Skin): A Brief History, Design Considerations, and Recent Progress , 2013, Advanced materials.

[87]  Minoru Asada,et al.  Anthropomorphic robotic soft fingertip with randomly distributed receptors , 2006, Robotics Auton. Syst..

[88]  Xinran Wang,et al.  A Self‐Healable, Highly Stretchable, and Solution Processable Conductive Polymer Composite for Ultrasensitive Strain and Pressure Sensing , 2018 .

[89]  Weiliang Xu,et al.  A Soft Robotic Tongue—Mechatronic Design and Surface Reconstruction , 2017, IEEE/ASME Transactions on Mechatronics.

[90]  Youfan Hu,et al.  Recent progress in piezoelectric nanogenerators as a sustainable power source in self-powered systems and active sensors , 2015 .

[91]  Seungwan Ryu,et al.  Soft robot review , 2017 .

[92]  Rebecca K. Kramer,et al.  Soft Tactile Sensor Arrays for Force Feedback in Micromanipulation , 2014, IEEE Sensors Journal.

[93]  Cecilia Laschi,et al.  Control Strategies for Soft Robotic Manipulators: A Survey. , 2018, Soft robotics.

[94]  Hongbo Wang,et al.  Design Methodology for Magnetic Field-Based Soft Tri-Axis Tactile Sensors , 2016, Sensors.

[95]  Giorgio Metta,et al.  Carbon Nanofiber versus Graphene‐Based Stretchable Capacitive Touch Sensors for Artificial Electronic Skin , 2017, Advanced science.

[96]  Lucia Beccai,et al.  Soft, Transparent, Electronic Skin for Distributed and Multiple Pressure Sensing , 2013, Sensors.

[97]  C. Keplinger,et al.  25th Anniversary Article: A Soft Future: From Robots and Sensor Skin to Energy Harvesters , 2013, Advanced materials.

[98]  Mark C. Hersam,et al.  Wiring up Liquid Metal: Stable and Robust Electrical Contacts Enabled by Printable Graphene Inks , 2018 .

[99]  Rebecca K. Kramer,et al.  Low‐Cost, Facile, and Scalable Manufacturing of Capacitive Sensors for Soft Systems , 2017 .

[100]  Jamie Paik,et al.  Modeling, Design, and Development of Soft Pneumatic Actuators with Finite Element Method   , 2016 .

[101]  Shuang Song,et al.  Shape reconstruction for wire-driven flexible robots based on Bézier curve and electromagnetic positioning , 2015 .

[102]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[103]  David J. Webb,et al.  Fibre Bragg grating sensors in polymer optical fibres , 2015 .

[104]  Surya Girinatha Nurzaman,et al.  SVAS3: Strain Vector Aided Sensorization of Soft Structures , 2014, Sensors.

[105]  Shuichi Wakimoto,et al.  New concept and fundamental experiments of a smart pneumatic artificial muscle with a conductive fiber , 2016 .

[106]  Jie Huang,et al.  Soft Prosthetic Forefinger Tactile Sensing via a String of Intact Single Mode Optical Fiber , 2017, IEEE Sensors Journal.

[107]  C David Remy,et al.  Smart Braid Feedback for the Closed-Loop Control of Soft Robotic Systems. , 2017, Soft robotics.

[108]  Metin Sitti,et al.  Small-scale soft-bodied robot with multimodal locomotion , 2018, Nature.

[109]  Hadi Heidari,et al.  Modeling of CMOS Devices and Circuits on Flexible Ultrathin Chips , 2017, IEEE Transactions on Electron Devices.

[110]  Zhong Lin Wang,et al.  Recent Progress in Electronic Skin , 2015, Advanced science.

[111]  MajidiCarmel,et al.  Soft Robotics: A Perspective—Current Trends and Prospects for the Future , 2014 .

[112]  Conor J. Walsh,et al.  A Highly Sensitive Capacitive‐Based Soft Pressure Sensor Based on a Conductive Fabric and a Microporous Dielectric Layer , 2018 .

[113]  Ki-Uk Kyung,et al.  Polymer‐Waveguide‐Based Flexible Tactile Sensor Array for Dynamic Response , 2014, Advanced materials.

[114]  Yong-Young Noh,et al.  Uniaxial Alignment of Conjugated Polymer Films for High‐Performance Organic Field‐Effect Transistors , 2018, Advanced materials.

[115]  Cecilia Laschi,et al.  Soft robotics: a bioinspired evolution in robotics. , 2013, Trends in biotechnology.

[116]  Robert J. Wood,et al.  A Highly Stretchable Capacitive‐Based Strain Sensor Based on Metal Deposition and Laser Rastering , 2017 .

[117]  Veikko Sariola,et al.  Screen-Printed Curvature Sensors for Soft Robots , 2018, IEEE Sensors Journal.

[118]  Jennifer C. Case,et al.  Multi-mode strain and curvature sensors for soft robotic applications , 2017 .

[119]  Shigeki Sugano,et al.  Covering a Robot Fingertip With uSkin: A Soft Electronic Skin With Distributed 3-Axis Force Sensitive Elements for Robot Hands , 2018, IEEE Robotics and Automation Letters.

[120]  Fumiya Iida,et al.  The challenges ahead for bio-inspired 'soft' robotics , 2012, CACM.

[121]  Huai-Ti Lin,et al.  GoQBot: a caterpillar-inspired soft-bodied rolling robot , 2011, Bioinspiration & biomimetics.

[122]  Zhong Lin Wang,et al.  Triboelectric nanogenerators as self-powered active sensors , 2015 .

[123]  Allison M. Okamura,et al.  A soft robot that navigates its environment through growth , 2017, Science Robotics.

[124]  Kaspar Althoefer,et al.  Finite-Element Modeling of Soft Tissue Rolling Indentation , 2011, IEEE Transactions on Biomedical Engineering.

[125]  Giancarlo Canavese,et al.  Flexible Tactile Sensing Based on Piezoresistive Composites: A Review , 2014, Sensors.

[126]  Ali Sadeghi,et al.  Toward Self-Growing Soft Robots Inspired by Plant Roots and Based on Additive Manufacturing Technologies , 2017, Soft robotics.

[127]  Zhenan Bao,et al.  Pursuing prosthetic electronic skin. , 2016, Nature materials.

[128]  Cecilia Laschi,et al.  Learning dynamic models for open loop predictive control of soft robotic manipulators. , 2017, Bioinspiration & biomimetics.

[129]  M Giorelli,et al.  A 3D steady-state model of a tendon-driven continuum soft manipulator inspired by the octopus arm , 2012, Bioinspiration & biomimetics.

[130]  Lizhi Xu,et al.  Stretchable conductors by kirigami patterning of aramid-silver nanocomposites with zero conductance gradient , 2017 .

[131]  Mable P Fok,et al.  Dual-layer orthogonal fiber Bragg grating mesh based soft sensor for 3-dimensional shape sensing. , 2017, Optics express.

[132]  Massimo Totaro,et al.  Revealing bending and force in a soft body through a plant root inspired approach , 2015, Scientific Reports.

[133]  R. Wood,et al.  Meshworm: A Peristaltic Soft Robot With Antagonistic Nickel Titanium Coil Actuators , 2013, IEEE/ASME Transactions on Mechatronics.

[134]  Stephen A. Morin,et al.  Soft Robotics: Review of Fluid‐Driven Intrinsically Soft Devices; Manufacturing, Sensing, Control, and Applications in Human‐Robot Interaction   , 2017 .

[135]  Alon Wolf,et al.  Shape Tracking of Planar Hyper-Flexible Beams via Embedded PVDF Deflection Sensors , 2014, IEEE/ASME Transactions on Mechatronics.