MakeSense: Automated Sensor Design for Proprioceptive Soft Robots.

Soft robots have applications in safe human-robot interactions, manipulation of fragile objects, and locomotion in challenging and unstructured environments. In this article, we present a computational method for augmenting soft robots with proprioceptive sensing capabilities. Our method automatically computes a minimal stretch-receptive sensor network to user-provided soft robotic designs, which is optimized to perform well under a set of user-specified deformation-force pairs. The sensorized robots are able to reconstruct their full deformation state, under interaction forces. We cast our sensor design as a subselection problem, selecting a minimal set of sensors from a large set of fabricable ones, which minimizes the error when sensing specified deformation-force pairs. Unique to our approach is the use of an analytical gradient of our reconstruction performance measure with respect to selection variables. We demonstrate our technique on a bending bar and gripper example, illustrating more complex designs with a simulated tentacle.

[1]  Jamie Kyujin Paik,et al.  Strain sensor-embedded soft pneumatic actuators for extension and bending feedback , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[2]  D. Floreano,et al.  Soft Robotic Grippers , 2018, Advanced materials.

[3]  Robert J. Wood,et al.  Soft robotic glove for combined assistance and at-home rehabilitation , 2015, Robotics Auton. Syst..

[4]  Helmut Hauser,et al.  Towards a theoretical foundation for morphological computation with compliant bodies , 2011, Biological Cybernetics.

[5]  Jonathan Rossiter,et al.  Development of a tactile sensor based on biologically inspired edge encoding , 2009, 2009 International Conference on Advanced Robotics.

[6]  Oliver Brock,et al.  Efficient FEM-Based Simulation of Soft Robots Modeled as Kinematic Chains , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Thomas J. Wallin,et al.  3D printing antagonistic systems of artificial muscle using projection stereolithography , 2015, Bioinspiration & biomimetics.

[8]  Daniela Rus,et al.  Autonomous Soft Robotic Fish Capable of Escape Maneuvers Using Fluidic Elastomer Actuators. , 2014, Soft robotics.

[9]  C. David Remy,et al.  Sensing the motion of bellows through changes in mutual inductance , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[10]  Markus H. Gross,et al.  Computational design of actuated deformable characters , 2013, ACM Trans. Graph..

[11]  Jernej Barbic,et al.  FEM simulation of 3D deformable solids: a practitioner's guide to theory, discretization and model reduction , 2012, SIGGRAPH '12.

[12]  Nikolaus Correll,et al.  Materials that couple sensing, actuation, computation, and communication , 2015, Science.

[13]  Markus H. Gross,et al.  A computational design tool for compliant mechanisms , 2017, ACM Trans. Graph..

[14]  Robert J. Wood,et al.  Wearable soft sensing suit for human gait measurement , 2014, Int. J. Robotics Res..

[15]  Yong-Lae Park,et al.  Design and Fabrication of Soft Artificial Skin Using Embedded Microchannels and Liquid Conductors , 2012, IEEE Sensors Journal.

[16]  Matthew A. Robertson,et al.  New soft robots really suck: Vacuum-powered systems empower diverse capabilities , 2017, Science Robotics.

[17]  Jonathan Rossiter,et al.  Proprioceptive Flexible Fluidic Actuators Using Conductive Working Fluids , 2017, Soft robotics.

[18]  Iain A. Anderson,et al.  Stretch sensors for human body motion , 2014, Smart Structures.

[19]  Wojciech Matusik,et al.  Designing cable-driven actuation networks for kinematic chains and trees , 2017, Symposium on Computer Animation.

[20]  Rebecca K. Kramer,et al.  Hyperelastic pressure sensing with a liquid-embedded elastomer , 2010 .

[21]  Edward L. White,et al.  Sensor enabled closed-loop bending control of soft beams , 2016 .

[22]  Jennifer C. Case,et al.  Multi-mode strain and curvature sensors for soft robotic applications , 2017 .

[23]  Gierad Laput,et al.  Electrick: Low-Cost Touch Sensing Using Electric Field Tomography , 2017, CHI.

[24]  Christian Duriez,et al.  Vision-Based Sensing of External Forces Acting on Soft Robots Using Finite Element Method , 2018, IEEE Robotics and Automation Letters.

[25]  Daniel M. Vogt,et al.  Embedded 3D Printing of Strain Sensors within Highly Stretchable Elastomers , 2014, Advanced materials.

[26]  Yong-Lae Park,et al.  A Soft Strain Sensor Based on Ionic and Metal Liquids , 2013, IEEE Sensors Journal.

[27]  Takuya Umedachi,et al.  Highly deformable 3-D printed soft robot generating inching and crawling locomotions with variable friction legs , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Sanlin S. Robinson,et al.  Highly stretchable electroluminescent skin for optical signaling and tactile sensing , 2016, Science.

[29]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[30]  Oliver Brock,et al.  A method for sensorizing soft actuators and its application to the RBO hand 2 , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Massimo Totaro,et al.  Toward Perceptive Soft Robots: Progress and Challenges , 2018, Advanced science.

[32]  Eitan Grinspun,et al.  Designing inflatable structures , 2014, ACM Trans. Graph..

[33]  Robert J. Wood,et al.  Soft Robotic Grippers for Biological Sampling on Deep Reefs , 2016, Soft robotics.

[34]  Michael T. Tolley,et al.  Application-Driven Design of Soft, 3-D Printed, Pneumatic Actuators With Bellows , 2019, IEEE/ASME Transactions on Mechatronics.

[35]  Miguel A. Otaduy,et al.  Design and fabrication of flexible rod meshes , 2015, ACM Trans. Graph..

[36]  M SpinksGeoffrey,et al.  3D Printed Flexure Hinges for Soft Monolithic Prosthetic Fingers , 2016 .

[37]  Stephen A. Morin,et al.  Soft Robotics: Review of Fluid‐Driven Intrinsically Soft Devices; Manufacturing, Sensing, Control, and Applications in Human‐Robot Interaction   , 2017 .

[38]  Fionnuala Connolly,et al.  Automatic design of fiber-reinforced soft actuators for trajectory matching , 2016, Proceedings of the National Academy of Sciences.

[39]  Robert J. Wood,et al.  An integrated design and fabrication strategy for entirely soft, autonomous robots , 2016, Nature.

[40]  Oliver Brock,et al.  Acoustic Sensing for Soft Pneumatic Actuators , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[41]  Y. Nesterov.  A method for solving the convex programming problem with convergence rate O(1/k^2) , 1983 .

[42]  Yigit Mengüç,et al.  Directly Fabricating Soft Robotic Actuators With an Open-Source 3-D Printer , 2017, IEEE Robotics and Automation Letters.

[43]  Emmanuel J. Candès,et al.  Adaptive Restart for Accelerated Gradient Schemes , 2012, Foundations of Computational Mathematics.

[44]  Surya Girinatha Nurzaman,et al.  SVAS3: Strain Vector Aided Sensorization of Soft Structures , 2014, Sensors.

[45]  Olga Sorkine-Hornung,et al.  Spin-it , 2014, ACM Trans. Graph..

[46]  T. Nanayakkara,et al.  Soft Robotics Technologies to Address Shortcomings in Today ’ s Minimally Invasive Surgery : The STIFF-FLOP Approach , 2014 .

[47]  Daniel M. Vogt,et al.  Soft Somatosensitive Actuators via Embedded 3D Printing , 2018, Advanced materials.

[48]  J. Bae,et al.  Consistent and Reproducible Direct Ink Writing of Eutectic Gallium-Indium for High-Quality Soft Sensors. , 2018, Soft robotics.

[49]  Gabriel Goh,et al.  Why Momentum Really Works , 2017 .

[50]  Shoichi Iikura,et al.  Development of flexible microactuator and its applications to robotic mechanisms , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[51]  Hod Lipson,et al.  Soft material for soft actuators , 2017, Nature Communications.

[52]  Filip Ilievski,et al.  Soft robotics for chemists. , 2011, Angewandte Chemie.

[53]  Wojciech Matusik,et al.  Computational design of mechanical characters , 2013, ACM Trans. Graph..

[54]  Dario Floreano,et al.  Forceful manipulation with micro air vehicles , 2018, Science Robotics.

[55]  Jonathan Rossiter,et al.  High strength bubble artificial muscles for walking assistance , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[56]  Wojciech Matusik,et al.  Computational Light Routing , 2014, ACM Trans. Graph..

[57]  Antonis A. Argyros,et al.  Towards force sensing from vision: Observing hand-object interactions to infer manipulation forces , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Bernd Bickel,et al.  DefSense: Computational Design of Customized Deformable Input Devices , 2016, CHI.

[59]  Allison M. Okamura,et al.  A soft robot that navigates its environment through growth , 2017, Science Robotics.

[60]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[61]  Nikolaus Correll,et al.  A soft pneumatic actuator that can sense grasp and touch , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).