Acoustic Sensing for Soft Pneumatic Actuators

We propose a novel sensing method for soft pneumatic actuators. The method uses a single microphone, embedded into the actuator's air chamber. Contact with the environment induces sound (vibration) in the actuator. The materials and the shape of the actuator reflect, refract, and attenuate the sound as it propagates inside the actuator. This produces a unique sound signature for different types of events, enabling the sensing of contact locations, contact force, and the type of contacted material. Sensing is insensitive to the inflation state of the actuator and to background noise. We demonstrate the robustness and versatility of the microphone-based sensor solution in experiments with a PneuFlex actuator. The proposed sensorization avoids the fundamental challenges of sensorizing soft pneumatic actuators, because the placement of a microphone does not negatively affect the compliance of the actuator and because a single microphone suffices for sensorization of the entire actuator, eliminating the need for an application-specific sensor layout.

[1]  Eric Krotkov,et al.  Robotic Perception of Material: Experiments with Shape-Invariant Acoustic Measures of Material Type , 1995, ISER.

[2]  Walterio W. Mayol-Cuevas,et al.  A first approach to tactile texture recognition , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[3]  Loren G. Terveen,et al.  The sound of one hand: a wrist-mounted bio-acoustic fingertip gesture interface , 2002, CHI Extended Abstracts.

[4]  Lorenzo Natale,et al.  Tapping into Touch , 2005 .

[5]  P. Remington Structure-Borne Sound: Structural Vibrations and Sound Radiation at Audio Frequencies (3rd Edition) , 2005 .

[6]  J. Randall Flanagan,et al.  Coding and use of tactile signals from the fingertips in object manipulation tasks , 2009, Nature Reviews Neuroscience.

[7]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[8]  Connor Schenck,et al.  Interactive object recognition using proprioceptive and auditory feedback , 2011, Int. J. Robotics Res..

[9]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[10]  Joseph M. Romano,et al.  Creating Realistic Virtual Textures from Contact Acceleration Data , 2012, IEEE Transactions on Haptics.

[11]  Joshua R. Smith,et al.  Seashell effect pretouch sensing for robotic grasping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Daniel M. Vogt,et al.  Design and Characterization of a Soft Multi-Axis Force Sensor Using Embedded Microfluidic Channels , 2013, IEEE Sensors Journal.

[13]  Robert J. Wood,et al.  Flexible, stretchable tactile arrays from MEMS barometers , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[14]  Rebecca K. Kramer,et al.  Direct Writing of Gallium‐Indium Alloy for Stretchable Electronics , 2014 .

[15]  Oliver Brock,et al.  Exploitation of environmental constraints in human and robotic grasping , 2015, Int. J. Robotics Res..

[16]  Oliver Brock,et al.  Planning grasp strategies That Exploit Environmental Constraints , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[17]  R. Adam Bilodeau,et al.  Monolithic fabrication of sensors and actuators in a soft robotic gripper , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Nikolaus Correll,et al.  A soft pneumatic actuator that can sense grasp and touch , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Véronique Perdereau,et al.  Tactile sensing in dexterous robot hands - Review , 2015, Robotics Auton. Syst..

[20]  Kevin O'Brien,et al.  Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides , 2016, Science Robotics.

[21]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[22]  Paolo Fiorini,et al.  A Deformable Smart Skin for Continuous Sensing Based on Electrical Impedance Tomography , 2016, Sensors.

[23]  Peter J. Ramadge,et al.  Learning to identify container contents through tactile vibration signatures , 2016, 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR).

[24]  Oliver Brock,et al.  A method for sensorizing soft actuators and its application to the RBO hand 2 , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Daniel M. Vogt,et al.  Batch Fabrication of Customizable Silicone‐Textile Composite Capacitive Strain Sensors for Human Motion Tracking , 2017 .

[26]  Edward H. Adelson,et al.  GelSight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force , 2017, Sensors.

[27]  Jian Liu,et al.  VibWrite: Towards Finger-input Authentication on Ubiquitous Surfaces via Physical Vibration , 2017, CCS.