Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors

We describe a combined proximity, contact and force (PCF) sensor based on a commodity infrared distance sensor embedded in a transparent elastomer with applications in robotic manipulation. Prior to contact, the sensor works as a distance sensor, whereas after contact the elastomer magnifies the near field of the proximity sensors letting the sensor interpret the indentation on elastomer as force. Contact occurs at the transition of proximity and force. We describe in detail the sensor design, its principle of operation and experimentally characterize the design parameters including polymer thickness, its mixing ratio, and emitter current of the infrared sensor. We also show that the sensor response has an inflection point at contact that is independent of an object’s surface properties, making it a robust detector for contact events. We finally demonstrate a series of use cases for the proposed PCF sensor, including (1) improving pre-grasp alignment, (2) determining contact event with objects, (3) obtaining simple 3D point cloud models of objects using both proximity and contact, and (4) registering self-generated point clouds to those from a RGB-D camera using a Baxter robot and Kinova Jaco arm.

[1]  Lin Wang,et al.  Characterization of a silicon-based shear-force sensor on human subjects , 2002, IEEE Transactions on Biomedical Engineering.

[2]  Guocheng Shao,et al.  new fabrication method for all-PDMS waveguides , 2013 .

[3]  Gordon Cheng,et al.  Humanoid Multimodal Tactile-Sensing Modules , 2011, IEEE Transactions on Robotics.

[4]  Hiroyuki Shinoda,et al.  Ultrasonic emission tactile sensing , 1995 .

[5]  Nikolaus Correll,et al.  Integrated force and distance sensing using elastomer-embedded commodity proximity sensors , 2016, Robotics: Science and Systems.

[6]  Nikolaus Correll,et al.  Functionalized textiles for interactive soft robotics , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Oliver Brock,et al.  Analysis and Observations From the First Amazon Picking Challenge , 2016, IEEE Transactions on Automation Science and Engineering.

[8]  Yong-Lae Park,et al.  A Soft Strain Sensor Based on Ionic and Metal Liquids , 2013, IEEE Sensors Journal.

[9]  H. Worn,et al.  Tactile proximity sensors for robotic applications , 2013, 2013 IEEE International Conference on Industrial Technology (ICIT).

[10]  Oliver Brock,et al.  A Novel Type of Compliant, Underactuated Robotic Hand for Dexterous Grasping , 2014, Robotics: Science and Systems.

[11]  Yasuo Kuniyoshi,et al.  Conformable and scalable tactile sensor skin for curved surfaces , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  J. Rossiter,et al.  An LED-based Tactile Sensor for Multi-sensing over Large Areas , 2006, 2006 5th IEEE Conference on Sensors.

[13]  Sven Molkenstruck,et al.  A manipulator plays Jenga , 2008, IEEE Robotics & Automation Magazine.

[14]  Andrew S. Glassner,et al.  Principles of Digital Image Synthesis , 1995 .

[15]  S.S. Lancaster,et al.  A fuzzy logic controller for the application of skin pressure , 2004, IEEE Annual Meeting of the Fuzzy Information, 2004. Processing NAFIPS '04..

[16]  Hyung-Kew Lee,et al.  Normal and Shear Force Measurement Using a Flexible Polymer Tactile Sensor With Embedded Multiple Capacitors , 2008, Journal of Microelectromechanical Systems.

[17]  Nikolaus Correll,et al.  Simultaneous localization, mapping, and manipulation for unsupervised object discovery , 2014, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Michael Beetz,et al.  Improving robot manipulation through fingertip perception , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Katsuhiko Nakamura,et al.  A Tactile Sensor Instantaneously Evaluating Friction Coefficients , 2001 .

[20]  Gordon Cheng,et al.  Realizing whole-body tactile interactions with a self-organizing, multi-modal artificial skin on a humanoid robot , 2015, Adv. Robotics.

[21]  A. Wo,et al.  Transmission Spectrum of PDMS in 4-7µm Mid-IR Range for Characterization of Protein Structure , 2006 .

[22]  Robert B. Kelley,et al.  Using gripper mounted infrared proximity sensors for robot feedback control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[23]  Siddhartha S. Srinivasa,et al.  Extrinsic dexterity: In-hand manipulation with external forces , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Ronald S. Fearing,et al.  A surface micromachined microtactile sensor array , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[25]  Ashutosh Saxena,et al.  Reactive grasping using optical proximity sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[26]  Max Born,et al.  Principles of optics - electromagnetic theory of propagation, interference and diffraction of light (7. ed.) , 1999 .

[27]  Gordon Cheng,et al.  Directions Toward Effective Utilization of Tactile Skin: A Review , 2013, IEEE Sensors Journal.

[28]  Joong Yull Park,et al.  Increased poly(dimethylsiloxane) stiffness improves viability and morphology of mouse fibroblast cells , 2010 .

[29]  Robert D. Howe,et al.  Contact sensing and grasping performance of compliant hands , 2010, Auton. Robots.

[30]  J. Spronck,et al.  A capacitive tactile sensor for shear and normal force measurements , 1992 .

[31]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[32]  Nikolaus Correll,et al.  Improving Grasp Performance Using In-Hand Proximity and Dynamic Tactile Sensing , 2016, ISER.

[33]  Chang Liu,et al.  Re-configurable fluid circuits by PDMS elastomer micromachining , 1999, Technical Digest. IEEE International MEMS 99 Conference. Twelfth IEEE International Conference on Micro Electro Mechanical Systems (Cat. No.99CH36291).

[34]  José-Enrique Simó-Ten,et al.  Using infrared sensors for distance measurement in mobile robots , 2002, Robotics Auton. Syst..

[35]  Yasuo Kuniyoshi,et al.  Wearable motion capture suit with full-body tactile sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[36]  X. Tao,et al.  Soft Fiber Optic Sensors for Precision Measurement of Shear Stress and Pressure , 2013, IEEE Sensors Journal.

[37]  Kaspar Althoefer,et al.  Force and proximity fingertip sensor to enhance grasping perception , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[38]  Nikolaus Correll,et al.  A soft pneumatic actuator that can sense grasp and touch , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[39]  Nikolaus Correll,et al.  Texture recognition and localization in amorphous robotic skin , 2015, Bioinspiration & biomimetics.

[40]  Stefanie Tellex,et al.  Learning to pick up objects through active exploration , 2015, 2015 Joint IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob).

[41]  Yong-Lae Park,et al.  Fiber optically sensorized multi-fingered robotic hand , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[42]  Ronald S. Fearing,et al.  Simplified Grasping and Manipulation with Dextrous Robot Hands , 1984, 1984 American Control Conference.

[43]  Giulio Sandini,et al.  Tactile Sensing—From Humans to Humanoids , 2010, IEEE Transactions on Robotics.

[44]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[45]  Andreas Neyer,et al.  Raman, mid-infrared, near-infrared and ultraviolet–visible spectroscopy of PDMS silicone rubber for characterization of polymer optical waveguide materials , 2010 .