Improved Proximity, Contact, and Force Sensing via Optimization of Elastomer-Air Interface Geometry

We describe a single fingertip-mounted sensing system for robot manipulation that provides proximity (pre-touch), contact detection (touch), and force sensing (post-touch). The sensor system consists of optical time-of-flight range measurement modules covered in a clear elastomer. Because the elastomer is clear, the sensor can detect and range nearby objects, as well as measure deformations caused by objects that are in contact with the sensor and thereby estimate the applied force. We examine how this sensor design can be improved with respect to invariance to object reflectivity, signal-to-noise ratio, and continuous operation when switching between the distance and force measurement regimes. By harnessing time-of-flight technology and optimizing the elastomer-air boundary to control the emitted light’s path, we develop a sensor that is able to seamlessly transition between measuring distances of up to 50 mm and contact forces of up to 10 newtons. We demonstrate that our sensor improves manipulation accuracy in a block unstacking task. Thorough instructions for manufacturing the sensor from inexpensive, commercially available components are provided, as well as all relevant hardware design files and software sources.

[1]  Robert B. Kelley,et al.  Using gripper mounted infrared proximity sensors for robot feedback control , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[2]  Joshua R. Smith,et al.  Electric field imaging pretouch for robotic graspers , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Tamim Asfour,et al.  Stereo-based 6D object localization for grasping with humanoid robot systems , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[5]  Oliver Brock,et al.  Manipulating articulated objects with interactive perception , 2008, 2008 IEEE International Conference on Robotics and Automation.

[6]  Joshua R. Smith,et al.  Electric Field Servoing for robotic manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Ashutosh Saxena,et al.  Reactive grasping using optical proximity sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[8]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Joshua R. Smith,et al.  An Electric Field Pretouch system for grasping and co-manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[11]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[12]  Michael Beetz,et al.  Improving robot manipulation through fingertip perception , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Joshua R. Smith,et al.  Seashell effect pretouch sensing for robotic grasping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[14]  Aiguo Ming,et al.  Pre-shaping for various objects by the robot hand equipped with resistor network structure proximity sensors , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  X. Tao,et al.  Soft Fiber Optic Sensors for Precision Measurement of Shear Stress and Pressure , 2013, IEEE Sensors Journal.

[16]  Jörg Stückler,et al.  Efficient 3D object perception and grasp planning for mobile manipulation in domestic environments , 2013, Robotics Auton. Syst..

[17]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .

[18]  Heinz Wörn,et al.  6D proximity servoing for preshaping and haptic exploration using capacitive tactile proximity sensors , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Kevin Huang,et al.  Sensor-aided teleoperated grasping of transparent objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Di Guo,et al.  Transmissive optical pretouch sensing for robotic grasping , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Yong-Lae Park,et al.  Fiber optically sensorized multi-fingered robotic hand , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Hubert Zangl,et al.  Responsive fingers — capacitive sensing during object manipulation , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Nikolaus Correll,et al.  Texture recognition and localization in amorphous robotic skin , 2015, Bioinspiration & biomimetics.

[24]  Kaspar Althoefer,et al.  Fingertip proximity sensor with realtime visual-based calibration , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Yamaguchi Akihiko,et al.  Combining finger vision and optical tactile sensing: Reducing and handling errors while cutting vegetables , 2016 .

[26]  Nikolaus Correll,et al.  Integrated force and distance sensing using elastomer-embedded commodity proximity sensors , 2016, Robotics: Science and Systems.

[27]  Nikolaus Correll,et al.  Merging Local and Global 3D Perception using Contact Sensing , 2017, AAAI Spring Symposia.

[28]  Joshua R. Smith,et al.  Pre-touch sensing for sequential manipulation , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Nikolaus Correll,et al.  Improving grasp performance using in-hand proximity and contact sensing , 2016, ArXiv.

[30]  Matei T. Ciocarlie,et al.  Accurate contact localization and indentation depth prediction with an optics-based tactile sensor , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Masatoshi Ishikawa,et al.  High-Speed High-Precision Proximity Sensor for Detection of Tilt, Distance, and Contact , 2018, IEEE Robotics and Automation Letters.

[32]  Nikolaus Correll,et al.  Integrated proximity, contact and force sensing using elastomer-embedded commodity proximity sensors , 2018, Auton. Robots.