Transmissive optical pretouch sensing for robotic grasping

Robotic grasping has been hindered by the inability of robots to perceive unstructured environments. Because these environments can be complex or dynamic, it is important to obtain additional and precise sensing information just before grasping. This paper expands upon the pretouch modality by introducing a transmissive optical sensor. It can unambiguously indicate the presence or lack of objects in close proximity. A wide variety of items that other sensors fail to sense, such as extremely soft or shiny objects, can be detected by the proposed sensor. The sensor is also fully integrated into the fingertips of the PR2 robotic platform and manufactured with inexpensive, commercially-available components. Several experiments are conducted to verify its utility in both environment perception and robotic grasping. It is shown that the perception information supplied by the sensor facilitates effective robotic grasping.

[1]  Michael Beetz,et al.  Improving robot manipulation through fingertip perception , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Quoc V. Le,et al.  Grasping novel objects with depth segmentation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .

[4]  Ashutosh Saxena,et al.  Reactive grasping using optical proximity sensors , 2009, 2009 IEEE International Conference on Robotics and Automation.

[5]  Joshua R. Smith,et al.  Seashell effect pretouch sensing for robotic grasping , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  Robert W. Platt,et al.  Inferring hand-object configuration directly from tactile data , 2010 .

[7]  Joshua R. Smith,et al.  A unified framework for grasping and shape acquisition via pretouch sensing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[8]  Hong Qiao,et al.  Vision-Based 3-D Grasping of 3-D Objects With a Simple 2-D Gripper , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[10]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Danica Kragic,et al.  Mind the gap - robotic grasping under incomplete observation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[12]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Joshua R. Smith,et al.  An Electric Field Pretouch system for grasping and co-manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Dinesh Manocha,et al.  Object localization using crossbeam sensing , 1993, [1993] Proceedings IEEE International Conference on Robotics and Automation.

[15]  Matei T. Ciocarlie,et al.  Data-driven grasping with partial sensor data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Liang-Ting Jiang Pretouch Sensing for Robotic Grasping , 2014 .

[17]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Joshua R. Smith,et al.  Electric field imaging pretouch for robotic graspers , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Joshua R. Smith,et al.  Electric Field Servoing for robotic manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Helge J. Ritter,et al.  A Probabilistic Approach to Tactile Shape Reconstruction , 2011, IEEE Transactions on Robotics.

[21]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.