Reactive grasping using optical proximity sensors

We propose a system for improving grasping using fingertip optical proximity sensors that allows us to perform online grasp adjustments to an initial grasp point without requiring premature object contact or regrasping strategies. We present novel optical proximity sensors that fit inside the fingertips of a Barrett Hand, and demonstrate their use alongside a probabilistic model for robustly combining sensor readings and a hierarchical reactive controller for improving grasps online. This system can be used to complement existing grasp planning algorithms, or be used in more interactive settings where a human indicates the location of objects. Finally, we perform a series of experiments using a Barrett hand equipped with our sensors to grasp a variety of common objects with mixed geometries and surface textures.

[1]  John Kenneth Salisbury,et al.  Interpretation of contact geometries from force measurements , 1984, ICRA.

[2]  P. Regtien.  Accurate optical proximity detector , 1990, 7th IEEE Conference on Instrumentation and Measurement Technology.

[3]  Andrew A. Goldenberg,et al.  An electrooptical orientation sensor for robotics , 1992, IEEE Trans. Robotics Autom..

[4]  Beno Benhabib,et al.  Two-dimensional orientation sensor , 1992, J. Field Robotics.

[5]  M. Buehler,et al.  Dynamic object localization via a proximity sensor network , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[6]  M. Buehler,et al.  Robust Estimation of Pre-Contact Object Trajectories , 1997 .

[7]  J. A. Coelho,et al.  A Control Basis for Learning Multifingered Grasps , 1997 .

[8]  J. A. Coelho,et al.  A control basis for learning multifingered grasps , 1997, J. Field Robotics.

[9]  Roderic A. Grupen,et al.  Robust finger gaits from closed-loop controllers , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Justus Piater.  Learning Visual Features to Predict Hand Orientations , 2002 .

[11]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[12]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[13]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects , 2006, NIPS.

[14]  John Kenneth Salisbury,et al.  An Optical Fiber Proximity Sensor for Haptic Exploration , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Joshua R. Smith,et al.  Electric field imaging pretouch for robotic graspers , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Masatsugu Iribe,et al.  Adaptive grasping by multi fingered hand with tactile sensor based on robust force and position control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[17]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[18]  Zhe Xu,et al.  A point-and-click interface for the real world: Laser designation of objects for mobile manipulation , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[20]  Leslie Pack Kaelbling,et al.  Robust Belief-Based Execution of Manipulation Programs , 2008 .

[21]  Joshua R. Smith,et al.  Electric Field Servoing for robotic manipulation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Ashutosh Saxena,et al.  Learning 3-D object orientation from images , 2009, 2009 IEEE International Conference on Robotics and Automation.