Center-of-Mass-Based Grasp Pose Adaptation Using 3D Range and Force/Torque Sensing

Lifting objects, whose mass may produce high wrist torques that exceed the hardware strength limits, could lead to unstable grasps or serious robot damage. This work introduces a new Center-of-Mass (CoM)-based grasp pose adaptation method, for picking up objects using a combination of exteroceptive 3D perception and proprioceptive force/torque sensor feedback. The method works in two iterative stages to provide reliable and wrist torque efficient grasps. Initially, a geometric object CoM is estimated from the input range data. In the first stage, a set of hand-size handle grasps are localized on the object and the closest to its CoM is selected for grasping. In the second stage, the object is lifted using a single arm, while the force and torque readings from the sensor on the wrist are monitored. Based on these readings, a displacement to the new CoM estimation is calculated. The object is released and the process is repeated until the wrist torque effort is minimized. The advantage of our method is the blending of both exteroceptive (3D range) and proprioceptive (force/torque) sensing for finding the grasp location that minimizes the wrist effort, potentially improving the reliability of the grasping and the subsequent manipulation task. We experimentally validate the proposed method by executing a number of tests on a set of objects that include handles, using the humanoid robot WALK-MAN.

[1]  Jeffrey C. Trinkle,et al.  A dynamic Bayesian approach to real-time estimation and filtering in grasp acquisition , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Manuel Lopes,et al.  Learning Object Affordances: From Sensory--Motor Coordination to Imitation , 2008, IEEE Transactions on Robotics.

[3]  Nikolaos G. Tsagarakis,et al.  Robot control for dummies: Insights and examples using OpenSoT , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[4]  Danica Kragic,et al.  Learning tactile characterizations of object- and pose-specific grasps , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Jörn Malzahn,et al.  WALK‐MAN: A High‐Performance Humanoid Platform for Realistic Environments , 2017, J. Field Robotics.

[6]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[7]  Oussama Khatib,et al.  Grasping with application to an autonomous checkout robot , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  Nikolaos G. Tsagarakis,et al.  A Modular Approach for Remote Operation of Humanoid Robots in Search and Rescue Scenarios , 2014, MESAS.

[9]  A. R. Jerbert,et al.  Distance from a Line, or Plane, to a Poin , 1952 .

[10]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[11]  S. Gruber,et al.  Robot hands and the mechanics of manipulation , 1987, Proceedings of the IEEE.

[12]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[13]  Dimitrios Kanoulas,et al.  Curved Surface Patches for Rough Terrain Perception , 2014, ArXiv.

[14]  Dieter Fox,et al.  Interactive singulation of objects from a pile , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Darwin G. Caldwell,et al.  Visual Grasp Affordance Localization in Point Clouds Using Curved Contact Patches , 2017, Int. J. Humanoid Robotics.

[16]  Nikolaos G. Tsagarakis,et al.  Experimental Evaluation of a Perceptual Pipeline for Hierarchical Affordance Extraction , 2016, ISER.

[17]  Dongming Gan,et al.  Object shape perception in blind robot grasping using a wrist force/torque sensor , 2013, 2013 IEEE 20th International Conference on Electronics, Circuits, and Systems (ICECS).

[18]  Nikolaos G. Tsagarakis,et al.  Detecting object affordances with Convolutional Neural Networks , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Robert Platt,et al.  Localizing Grasp Affordances in 3-D Points Clouds Using Taubin Quadric Fitting , 2013, ArXiv.

[20]  Hedvig Kjellström,et al.  Functional object descriptors for human activity modeling , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  Satoshi Kagami,et al.  Learning object models for whole body manipulation , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[22]  Markus Vincze,et al.  AfRob: The affordance network ontology for robots , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Manuel G. Catalano,et al.  Adaptive synergies for a humanoid robot hand , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[24]  Markus Vincze,et al.  Empty the basket - a shape based learning approach for grasping piles of unknown objects , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Danica Kragic,et al.  Predicting slippage and learning manipulation affordances through Gaussian Process regression , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[26]  Andrew T. Miller,et al.  Integration of Vision , Force and Tactile Sensing for Grasping , 1999 .

[27]  Nicholas Roy,et al.  Robust Object Grasping Using Force Compliant Motion Primitives , 2013 .

[28]  Giorgio Metta,et al.  Self-supervised learning of grasp dependent tool affordances on the iCub Humanoid robot , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[29]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[30]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[31]  Kaijen Hsiao,et al.  Active Manipulation for Perception , 2016, Springer Handbook of Robotics, 2nd Ed..

[32]  J. Andrew Bagnell,et al.  Clearing a pile of unknown objects using interactive perception , 2013, 2013 IEEE International Conference on Robotics and Automation.

[33]  Rachid Alami,et al.  A Grasp Planner Based On Inertial Properties , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[34]  Nikolaos G. Tsagarakis,et al.  An affordance-based pilot interface for high-level control of humanoid robots in supervised autonomy , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[35]  Ashutosh Saxena,et al.  Efficient grasping from RGBD images: Learning using a new rectangle representation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[36]  Danica Kragic,et al.  A probabilistic framework for task-oriented grasp stability assessment , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[38]  Yiannis Aloimonos,et al.  Affordance detection of tool parts from geometric features , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[39]  Allison M. Okamura,et al.  Feature Detection for Haptic Exploration with Robotic Fingers , 2001, Int. J. Robotics Res..

[40]  Jörg Stückler,et al.  Efficient 3D object perception and grasp planning for mobile manipulation in domestic environments , 2013, Robotics Auton. Syst..

[41]  Giorgio Battistelli,et al.  Memory Unscented Particle Filter for 6-DOF Tactile Localization , 2017, IEEE Transactions on Robotics.

[42]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Markus Vincze,et al.  Learning grasps for unknown objects in cluttered scenes , 2013, 2013 IEEE International Conference on Robotics and Automation.

[44]  Kate Saenko,et al.  High precision grasp pose detection in dense clutter , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[45]  Alexander Herzog,et al.  Template-based learning of grasp selection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[46]  Marsette Vona,et al.  Moving Volume KinectFusion , 2012, BMVC.

[47]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[48]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[49]  Danica Kragic,et al.  Learning a dictionary of prototypical grasp-predicting parts from grasping experience , 2013, 2013 IEEE International Conference on Robotics and Automation.

[50]  Kaspar Althoefer,et al.  Tactile sensing for dexterous in-hand manipulation in robotics-A review , 2011 .

[51]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[52]  Oussama Khatib,et al.  Global Localization of Objects via Touch , 2011, IEEE Transactions on Robotics.

[53]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[54]  Sven Behnke,et al.  Real-Time Plane Segmentation Using RGB-D Cameras , 2012, RoboCup.

[55]  Nikolaos G. Tsagarakis,et al.  XBotCore: A Real-Time Cross-Robot Software Platform , 2017, 2017 First IEEE International Conference on Robotic Computing (IRC).

[56]  Oliver Kroemer,et al.  Predicting object interactions from contact distributions , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[57]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .

[58]  Kaspar Althoefer,et al.  Combining touch and vision for the estimation of an object's pose during manipulation , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Joel W. Burdick,et al.  Fusion of stereo vision, force-torque, and joint sensors for estimation of in-hand object location , 2011, 2011 IEEE International Conference on Robotics and Automation.

[60]  Nassir Navab,et al.  Adaptive neighborhood selection for real-time surface normal estimation from organized point cloud data using integral images , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[61]  Bernt Schiele,et al.  Functional Object Class Detection Based on Learned Affordance Cues , 2008, ICVS.

[62]  Giulio Sandini,et al.  Highly Sensitive Soft Tactile Sensors for an Anthropomorphic Robotic Hand , 2015, IEEE Sensors Journal.

[63]  Daniel Cohen-Or,et al.  Volume graphics , 1993, Computer.

[64]  Tsutomu Hasegawa,et al.  Real-time pose estimation of an object manipulated by multi-fingered hand using 3D stereo vision and tactile sensing , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[65]  John Hollerbach,et al.  Rigid body load identification for manipulators , 1985, 1985 24th IEEE Conference on Decision and Control.

[66]  Ville Kyrki,et al.  Probabilistic sensor-based grasping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[67]  E. Adelson,et al.  Localization and Manipulation of Small Parts Using , 2014 .