A data-driven statistical framework for post-grasp manipulation

Grasping an object is usually only an intermediate goal for a robotic manipulator. To finish the task, the robot needs to know where the object is in its hand and what action to execute. This paper presents a general statistical framework to address these problems. Given a novel object, the robot learns a statistical model of grasp state conditioned on sensor values. The robot also builds a statistical model of the requirements for a successful execution of the task in terms of uncertainty in the state of the grasp. Both of these models are constructed by offline experiments. The online process then grasps objects and chooses actions to maximize likelihood of success. This paper describes the framework in detail, and demonstrates its effectiveness experimentally in placing, dropping, and insertion tasks. To construct statistical models, the robot performed over 8,000 grasp trials, and over 1,000 trials each of placing, dropping, and insertion.

[1]  井上 博允,et al.  Force Feedback in Precise Assembly Tasks , 1975 .

[2]  SimunoviÄ SimunoviÄ,et al.  An information approach to parts mating , 1979 .

[3]  Daniel E. Whitney,et al.  Applying Stochastic Control Theory to Robot Sensing, Teaching, and Long Term Control , 1982 .

[4]  Russell H. Taylor,et al.  Automatic Synthesis of Fine-Motion Strategies for Robots , 1984 .

[5]  Michael A. Erdmann,et al.  Using Backprojections for Fine Motion Planning with Uncertainty , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[6]  Matthew T. Mason,et al.  Mechanics and Planning of Manipulator Pushing Operations , 1986 .

[7]  Jeffrey C. Trinkle,et al.  An Investigation of Frictionless Enveloping Grasping in the Plane , 1988, Int. J. Robotics Res..

[8]  Arthur C. Sanderson,et al.  The motion of a pushed, sliding workpiece , 1988, IEEE J. Robotics Autom..

[9]  Randy C. Brost,et al.  Automatic Grasp Planning in the Presence of Uncertainty , 1988, Int. J. Robotics Res..

[10]  Matthew T. Mason,et al.  An exploration of sensorless manipulation , 1986, IEEE J. Robotics Autom..

[11]  Kenneth Y. Goldberg,et al.  Bayesian grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[12]  Ken Goldberg,et al.  Stochastic plans for robotic manipulation , 1991 .

[13]  Alan D. Christiansen.  Manipulation planning for empirical backprojections , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[14]  Alan D. Christiansen,et al.  Automatic acquisition of task theories for robotic manipulation , 1992 .

[15]  Randy C. Brost,et al.  Analysis and planning of planar manipulation tasks , 1992 .

[16]  Leslie Pack Kaelbling,et al.  Acting Optimally in Partially Observable Stochastic Domains , 1994, AAAI.

[17]  Kenneth Y. Goldberg,et al.  Sorting parts by random grasping , 1995, IEEE Trans. Robotics Autom..

[18]  Alan D. Christiansen,et al.  Comparing two algorithms for automatic planning by robots in stochastic environments , 1995, Robotica.

[19]  Steven M. LaValle,et al.  Evaluating motion strategies under nondeterministic or probabilistic uncertainties in sensing and control , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[20]  Alan D. Christiansen,et al.  Probabilistic Analysis of Manipulation Tasks: A Conceptual Framework , 1996, Int. J. Robotics Res..

[21]  Steven M. LaValle,et al.  An Objective-Based Framework for Motion Planning under Sensing and Control Uncertainties , 1998, Int. J. Robotics Res..

[22]  L. Györfi,et al.  A Distribution-Free Theory of Nonparametric Regression (Springer Series in Statistics) , 2002 .

[23]  Roderic A. Grupen,et al.  Acquiring state from control dynamics to learn grasping policies for robot hands , 2002, Adv. Robotics.

[24]  Adam Krzyzak,et al.  A Distribution-Free Theory of Nonparametric Regression , 2002, Springer series in statistics.

[25]  Antonio Morales,et al.  Using Experience for Assessing Grasp Reliability , 2004, Int. J. Humanoid Robotics.

[26]  Herman Bruyninckx,et al.  Bayesian Hybrid Model-State Estimation Applied to Simultaneous Contact Formation Recognition and Geometrical Parameter Estimation , 2005, Int. J. Robotics Res..

[27]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[28]  Siddhartha S. Srinivasa,et al.  Planar batting under shape, pose, and impact uncertainty , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[29]  Robert Platt.  Learning grasp strategies composed of contact relative motions , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[30]  Satinder P. Singh,et al.  Exponential Family Predictive Representations of State , 2007, NIPS.

[31]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[32]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[33]  Byron Boots,et al.  Closing the learning-planning loop with predictive state representations , 2009, Int. J. Robotics Res..

[34]  Carl E. Rasmussen,et al.  Gaussian Processes for Machine Learning (GPML) Toolbox , 2010, J. Mach. Learn. Res..

[35]  Siddhartha S. Srinivasa,et al.  Manipulation Capabilities with Simple Hands , 2010, ISER.

[36]  Siddhartha S. Srinivasa,et al.  Abort and retry in grasping , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Siddhartha S. Srinivasa,et al.  A Framework for Push-Grasping in Clutter , 2011, Robotics: Science and Systems.

[38]  Peter K. Allen,et al.  Data-driven grasping , 2011, Auton. Robots.

[39]  Stefan Schaal,et al.  Learning to grasp under uncertainty , 2011, 2011 IEEE International Conference on Robotics and Automation.

[40]  Leslie Pack Kaelbling,et al.  Robust grasping under object pose uncertainty , 2011, Auton. Robots.

[41]  Byron Boots,et al.  Closing the learning-planning loop with predictive state representations , 2011, Int. J. Robotics Res..

[42]  Siddhartha S. Srinivasa,et al.  A data-driven statistical framework for post-grasp manipulation , 2014, Int. J. Robotics Res..

[43]  Yun Jiang,et al.  Learning to place new objects , 2011, 2012 IEEE International Conference on Robotics and Automation.

[44]  Ling Xu,et al.  Physical Human Interactive Guidance: Identifying Grasping Principles From Human-Planned Grasps , 2012, IEEE Transactions on Robotics.

[45]  Siddhartha S. Srinivasa,et al.  Autonomous manipulation with a general-purpose simple hand , 2011, Int. J. Robotics Res..

[46]  Yun Jiang,et al.  Learning to place new objects in a scene , 2012, Int. J. Robotics Res..

[47]  Jorge Dias,et al.  Extracting data from human manipulation of objects towards improving autonomous robotic grasping , 2012, Robotics Auton. Syst..

[48]  Leslie Pack Kaelbling,et al.  Object placement as inverse motion planning , 2013, 2013 IEEE International Conference on Robotics and Automation.

[49]  Alberto Rodriguez,et al.  A simple and compliant force sensing palm for the MLab Simple Hand , 2013, 2013 IEEE International Conference on Robotics and Automation.