Kinematically optimised predictions of object motion

Predicting the motions of rigid objects under contacts is a necessary precursor to planning of robot manipulation of objects. On the one hand physics based rigid body simulations are used, and on the other learning approaches are being developed. The advantage of physics simulations is that because they explicitly perform collision checking they respect kinematic constraints, producing physically plausible predictions. The advantage of learning approaches is that they can capture the effects on motion of unobservable parameters such as mass distribution, and frictional coefficients, thus producing more accurate predicted trajectories. This paper shows how to bring together the advantages of both approaches to achieve learned simulators of specific objects that outperform previous learning approaches. Our approach employs a fast simplified collision checker and a learning method. The learner predicts trajectories for the object. These are optimised post prediction to minimise interpenetrations according to the collision checker. In addition we show that cleaning the training data prior to learning can also improve performance. Combining both approaches results in consistently strong prediction performance. The new simulator outperforms previous learning based approaches on a single contact push manipulation prediction task. We also present results showing that the method works for multi-contact manipulation, for which rigid body simulators are notoriously unstable.

[1]  Rustam Stolkin,et al.  Prediction learning in robotic pushing manipulation , 2009, 2009 International Conference on Advanced Robotics.

[2]  G. Dorffner,et al.  Learning to perceive affordances in a framework of developmental embodied cognition , 2007, 2007 IEEE 6th International Conference on Development and Learning.

[3]  Rustam Stolkin,et al.  Learning to predict how rigid objects behave under simple manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[4]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[5]  Darius Burschka,et al.  Predicting human intention in visual observations of hand/object interactions , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Rustam Stolkin,et al.  Predicting workpiece motions under pushing manipulations using the principle of minimum energy , 2015 .

[7]  J. Koláček,et al.  Nonparametric Conditional Density Estimation , 2013 .

[8]  Takafumi Kanamori,et al.  Nonparametric Conditional Density Estimation Using Piecewise-Linear Solution Path of Kernel Quantile Regression , 2009, Neural Computation.

[9]  Matthew T. Mason,et al.  Mechanics of Robotic Manipulation , 2001 .

[10]  Rustam Stolkin,et al.  Motion estimation using physical simulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  Giulio Sandini,et al.  Learning about objects through action - initial steps towards artificial cognition , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  T. Mörwald Edge Tracking of Textured Objects with a Recursive Particle Filter , 2009 .

[13]  Aleš Leonardis,et al.  Towards Learning Basic Object Affordances from Object Properties , 2008 .

[14]  Michael Beetz,et al.  Simulation-based temporal projection of everyday robot object manipulation , 2011, AAMAS.

[15]  Vijay Kumar,et al.  Designing open-loop plans for planar micro-manipulation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Alexander Stoytchev,et al.  Learning the Affordances of Tools Using a Behavior-Grounded Approach , 2006, Towards Affordance-Based Robot Control.

[17]  Jens Reinecke,et al.  Online in-hand object localization , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.