An Approach for Imitation Learning on Riemannian Manifolds

In imitation learning, multivariate Gaussians are widely used to encode robot behaviors. Such approaches do not provide the ability to properly represent end-effector orientation, as the distance metric in the space of orientations is not Euclidean. In this paper, we present an extension of common imitation learning techniques to Riemannian manifolds. This generalization enables the encoding of joint distributions that include the robot pose. We show that Gaussian conditioning, Gaussian product, and nonlinear regression can be achieved with this representation. The proposed approach is illustrated with examples on a two-dimensional sphere, with an example of regression between two robot end-effector poses, as well as an extension of task-parameterized Gaussian mixture model and Gaussian mixture regression to Riemannian manifolds.

[1]  S. R. Jammalamadaka,et al.  Directional Statistics, I , 2011 .

[2]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[3]  Sandra Hirche,et al.  Rigid motion estimation using mixtures of projected Gaussians , 2013, Proceedings of the 16th International Conference on Information Fusion.

[4]  Søren Hauberg,et al.  Model Transport: Towards Scalable Transfer Learning on Manifolds , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Aude Billard,et al.  Learning from Humans , 2016, Springer Handbook of Robotics, 2nd Ed..

[6]  Sandra Hirche,et al.  Gaussian process dynamical models over dual quaternions , 2015, 2015 European Control Conference (ECC).

[7]  Bryce B. Ready,et al.  Filtering Techniques for Pose Estimation With Applications to Unmanned Air Vehicles , 2012 .

[8]  Francesc Moreno-Noguer,et al.  3D Human Pose Tracking Priors using Geodesic Mixture Models , 2017, International Journal of Computer Vision.

[9]  Jan Peters,et al.  Probabilistic Movement Primitives , 2013, NIPS.

[10]  Marc Toussaint,et al.  Direct Loss Minimization Inverse Optimal Control , 2015, Robotics: Science and Systems.

[11]  Aude Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[12]  Sergey Levine,et al.  Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimization , 2016, ICML.

[13]  A. Billard,et al.  Learning Stable Nonlinear Dynamical Systems With Gaussian Mixture Models , 2011, IEEE Transactions on Robotics.

[14]  Hongdong Li,et al.  Rotation Averaging , 2013, International Journal of Computer Vision.

[15]  Sylvain Calinon,et al.  A tutorial on task-parameterized movement learning and retrieval , 2016, Intell. Serv. Robotics.

[16]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[17]  Darwin G. Caldwell,et al.  Learning bimanual end-effector poses from demonstrations using task-parameterized dynamical systems , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Helge J. Ritter,et al.  Gaussian Mixture Model for 3-DoF orientations , 2017, Robotics Auton. Syst..

[19]  Søren Hauberg,et al.  Unscented Kalman Filtering on Riemannian Manifolds , 2013, Journal of Mathematical Imaging and Vision.

[20]  Darwin G. Caldwell,et al.  A task-parameterized probabilistic model with minimal intervention control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Gijs Dubbelman,et al.  Intrinsic statistical techniques for robust pose estimation , 2011 .

[22]  Marc Toussaint,et al.  Understanding the geometry of workspace obstacles in Motion Optimization , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Peter Englert,et al.  Inverse KKT: Learning cost functions of manipulation tasks from demonstrations , 2017, ISRR.

[24]  Søren Hauberg,et al.  A Geometric take on Metric Learning , 2012, NIPS.

[25]  Levent Tunçel,et al.  Optimization algorithms on matrix manifolds , 2009, Math. Comput..

[26]  Sergey Levine,et al.  Continuous Inverse Optimal Control with Locally Optimal Examples , 2012, ICML.

[27]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[28]  Suvrit Sra,et al.  Matrix Manifold Optimization for Gaussian Mixtures , 2015, NIPS.