Learning Continuous Cost-to-Go Functions for Non-holonomic Systems

This paper presents a supervised learning method to generate continuous cost-to-go functions of non-holonomic systems directly from the workspace description. Supervision from informative examples reduces training time and improves network performance. The manifold representing the optimal trajectories of a non-holonomic system has high-curvature regions which can not be efficiently captured with uniform sampling. To address this challenge, we present an adaptive sampling method which makes use of sampling based planners along with local, closed-form solutions to generate training samples. The cost-to-go function over a specific workspace is represented as a neural network whose weights are generated by a second, higher order network. The networks are trained in an end-to-end fashion. In our previous work, this architecture was shown to successfully learn to generate the cost-to-go functions of holonomic systems using uniform sampling. In this work, we show that uniform sampling fails for non-holonomic systems. However, with the proposed adaptive sampling methodology, our network can generate near-optimal trajectories for non-holonomic systems while avoiding obstacles. Experiments show that our method is two orders of magnitude faster compared to traditional approaches in cluttered environments.

[1]  Jean-Paul Laumond,et al.  Guidelines in nonholonomic motion planning for mobile robots , 1998 .

[2]  Emilio Frazzoli,et al.  Anytime Motion Planning using the RRT* , 2011, 2011 IEEE International Conference on Robotics and Automation.

[3]  Nancy M. Amato,et al.  UOBPRM: A uniformly distributed obstacle-based PRM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Kris Hauser,et al.  Asymptotically Optimal Planning by Feasible Kinodynamic Planning in a State–Cost Space , 2015, IEEE Transactions on Robotics.

[5]  Edward Schmerling,et al.  Learned Critical Probabilistic Roadmaps for Robotic Motion Planning , 2019 .

[6]  Steven M. LaValle,et al.  Randomized Kinodynamic Planning , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[7]  Marco Pavone,et al.  Learning Sampling Distributions for Robot Motion Planning , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Yuval Tassa,et al.  Control-limited differential dynamic programming , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Lydia E. Kavraki,et al.  The Open Motion Planning Library , 2012, IEEE Robotics & Automation Magazine.

[10]  G. Swaminathan Robot Motion Planning , 2006 .

[11]  L. Dubins On Curves of Minimal Length with a Constraint on Average Curvature, and with Prescribed Initial and Terminal Positions and Tangents , 1957 .

[12]  Daniel Vallejo,et al.  OBPRM: an obstacle-based PRM for 3D workspaces , 1998 .

[13]  Kostas E. Bekris,et al.  Probabilistic Completeness of RRT for Geometric and Kinodynamic Planning With Forward Propagation , 2018, IEEE Robotics and Automation Letters.

[14]  Michael C. Yip,et al.  Dynamically Constrained Motion Planning Networks for Non-Holonomic Robots , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Tao Qin,et al.  Learning What Data to Learn , 2017, ArXiv.

[16]  François Fleuret,et al.  Not All Samples Are Created Equal: Deep Learning with Importance Sampling , 2018, ICML.

[17]  Nancy M. Amato,et al.  An obstacle-based rapidly-exploring random tree , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[18]  Volkan Isler,et al.  Turning a Corner with a Dubins Car , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[19]  Pieter Abbeel,et al.  Value Iteration Networks , 2016, NIPS.

[20]  Kostas E. Bekris,et al.  Asymptotically optimal sampling-based kinodynamic planning , 2014, Int. J. Robotics Res..

[21]  Siddhartha S. Srinivasa,et al.  LEGO: Leveraging Experience in Roadmap Generation for Sampling-Based Planning , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[23]  Daniel D. Lee,et al.  Higher-Order Function Networks for Learning Composable 3D Object Representations , 2019, ICLR.

[24]  Siddharth Srivastava,et al.  Learn and Link: Learning Critical Regions for Efficient Planning , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Jean-Paul Laumond,et al.  Robot Motion Planning and Control , 1998 .

[26]  Kostas J. Kyriakopoulos,et al.  Nonholonomic navigation and control of cooperating mobile manipulators , 2003, IEEE Trans. Robotics Autom..

[27]  Simon Parsons,et al.  Principles of Robot Motion: Theory, Algorithms and Implementations by Howie Choset, Kevin M. Lynch, Seth Hutchinson, George Kantor, Wolfram Burgard, Lydia E. Kavraki and Sebastian Thrun, 603 pp., $60.00, ISBN 0-262-033275 , 2007, The Knowledge Engineering Review.

[28]  K.J. Kyriakopoulos,et al.  3D navigation and collision avoidance for a non-holonomic vehicle , 2008, 2008 American Control Conference.

[29]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Daniel D. Lee,et al.  Cost-to-Go Function Generating Networks for High Dimensional Motion Planning , 2020, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[31]  L. Shepp,et al.  OPTIMAL PATHS FOR A CAR THAT GOES BOTH FORWARDS AND BACKWARDS , 1990 .

[32]  Subhash Suri,et al.  Curvature-Constrained Shortest Paths in a Convex Polygon , 2002, SIAM J. Comput..

[33]  Ross A. Knepper,et al.  Differentially constrained mobile robot motion planning in state lattices , 2009, J. Field Robotics.

[34]  Sergio Casas,et al.  End-To-End Interpretable Neural Motion Planner , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Michael C. Yip,et al.  Motion Planning Networks , 2018, 2019 International Conference on Robotics and Automation (ICRA).