Learning Trajectories for Real- Time Optimal Control of Quadrotors

Nonlinear optimal control problems are challenging to solve efficiently due to non-convexity. This paper introduces a trajectory optimization approach that achieves realtime performance by combining machine learning to predict optimal trajectories with refinement by quadratic optimization. First, a library of optimal trajectories is calculated offline and used to train a neural network. Online, the neural network predicts a trajectory for a novel initial state and cost function, and this prediction is further optimized by a sparse quadratic programming solver. We apply this approach to a fly-to-target movement problem for an indoor quadrotor. Experiments demonstrate that the technique calculates near-optimal trajectories in a few milliseconds, and generates agile movement that can be tracked more accurately than existing methods.

[1]  Yuval Tassa,et al.  Continuous control with deep reinforcement learning , 2015, ICLR.

[2]  Alberto Bemporad,et al.  The explicit solution of model predictive control via multiparametric quadratic programming , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[3]  Kris Hauser Learning the Problem-Optimum Map: Analysis and Application to Global Optimization in Robotics , 2017, IEEE Transactions on Robotics.

[4]  Markus Hehn,et al.  A Computationally Efficient Motion Primitive for Quadrocopter Trajectory Generation , 2015, IEEE Transactions on Robotics.

[5]  Fei Gao,et al.  Online quadrotor trajectory generation and autonomous navigation on point clouds , 2016, 2016 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR).

[6]  Fanghua Jiang,et al.  Improving Low-Thrust Trajectory Optimization by Adjoint Estimation with Shape-Based Path , 2017 .

[7]  Kris Hauser,et al.  A data-driven indirect method for nonlinear optimal control , 2017, Astrodynamics.

[8]  Julian Förster,et al.  System Identification of the Crazyflie 2.0 Nano Quadrocopter , 2015 .

[9]  Nicolas Mansard,et al.  Trajectory generation for quadrotor based systems using numerical optimal control , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[10]  J. Betts Survey of Numerical Methods for Trajectory Optimization , 1998 .

[11]  Ahmad A. Masoud,et al.  Kinodynamic Motion Planning , 2010, IEEE Robotics & Automation Magazine.

[12]  Marc Toussaint,et al.  Fast motion planning from experience: trajectory prediction for speeding up movement generation , 2013, Auton. Robots.

[13]  Fanghua Jiang,et al.  Systematic low-thrust trajectory optimization for a multi-rendezvous mission using adjoint scaling , 2016, 1603.02352.

[14]  Sami Haddadin,et al.  Learning quadrotor maneuvers from optimal control and generalizing in real-time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Gerd Hirzinger,et al.  Trajectory planning for optimal robot catching in real-time , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Stephen P. Boyd,et al.  OSQP: an operator splitting solver for quadratic programs , 2017, 2018 UKACC 12th International Conference on Control (CONTROL).

[17]  Davide Scaramuzza,et al.  Fast Trajectory Optimization for Agile Quadrotor Maneuvers with a Cable-Suspended Payload , 2017, Robotics: Science and Systems.

[18]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.