Full-Body Torque-Level Non-linear Model Predictive Control for Aerial Manipulation

Non-linear model predictive control (nMPC) is a powerful approach to control complex robots (such as humanoids, quadrupeds or unmanned aerial manipulators (UAMs)) as it brings important advantages over other existing techniques. The full-body dynamics, along with the prediction capability of the optimal control problem (OCP) solved at the core of the controller, allows to actuate the robot in line with its dynamics. This fact enhances the robot capabilities and allows, e.g., to perform intricate maneuvers at high dynamics while optimizing the amount of energy used. Despite the many similarities between humanoids or quadrupeds and UAMs, full-body torque-level nMPC has rarely been applied to UAMs. This paper provides a thorough description of how to use such techniques in the field of aerial manipulation. We give a detailed explanation of the different parts involved in the OCP, from the UAM dynamical model to the residuals in the cost function. We develop and compare three different nMPC controllers: Weighted MPC, Rail MPC and Carrot MPC, which differ on the structure of their OCPs and on how these are updated at every time step. To validate the proposed framework, we present a wide variety of simulated case studies. First, we evaluate the trajectory generation problem, i.e., optimal control problems solved offline, involving different kinds of motions (e.g., aggressive maneuvers or contact locomotion) for different types UAMs. Then, we assess the performance of the three nMPC controllers, i.e., closed-loop controllers solved online, through a variety of realistic simulations. For the benefit of the community, we have made available the source code related to this work.

[1]  Ludovic Righetti,et al.  An Open Torque-Controlled Modular Robot Architecture for Legged Locomotion Research , 2019, IEEE Robotics and Automation Letters.

[2]  James E. Bobrow,et al.  An efficient sequential linear quadratic algorithm for solving nonlinear optimal control problems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[3]  Marin Kobilarov,et al.  Towards model-predictive control for aerial pick-and-place , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Paolo Rocco,et al.  Trajectory Generation for Unmanned Aerial Manipulators Through Quadratic Programming , 2017, IEEE Robotics and Automation Letters.

[5]  D. Mayne A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[6]  Thomas Richardson,et al.  An Adaptive-Compliance Manipulator for Contact-Based Aerial Applications , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[7]  R. Murray,et al.  Differential Flatness of Mechanical Control Systems: A Catalog of Prototype Systems , 1995 .

[8]  Nicolas Mansard,et al.  Crocoddyl: An Efficient and Versatile Framework for Multi-Contact Optimal Control , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Antonio Franchi,et al.  Dynamic decentralized control for protocentric aerial manipulators , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Nicolas Mansard,et al.  A Direct-Indirect Hybridization Approach to Control-Limited DDP , 2020, ArXiv.

[11]  Konstantin Kondak,et al.  A Stabilizing Controller for Regulation of UAV With Manipulator , 2018, IEEE Robotics and Automation Letters.

[12]  Zachary Manchester,et al.  ALTRO: A Fast Solver for Constrained Trajectory Optimization , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[13]  Dinesh Atchuthan,et al.  A micro Lie theory for state estimation in robotics , 2018, ArXiv.

[14]  Marco Hutter,et al.  Whole-Body Nonlinear Model Predictive Control Through Contacts for Quadrupeds , 2017, IEEE Robotics and Automation Letters.

[15]  Antonio Franchi,et al.  Toward Aerial Physical Locomotion: The Contact-Fly-Contact Problem , 2018, IEEE Robotics and Automation Letters.

[16]  Moritz Diehl,et al.  Fast motions in biomechanics and robotics : optimization and feedback control , 2006 .

[17]  J. Solà,et al.  Squash-Box Feasibility Driven Differential Dynamic Programming , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Roland Siegwart,et al.  Fast nonlinear Model Predictive Control for unified trajectory optimization and tracking , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Roland Siegwart,et al.  Fast nonlinear model predictive control for multicopter attitude tracking on SO(3) , 2015, 2015 IEEE Conference on Control Applications (CCA).

[20]  Stefan Leutenegger,et al.  Aerial Manipulation Using Hybrid Force and Position NMPC Applied to Aerial Writing , 2020, Robotics: Science and Systems.

[21]  Davide Bicego,et al.  A Truly-Redundant Aerial Manipulator System With Application to Push-and-Slide Inspection in Industrial Plants , 2019, IEEE Robotics and Automation Letters.

[22]  Jean Ponce,et al.  Equality Constrained Differential Dynamic Programming , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Pierre-Brice Wieber,et al.  Recent Progress in Legged Robots Locomotion Control , 2021, Current Robotics Reports.

[24]  Antonio Franchi,et al.  Differential flatness and control of protocentric aerial manipulators with any number of arms and mixed rigid-/elastic-joints , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[25]  Vincenzo Lippiello,et al.  Hybrid Visual Servoing With Hierarchical Task Composition for Aerial Manipulation , 2016, IEEE Robotics and Automation Letters.

[26]  Anis Koubaa Robot Operating System (ROS): The Complete Reference (Volume 1) , 2016 .

[27]  Raffaello D'Andrea,et al.  Design, modeling and control of an omni-directional aerial vehicle , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[28]  W. Blajer Methods for constraint violation suppression in the numerical simulation of constrained multibody systems – A comparative study , 2011 .

[29]  Aníbal Ollero,et al.  Aerial Manipulation: A Literature Review , 2018, IEEE Robotics and Automation Letters.

[30]  Nicolas Mansard,et al.  Differential Dynamic Programming for Multi-Phase Rigid Contact Dynamics , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[31]  Moritz Diehl,et al.  A Family of Iterative Gauss-Newton Shooting Methods for Nonlinear Optimal Control , 2017, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[32]  Farrokh Janabi-Sharifi,et al.  Aerial manipulation - A literature survey , 2018, Robotics Auton. Syst..

[33]  Antonio Franchi,et al.  Modeling, control and design optimization for a fully-actuated hexarotor aerial vehicle with tilted propellers , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Davide Bicego,et al.  6D interaction control with aerial robots: The flying end-effector paradigm , 2019, Int. J. Robotics Res..

[35]  Roland Siegwart,et al.  Trajectory Tracking Nonlinear Model Predictive Control for an Overactuated MAV , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Vijay Kumar,et al.  Trajectory generation and control of a quadrotor with a cable-suspended load - A differentially-flat hybrid system , 2013, 2013 IEEE International Conference on Robotics and Automation.

[37]  Nicolas Mansard,et al.  Trajectory generation for quadrotor based systems using numerical optimal control , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[38]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[39]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[40]  Ludovic Righetti,et al.  High-Frequency Nonlinear Model Predictive Control of a Manipulator , 2021, 2021 IEEE International Conference on Robotics and Automation (ICRA).

[41]  WächterAndreas,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006 .

[42]  Antonio Franchi,et al.  Control-Aware Motion Planning for Task-Constrained Aerial Manipulation , 2018, IEEE Robotics and Automation Letters.

[43]  Olivier Stasse,et al.  Whole-body model-predictive control applied to the HRP-2 humanoid , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[44]  Olivier Stasse,et al.  The Pinocchio C++ library : A fast and flexible implementation of rigid body dynamics algorithms and their analytical derivatives , 2019, 2019 IEEE/SICE International Symposium on System Integration (SII).

[45]  M. McCall,et al.  Rigid Body Dynamics , 2008 .

[46]  Paolo Rocco,et al.  Nonlinear model predictive control for aerial manipulation , 2017, 2017 International Conference on Unmanned Aircraft Systems (ICUAS).

[47]  Aníbal Ollero,et al.  A multilayer control for multirotor UAVs equipped with a servo robot arm , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[48]  John T. Betts,et al.  Practical Methods for Optimal Control and Estimation Using Nonlinear Programming , 2009 .

[49]  Philippe Martin,et al.  A Lie-Backlund approach to equivalence and flatness of nonlinear systems , 1999, IEEE Trans. Autom. Control..