Multirotors From Takeoff to Real-Time Full Identification Using the Modified Relay Feedback Test and Deep Neural Networks

Low cost real-time identification of multirotor unmanned aerial vehicle (UAV) dynamics is an active area of research supported by the surge in demand and emerging application domains. Such real-time identification capabilities shorten development time and cost, making UAVs' technology more accessible, and enable a variety of advanced applications. In this paper, we present a novel comprehensive approach, called DNN-MRFT, for real-time identification and tuning of multirotor UAVs using the Modified Relay Feedback Test (MRFT) and Deep Neural Networks (DNN). The first contribution is the development of a generalized framework for the application of DNN-MRFT to higher-order systems. The second contribution is a method for the exact estimation of identified process gain which mitigates the inaccuracies introduced due to the use of the describing function method in approximating the response of Lure's systems. The third contribution is a generalized controller based on DNN-MRFT that takes-off a UAV with unknown dynamics and identifies the inner loops dynamics in-flight. Using the developed generalized framework, DNN-MRFT is sequentially applied to the outer translational loops of the UAV utilizing in-flight results obtained for the inner attitude loops. DNN-MRFT takes on average 15 seconds to get the full knowledge of multirotor UAV dynamics and was tested on multiple designs and sizes. The identification accuracy of DNN-MRFT is demonstrated by the ability of a UAV to pass through a vertical window without any further tuning, calibration, or feedforward terms. Such demonstrated accuracy, speed, and robustness of identification pushes the limits of state-of-the-art in real-time identification of UAVs.

[1]  Shuzhi Sam Ge,et al.  Adaptive control of a quadrotor aerial vehicle with input constraints and uncertain parameters , 2018, Int. J. Control.

[2]  Andreas Krause,et al.  Safe controller optimization for quadrotors with Gaussian processes , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Bohyung Han,et al.  Regularizing Deep Neural Networks by Noise: Its Interpretation and Optimization , 2017, NIPS.

[4]  Saleh Mobayen,et al.  Adaptive sliding mode control for finite-time stability of quad-rotor UAVs with parametric uncertainties. , 2017, ISA transactions.

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Robert Mahony,et al.  Modelling and control of a large quadrotor robot , 2010 .

[7]  Mandy Eberhart,et al.  Helicopter Performance Stability And Control , 2016 .

[8]  Igor Boiko,et al.  Design of rules for in-flight non-parametric tuning of PID controllers for unmanned aerial vehicles , 2019, J. Frankl. Inst..

[9]  Dariusz Horla,et al.  Real-Time Model-Free Minimum-Seeking Autotuning Method for Unmanned Aerial Vehicle Controllers Based on Fibonacci-Search Algorithm , 2019, Sensors.

[10]  Antonio Franchi,et al.  Differential Flatness of Quadrotor Dynamics Subject to Rotor Drag for Accurate Tracking of High-Speed Trajectories , 2017, IEEE Robotics and Automation Letters.

[11]  Chun-Liang Lin,et al.  Identification of Flight Vehicle Models Using Fuzzified Eigensystem Realization Algorithm , 2011, IEEE Transactions on Industrial Electronics.

[12]  Bin Xu,et al.  Composite Learning Finite-Time Control With Application to Quadrotors , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  David Howard,et al.  A Platform That Directly Evolves Multirotor Controllers , 2017, IEEE Transactions on Evolutionary Computation.

[14]  Angela P. Schoellig,et al.  Deep neural networks for improved, impromptu trajectory tracking of quadrotors , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Tore Hägglund,et al.  Automatic tuning of simple regulators with specifications on phase and amplitude margins , 1984, Autom..

[16]  John E. Bennett,et al.  Identification of multivariable linear systems from input/output measurements , 1992, IEEE Trans. Ind. Electron..

[17]  Wojciech Giernacki,et al.  Iterative Learning Method for In-Flight Auto-Tuning of UAV Controllers Based on Basic Sensory Information , 2019, Applied Sciences.

[18]  Haoyong Yu,et al.  Composite Learning Robot Control With Friction Compensation: A Neural Network-Based Approach , 2019, IEEE Transactions on Industrial Electronics.

[19]  Stefan Jakubek,et al.  Combustion Engine Test Bed System Identification Under the Presence of Cyclic Disturbances , 2020 .

[20]  Ronald A. Rohrer,et al.  Sensitivity considerations in optimal system design , 1965 .

[21]  Akhilesh Swarup,et al.  On adaptive sliding mode control for improved quadrotor tracking , 2018 .

[22]  YangQuan Chen,et al.  A multifunctional HIL testbed for multirotor VTOL UAV actuator , 2010, Proceedings of 2010 IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications.

[23]  Sergey Levine,et al.  Low-Level Control of a Quadrotor With Deep Model-Based Reinforcement Learning , 2019, IEEE Robotics and Automation Letters.

[24]  Igor Boiko Input-output analysis of limit cycling relay feedback control systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[25]  D. P. Atherton,et al.  Nonlinear Control Engineering-Describing Function Analysis and Design , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[26]  Stijn Derammelaere,et al.  Online Identification of a Mechanical System in Frequency Domain Using Sliding DFT , 2016, IEEE Transactions on Industrial Electronics.

[27]  Liuping Wang,et al.  Automatic tuning of attitude control system for fixed-wing unmanned aerial vehicles , 2016 .

[28]  Yuanzhi Li,et al.  Convergence Analysis of Two-layer Neural Networks with ReLU Activation , 2017, NIPS.

[29]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Claire J. Tomlin,et al.  Quadrotor Helicopter Flight Dynamics and Control: Theory and Experiment , 2007 .

[31]  Igor Boiko Modified Relay Feedback Test (MRFT) and Tuning of PID Controllers , 2013 .

[32]  Diego Eckhard,et al.  Pitch and Roll control of a Quadcopter using Cascade Iterative Feedback Tuning , 2016 .

[33]  Jiancheng Fang,et al.  Frequency-Domain System Identification of an Unmanned Helicopter Based on an Adaptive Genetic Algorithm , 2014, IEEE Transactions on Industrial Electronics.

[34]  Raghad Al-Husari,et al.  Precision landing using an adaptive fuzzy multi-sensor data fusion architecture , 2018, Appl. Soft Comput..

[35]  Gaurav S. Sukhatme,et al.  Sim-to-(Multi)-Real: Transfer of Low-Level Robust Control Policies to Multiple Quadrotors , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  Igor Boiko,et al.  Design of non-parametric process-specific optimal tuning rules for PID control of flow loops , 2014, J. Frankl. Inst..

[37]  Charles Richter,et al.  Polynomial Trajectory Planning for Aggressive Quadrotor Flight in Dense Indoor Environments , 2016, ISRR.

[38]  Leonid M. Fridman,et al.  Analysis of Chattering in Systems With Second-Order Sliding Modes , 2007, IEEE Transactions on Automatic Control.

[39]  Ausif Mahmood,et al.  Review of Deep Learning Algorithms and Architectures , 2019, IEEE Access.

[40]  Roland Siegwart,et al.  PID vs LQ control techniques applied to an indoor micro quadrotor , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[41]  Raffaello D'Andrea,et al.  Optimization-based iterative learning for precise quadrocopter trajectory tracking , 2012, Autonomous Robots.

[42]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[43]  Pieter Abbeel,et al.  Autonomous Helicopter Aerobatics through Apprenticeship Learning , 2010, Int. J. Robotics Res..