Augmented Models in Estimation and Control

The field of automatic control has seen tremendous advances in the past years, driven by the increasing availability of capable computers for small and embedded systems with tight constraints on cost, energy and size. Sophisticated nonlinear filters such as the Extended Kalman Filter can be run even on average embedded hardware, and complex optimizing control schemes such as Model Predictive Control can be precomputed and thus executed on tiny systems in real time. Despite the availability of promising new theories and algorithms, the practitioner often finds it hard to apply these methods to the problems at hand. One of the problems lies in the fact that the theoretical frameworks are relatively involved, rendering the adaptation of many theoretical algorithms to practical problems difficult. Many estimation and control algorithms employ a dynamical model of the system under consideration. Augmented models are a promising tools for extending such algorithms to fit practical problems. Augmenting a model thereby describes the act of appending additional dynamics to an already existing model of the system. These augmented dynamics may for instance represent disturbances acting on the system, or they may be used to model varying parameters of the dynamic equations of the system. The advantage of augmented models is that they do not conceptually change the underlying algorithm, thus retaining most or all of its properties. This thesis strives to give an overview of the uses of augmented models in estimation and control, and to provide several methods which facilitate the adaptation of existing algorithms to practical problems. In the first part, preliminaries necessary to understand the text are established. In the second part, two case studies are presented demonstrating the usefulness of augmented models in estimation. The first study is concerned with attitude detection of vehicles with low-cost sensors. A sensor box is fitted to the vehicle comprising a GPS receiver and an accelerometer. The orientation of the box with respect to the vehicle is unknown and has thus to be inferred from the measurements. The lack of gyros (turn rate sensors) further complicates the task. An Extended Kalman Filter (EKF) is employed, where the equations of motion of the vehicle are augmented by the installation angles. This approach is shown to reliably produce correct estimates both in simulation and experimental trials. A second case study revolves around a collision avoidance system for light aircraft. The system uses GPS measurements to continuously compute a prediction of the aircraft trajectory, which is then transmitted by means of a digital radio link. For the system to work correctly, the prediction needs to be accurate. The current implementation does not account for wind, thus showing significant prediction error when strong wind disturbances are encountered. We show that by employing a dynamical model of the aircraft, augmented by a wind model and then using an Interacting Multiple Models (IMM) filter, a high prediction accuracy can be attained also in windy conditions. The method has been validated experimentally by using a large database of flight records of gliders. The third part is dedicated to reference tracking with Model Predictive Control. In many practical control applications, a design goal is to remove tracking offset in presence of persistent disturbances and model mismatch. Classical control methods such as PID achieve this by explicitly adding integral action on the tracking error, which automatically eliminates offset in the steady-state. In the MPC framework, this approach does not provide an adequate solution since windup issues may arise when constraints on the input or the state vector are present. We tackle the problem by employing model augmentation, where a disturbance model captures the effects of model mismatch and disturbances. An observer is used to estimate the disturbance, a target state is computed from the disturbance estimate and the reference, and the MPC formulation is extended to penalize the deviation from this target state. We first treat the case where the system state is measurable and no model mismatch is present, termed the nominal case. This case is motivated by an inverted pendulum benchmark problem. We move on by considering offset-free control with linear models and constant

[1]  Yaakov Bar-Shalom,et al.  Estimation and Tracking: Principles, Techniques, and Software , 1993 .

[2]  C. Johnson Optimal control of the linear regulator with constant disturbances , 1968 .

[3]  Paul Zarchan,et al.  Fundamentals of Kalman Filtering: A Practical Approach , 2001 .

[4]  K. T. Tan,et al.  Linear systems with state and control constraints: the theory and application of maximal output admissible sets , 1991 .

[5]  Manfred Morari,et al.  Linear offset-free Model Predictive Control , 2009, Autom..

[6]  K.J. Astrom,et al.  Safe manual control of the Furuta pendulum , 2001, Proceedings of the 2001 IEEE International Conference on Control Applications (CCA'01) (Cat. No.01CH37204).

[7]  S. Benamor,et al.  A Luenberger-like observer for discrete-time nonlinear systems , 1997, 1997 European Control Conference (ECC).

[8]  Manfred Morari,et al.  Nonlinear offset-free model predictive control , 2012, Autom..

[9]  J. Pearson,et al.  Robust solutions to linear multivariable control problems , 1974 .

[10]  Alan Watts,et al.  This Is It , 1960 .

[11]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[12]  E. Gilbert,et al.  Computation of minimum-time feedback control laws for discrete-time systems with state-control constraints , 1987 .

[13]  David M. Bevly,et al.  Global Positioning System (GPS): A Low-Cost Velocity Sensor for Correcting Inertial Sensor Errors on Ground Vehicles , 2004 .

[14]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[15]  Bruce A. Francis,et al.  The internal model principle of control theory , 1976, Autom..

[16]  S. Ge,et al.  A global Implicit Function Theorem without initial point and its applications to control of non-affine systems of high dimensions , 2006 .

[17]  James B. Rawlings,et al.  Model predictive control with linear models , 1993 .

[18]  Manfred Morari,et al.  Offset-free reference tracking for predictive controllers , 2007, 2007 46th IEEE Conference on Decision and Control.

[19]  E. Mosca,et al.  Nonlinear control of constrained linear systems via predictive reference management , 1997, IEEE Trans. Autom. Control..

[20]  Guido Herrmann,et al.  Advanced Strategies in Control Systems with Input and Output Constraints , 2006 .

[21]  A. Bemporad,et al.  Constraint fulfilment in feedback control via predictive reference management , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[22]  J. Richalet,et al.  Model predictive heuristic control: Applications to industrial processes , 1978, Autom..

[23]  Malcolm D. Shuster Survey of attitude representations , 1993 .

[24]  Andrew Y. C. Nee,et al.  Methods for in-field user calibration of an inertial measurement unit without external equipment , 2008 .

[25]  Jan M. Maciejowski,et al.  The Implicit Daisy-Chaining Property of Constrained Predictive Control , 1997 .

[26]  D. Magill Optimal adaptive estimation of sampled stochastic processes , 1965 .

[27]  Mato Baotic,et al.  Multi-Parametric Toolbox (MPT) , 2004, HSCC.

[28]  Urban Maeder,et al.  Trajectory prediction for low-cost collision avoidance systems , 2009, 2009 IEEE/AIAA 28th Digital Avionics Systems Conference.

[29]  Manfred Morari,et al.  Analysis of discrete-time piecewise affine and hybrid systems , 2002, Autom..

[30]  S. Joe Qin,et al.  A survey of industrial model predictive control technology , 2003 .

[31]  Francesco Borrelli,et al.  On a Property of a Class of Offset-Free Model Predictive Controllers , 2009, IEEE Transactions on Automatic Control.

[32]  W. Dale Blair,et al.  IMM algorithm for tracking targets that maneuver through coordinated turns , 1992, Defense, Security, and Sensing.

[33]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[34]  Hugh F. Durrant-Whyte,et al.  A high integrity IMU/GPS navigation loop for autonomous land vehicle applications , 1999, IEEE Trans. Robotics Autom..

[35]  Petros G. Voulgaris,et al.  On optimal ℓ∞ to ℓ∞ filtering , 1995, Autom..

[36]  H. Nijmeijer Observability of autonomous discrete time non-linear systems: a geometric approach , 1982 .

[37]  Kenneth R. Muske,et al.  Disturbance model design for linear model predictive control , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[38]  Eduardo Sontag On the Observability of Polynomial Systems. , 1977 .

[39]  H. P. Blom An efficient filter for abruptly changing systems , 1984, The 23rd IEEE Conference on Decision and Control.

[40]  M. Morari,et al.  Explicit Model Predictive Control , 2007 .

[41]  Gabriele Pannocchia,et al.  Disturbance models for offset‐free model‐predictive control , 2003 .

[42]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[43]  Riccardo Scattolini,et al.  A stabilizing model-based predictive control algorithm for nonlinear systems , 2001, Autom..

[44]  Robert H. Bishop,et al.  Nonlinear approach to aircraft tracking problem , 1994 .

[45]  Y. Chan,et al.  A Kalman Filter Based Tracking Scheme with Input Estimation , 1979, IEEE Transactions on Aerospace and Electronic Systems.

[46]  W. Wonham,et al.  Synthesis of multivariable regulators: The internal model principle , 1974 .

[47]  L. B. Koppel Input multiplicities in nonlinear, multivariable control systems , 1982 .

[48]  H. Sorenson Approximate solutions of the nonlinear filtering problem , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[49]  M. Soroush Nonlinear state-observer design with application to reactors , 1997 .

[50]  F. Landis Markley,et al.  Attitude Estimation or Quaternion Estimation , 2003 .

[51]  Katsuhisa Furuta,et al.  Tracking domains for unstable plants with saturating-like actuators , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[52]  Darci Odloak,et al.  Robust MPC for systems with output feedback and input saturation , 2005 .

[53]  Gabriele Pannocchia,et al.  Robust Disturbance Modeling for Model Predictive Control with Application to Multivariable Ill-conditioned Processes , 2003 .

[54]  E. Davison,et al.  Pole assignment in linear time-invariant multivariable systems with constant disturbances , 1971 .

[55]  W. Rugh Linear System Theory , 1992 .

[56]  Jan M. Maciejowski,et al.  Predictive control : with constraints , 2002 .

[57]  Pascal Grieder,et al.  Efficient computation of feedback controllers for constrained systems , 2004 .

[58]  Manfred Morari,et al.  Trajectory Prediction for Light Aircraft , 2011 .

[59]  Thiagalingam Kirubarajan,et al.  Precision large scale air traffic surveillance using IMM/assignment estimators , 1999 .

[60]  Petter Tøndel,et al.  Constrained optimal control via multiparametric quadraticprogramming , 2003 .

[61]  Jitendra K. Tugnait,et al.  Validation and Comparison of Coordinated Turn Aircraft Maneuver Models , 2000 .

[62]  M. Pachter,et al.  Manual flight control with saturating actuators , 1998 .

[63]  P. Olver Nonlinear Systems , 2013 .

[64]  R. Mehra A comparison of several nonlinear filters for reentry vehicle tracking , 1971 .

[65]  L. Roberts Simulation of large-scale dynamic systems , 1975 .

[66]  Manfred Morari,et al.  Complexity reduction of receding horizon control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[67]  Xiaoji Niu,et al.  A Universal Approach for Processing any MEMS Inertial Sensor Configuration for Land-Vehicle Navigation , 2007, Journal of Navigation.

[68]  Coleman B. Brosilow,et al.  The modular multivariable controller: I: Steady‐state properties , 1992 .

[69]  Manfred Morari,et al.  Comparison of Hybrid Control Techniques for Buck and Boost DC-DC Converters , 2010, IEEE Transactions on Control Systems Technology.

[70]  Eric C. Kerrigan,et al.  Offset-free control of constrained linear discrete-time systems subject to persistent unmeasured disturbances , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[71]  Eduardo D. Sontag,et al.  Mathematical Control Theory: Deterministic Finite Dimensional Systems , 1990 .

[72]  Hugh F. Durrant-Whyte,et al.  Initial calibration and alignment of low-cost inertial navigation units for land vehicle applications , 1999, J. Field Robotics.

[73]  Alberto Bemporad,et al.  Nonlinear predictive reference governor for constrained control systems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[74]  Y. Bar-Shalom,et al.  Tracking a maneuvering target using input estimation versus the interacting multiple model algorithm , 1989 .

[75]  S MaybeckP,et al.  Investigation of constant turn-rate dynamics models in filters for airborne vehicle tracking. , 1982 .

[76]  James G. Hanley A Comparison of Nonlinear Algorithms to Prevent Pilot-Induced Oscillations Caused by Actuator Rate Limiting , 2012 .

[77]  J. Grizzle,et al.  The Extended Kalman Filter as a Local Asymptotic Observer for Nonlinear Discrete-Time Systems , 1992, 1992 American Control Conference.

[78]  S. Galeani,et al.  Non-linear anti-windup for manual flight control , 2005 .

[79]  Aboelmagd Noureldin,et al.  Performance Enhancement of MEMS-Based INS/GPS Integration for Low-Cost Navigation Applications , 2009, IEEE Transactions on Vehicular Technology.

[80]  Yaakov Bar-Shalom,et al.  Multitarget-Multisensor Tracking: Applications and Advances , 1992 .

[81]  Amir Averbuch,et al.  Interacting Multiple Model Methods in Target Tracking: A Survey , 1988 .

[82]  Graham C. Goodwin,et al.  Robust output-feedback model predictive control for systems with unstructured uncertainty , 2008, Autom..

[83]  J. Grizzle,et al.  Observer design for nonlinear systems with discrete-time measurements , 1995, IEEE Trans. Autom. Control..

[84]  Alberto Bemporad,et al.  The explicit solution of model predictive control via multiparametric quadratic programming , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[85]  Riccardo Scattolini,et al.  Output feedback and tracking of nonlinear systems with model predictive control , 2001, Autom..

[86]  Alberto Bemporad,et al.  Model predictive control based on linear programming - the explicit solution , 2002, IEEE Transactions on Automatic Control.

[87]  Y. Bar-Shalom,et al.  The interacting multiple model algorithm for systems with Markovian switching coefficients , 1988 .

[88]  Manfred Morari,et al.  Model predictive control: Theory and practice - A survey , 1989, Autom..

[89]  Mayuresh V. Kothare,et al.  Robust output feedback model predictive control using off-line linear matrix inequalities , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[90]  M. Zeitz The extended Luenberger observer for nonlinear systems , 1987 .

[91]  M. Yamakita,et al.  A NEW INVERTED PENDULUM APPARATUS FOR EDUCATION , 1992 .

[92]  Manfred Morari,et al.  Offset free model predictive control , 2007, 2007 46th IEEE Conference on Decision and Control.

[93]  Yehuda Bock,et al.  Error analysis of continuous GPS position time series , 2004 .

[94]  Manfred Morari,et al.  Offset-free reference tracking with model predictive control , 2010, Autom..

[95]  David Q. Mayne,et al.  Constrained model predictive control: Stability and optimality , 2000, Autom..

[96]  Alberto Bemporad,et al.  Dynamic programming for constrained optimal control of discrete-time linear hybrid systems , 2005, Autom..

[97]  C. Johnson Further study of the linear regulator with disturbances--The case of vector disturbances satisfying a linear differential equation , 1970 .

[98]  Yin-Chang Liu,et al.  Simulation of large scale dynamic systems. I: Modular integration methods , 1987 .

[99]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[100]  Alberto Bemporad,et al.  The explicit linear quadratic regulator for constrained systems , 2003, Autom..

[101]  E. Vinande,et al.  Mounting-Angle Estimation for Personal Navigation Devices , 2010, IEEE Transactions on Vehicular Technology.

[102]  W. Wonham,et al.  Regulation and Internal Stabilization in Linear Multivariable Systems , 1974 .

[103]  M. Shuster A survey of attitude representation , 1993 .

[104]  G. Stephanopoulos,et al.  Minimizing unobservability in inferential control schemes , 1980 .

[105]  J. Stuelpnagel On the Parametrization of the Three-Dimensional Rotation Group , 1964 .

[106]  Fredrik Gustafsson,et al.  Slip-based tire-road friction estimation , 1997, Autom..

[107]  Alberto Bemporad,et al.  Reference governor for constrained nonlinear systems , 1998, IEEE Trans. Autom. Control..

[108]  James B. Rawlings,et al.  Achieving state estimation equivalence for misassigned disturbances in offset‐free model predictive control , 2009 .

[109]  Kenneth R. Muske,et al.  Disturbance modeling for offset-free linear model predictive control , 2002 .

[110]  Manfred Morari,et al.  Studies in the synthesis of control structures for chemical processes: Part III: Optimal selection of secondary measurements within the framework of state estimation in the presence of persistent unknown disturbances , 1980 .

[111]  Alberto Bemporad,et al.  An MPC/hybrid system approach to traction control , 2006, IEEE Transactions on Control Systems Technology.

[112]  W. Denham,et al.  Sequential estimation when measurement function nonlinearity is comparable to measurement error. , 1966 .

[113]  E. Davison The robust control of a servomechanism problem for linear time-invariant multivariable systems , 1976 .

[114]  Xiaoji Niu,et al.  Civilian Vehicle Navigation: Required Alignment of the Inertial Sensors for Acceptable Navigation Accuracies , 2008, IEEE Transactions on Vehicular Technology.

[115]  W. Wonham Tracking and Regulation in Linear Multivariable Systems , 1973 .

[116]  E. Davison The output control of linear time-invariant multivariable systems with unmeasurable arbitrary disturbances , 1972 .

[117]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[118]  Laura R. Ray,et al.  Nonlinear Tire Force Estimation and Road Friction Identification: Simulation and Experiments, , 1997, Autom..

[119]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[120]  E. Kerrigan Robust Constraint Satisfaction: Invariant Sets and Predictive Control , 2000 .