A product-of-errors framework for linear hybrid system identification

Abstract We propose a general framework for identification of linear discrete-time hybrid systems in which arbitrary loss functions can be easily included. Our framework includes the algebraic (Vidal et al., 2003) and support vector regression (Lauer and Bloch, 2008a,b) methods as particular cases. Inspired by these approaches, we then propose an optimization framework that relies on the minimization of a product of loss functions. Here, the identification problem is recast as a nonlinear and non-convex, though continuous, optimization program that involves only the model parameters as variables. As a result, its complexity scales linearly with the number of data and it can easily be solved using standard global optimization methods. Moreover, we show that by choosing a saturated loss function, such as Hampel's loss function, the algorithm can efficiently deal with noise and outliers in the data. The final result is a general framework for linear hybrid system identification that can deal efficiently with noise, outliers, and large data sets. Numerical experiments demonstrate the efficiency and robustness of the proposed approach.

[1]  A. Juloski,et al.  A Bayesian approach to identification of hybrid systems , 2004, CDC.

[2]  Andrzej Cichocki,et al.  Neural networks for optimization and signal processing , 1993 .

[3]  Gérard Bloch,et al.  Switched and PieceWise Nonlinear Hybrid System Identification , 2008, HSCC.

[4]  René Vidal,et al.  Identification of Hybrid Systems: A Tutorial , 2007, Eur. J. Control.

[5]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[6]  W. P. M. H. Heemels,et al.  Comparison of Four Procedures for the Identification of Hybrid Systems , 2005, HSCC.

[7]  Alberto Bemporad,et al.  Identification of piecewise affine systems via mixed-integer programming , 2004, Autom..

[8]  Fabien Lauer,et al.  A new hybrid system identification algorithm with automatic tuning , 2008 .

[9]  S. Sastry,et al.  An algebraic geometric approach to the identification of a class of linear hybrid systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[10]  René Vidal,et al.  Identification of Deterministic Switched ARX Systems via Identification of Algebraic Varieties , 2005, HSCC.

[11]  René Vidal,et al.  Recursive identification of switched ARX systems , 2008, Autom..

[12]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[13]  Arnold Neumaier,et al.  Global Optimization by Multilevel Coordinate Search , 1999, J. Glob. Optim..

[14]  Kiyotsugu Takaba,et al.  Identification of piecewise affine systems based on statistical clustering technique , 2004, Autom..

[15]  Alberto Bemporad,et al.  A bounded-error approach to piecewise affine system identification , 2005, IEEE Transactions on Automatic Control.

[16]  Fabien Lauer From Support Vector Machines to Hybrid System Identification , 2008 .