LPV model order selection in an LS-SVM setting

In parametric identification of Linear Parameter-Varying (LPV) systems, the scheduling dependencies of the model coefficients are commonly parameterized in terms of linear combinations of a-priori selected basis functions. Such functions need to be adequately chosen, e.g., on the basis of some first-principles or expert's knowledge of the system, in order to capture the unknown dependencies of the model coefficient functions on the scheduling variable and, at the same time, to achieve a low-variance of the model estimate by limiting the number of parameters to be identified. This problem together with the well-known model order selection problem (in terms of number of input lags, output lags and input delay of the model structure) in system identification can be interpreted as a trade-off between bias and variance of the resulting model estimate. The problem of basis function selection can be avoided by using a non-parametric estimator of the coefficient functions in terms of a recently proposed Least-Square Support-Vector-Machine (LS-SVM) approach. However, the selection of the model order still appears to be an open problem in the identification of LPV systems via the LS-SVM method. In this paper, we propose a novel reformulation of the LPV LS-SVM approach, which, besides of the non-parametric estimation of the coefficient functions, achieves data-driven model order selection via convex optimization. The properties of the introduced approach are illustrated via a simulation example.

[1]  L. Breiman Better subset regression using the nonnegative garrote , 1995 .

[2]  Håkan Hjalmarsson,et al.  Sparse estimation based on a validation criterion , 2011, IEEE Conference on Decision and Control and European Control Conference.

[3]  Wei Xing Zheng,et al.  Model structure learning: A support vector machine approach for LPV linear-regression models , 2011, IEEE Conference on Decision and Control and European Control Conference.

[4]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[5]  Håkan Hjalmarsson,et al.  Order and structural dependence selection of LPV-ARX models revisited , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[6]  Mario Sznaier,et al.  An LMI approach to control-oriented identification and model (In) validation of LPV systems , 2003, IEEE Trans. Autom. Control..

[7]  Roland Tóth,et al.  Order and structural dependence selection of LPV-ARX models using a nonnegative garrote approach , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[8]  Hugues Garnier,et al.  Refined instrumental variable methods for identification of LPV Box-Jenkins models , 2010, Autom..

[9]  Paulo J. Lopes dos Santos,et al.  Subspace identification of linear parameter-varying systems with innovation-type noise models driven by general inputs and a measurable white noise time-varying parameter vector , 2008, Int. J. Syst. Sci..

[10]  J. Suykens,et al.  Parameter Estimation for Time Varying Dynamical Systems using Least Squares Support Vector Machines , 2012 .

[11]  Javad Mohammadpour,et al.  Control of linear parameter varying systems with applications , 2012 .

[12]  Michael Athans,et al.  Analysis of gain scheduled control for nonlinear plants , 1990 .

[13]  Michel Verhaegen,et al.  Subspace identification of MIMO LPV systems using a periodic scheduling sequence , 2007, Autom..

[14]  Dario Piga,et al.  A convex relaxation approach to set-membership identification of LPV systems , 2012, Autom..

[15]  Michel Verhaegen,et al.  Subspace identification of Bilinear and LPV systems for open- and closed-loop data , 2009, Autom..

[16]  Roland Tóth,et al.  Asymptotically optimal orthonormal basis functions for LPV system identification , 2009, Autom..

[17]  J. Mercer Functions of Positive and Negative Type, and their Connection with the Theory of Integral Equations , 1909 .

[18]  Roland Toth,et al.  Modeling and Identification of Linear Parameter-Varying Systems , 2010 .

[19]  Bassam Bamieh,et al.  Identification of linear parameter varying models , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[20]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .