Efficient Identification of Error-in-Variables Switched Systems via a Sum-of-Squares Polynomial Based Subspace Clustering Method

This paper addresses the problem of identification of error in variables switched linear models from experimental input/output data. This problem is known to be generically NP hard and thus computationally expensive to solve. To address this difficulty, several relaxations have been proposed in the past few years. While solvable in polynomial time these (convex) relaxations tend to scale poorly with the number of points and number/order of the subsystems, effectively limiting their applicability to scenarios with relatively small number of data points. To address this difficulty, in this paper we propose an efficient method that only requires performing (number of subsystems) singular value decompositions of matrices whose size is independent of the number of points. The underlying idea is to obtain a sum-of-squares polynomial approximation of the support of each subsystem one-at-a-time, and use these polynomials to segment the data into sets, each generated by a single subsystem. As shown in the paper, exploiting ideas from Christoffel’s functions allows for finding these polynomial approximations simply by performing SVDs. The parameters of each subsystem can then be identified from the segmented data using existing error-in-variables (EIV) techniques.

[1]  Mario Sznaier,et al.  SoS-RSC: A Sum-of-Squares Polynomial Approach to Robustifying Subspace Clustering Algorithms , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Allen Y. Yang,et al.  Estimation of Subspace Arrangements with Applications in Modeling and Segmenting Mixed Data , 2008, SIAM Rev..

[3]  Mario Sznaier,et al.  Randomized Algorithms for Analysis and Control of Uncertain Systems with Applications, Second Edition, Roberto Tempo, Giuseppe Calafiore, Fabrizio Dabbene (Eds.). Springer-Verlag, London (2013), 357, ISBN: 978-1-4471-4609-4 , 2014, Autom..

[4]  H. Fang,et al.  Identification of Switched Linear Systems via Sparse Optimization , 2015 .

[5]  Le Thi Hoai An,et al.  A Difference of Convex Functions Algorithm for Switched Linear Regression , 2014, IEEE Transactions on Automatic Control.

[6]  A. Juloski,et al.  HYBRID IDENTIFICATION OF NONLINEAR BIOCHEMICAL PROCESSES , 2006 .

[7]  Biao Huang,et al.  An improved algebraic geometric solution to the identification of switched ARX models with noise , 2011, Proceedings of the 2011 American Control Conference.

[8]  Chao Feng,et al.  Hybrid system identification via sparse polynomial optimization , 2010, Proceedings of the 2010 American Control Conference.

[9]  Fabien Lauer Global optimization for low-dimensional switching linear regression and bounded-error estimation , 2018, Autom..

[10]  S. Sastry,et al.  An algebraic geometric approach to the identification of a class of linear hybrid systems , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[11]  Biao Huang,et al.  An Iterative Algebraic Geometric Approach for Identification of Switched ARX Models with Noise , 2016 .

[12]  Yin Wang,et al.  A convex optimization approach to semi-supervised identification of switched ARX systems , 2014, 53rd IEEE Conference on Decision and Control.

[13]  Roland Tóth,et al.  An SDP approach for l0-minimization: Application to ARX model segmentation , 2013, Autom..

[14]  Constantino M. Lagoa,et al.  Identification of Switched ARX Systems from Large Noisy Data Sets , 2018, ArXiv.

[15]  Constantino M. Lagoa,et al.  A Sparsification Approach to Set Membership Identification of Switched Affine Systems , 2012, IEEE Transactions on Automatic Control.

[16]  Jasper V. Stokman,et al.  Orthogonal Polynomials of Several Variables , 2001, J. Approx. Theory.

[17]  Laurent Bako,et al.  Identification of switched linear systems via sparse optimization , 2011, Autom..

[18]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Alberto Bemporad,et al.  Identification of piecewise affine systems via mixed-integer programming , 2004, Autom..

[20]  Mario Sznaier,et al.  Efficient Identification of Error-in Variables Switched Systems Based on Riemannian Distance-Like Functions , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[21]  René Vidal,et al.  A Unified Algebraic Approach to 2-D and 3-D Motion Segmentation and Estimation , 2006, Journal of Mathematical Imaging and Vision.

[22]  René Vidal,et al.  Recursive identification of switched ARX systems , 2008, Autom..

[23]  Constantino M. Lagoa,et al.  Robust identification of switched affine systems via moments-based convex optimization , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[24]  Olivier Gehan,et al.  A real-time identification algorithm for switched linear systems with bounded noise , 2016, 2016 European Control Conference (ECC).

[25]  Constantino M. Lagoa,et al.  Set membership identification of switched linear systems with known number of subsystems , 2015, Autom..

[26]  Stéphane Lecoeuche,et al.  A recursive identification algorithm for switched linear/affine models , 2011 .

[27]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[28]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[29]  Jean B. Lasserre,et al.  Sorting out typicality with the inverse moment matrix SOS polynomial , 2016, NIPS.

[30]  A. Juloski,et al.  Data-based hybrid modelling of the component placement process in pick-and-place machines , 2004 .

[31]  Stefano Soatto,et al.  Applications of hybrid system identification in computer vision , 2007, 2007 European Control Conference (ECC).

[32]  Constantino M. Lagoa,et al.  GPCA with denoising: A moments-based convex approach , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[33]  Necmiye Ozay,et al.  An exact and efficient algorithm for segmentation of ARX models , 2016, 2016 American Control Conference (ACC).

[34]  Alberto Bemporad,et al.  A bounded-error approach to piecewise affine system identification , 2005, IEEE Transactions on Automatic Control.