Local and Piecewise Affine Approaches to System Identification

Identification of nonlinear systems is a multifaceted research area, with many diverse approaches and methods. This thesis considers two different approaches: (nonparametric) local modelling, and i ...

[1]  A. T. Fuller,et al.  Relay control systems optimized for various performance criteria , 1960 .

[2]  E. Nadaraya.  On Estimating Regression , 1964 .

[3]  G. S. Watson,et al.  Smooth regression analysis , 1964 .

[4]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[5]  V. A. Epanechnikov.  Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[6]  A. N. Shiryaev,et al.  Minimax Weights in a Trend Detection Problem of a Random Process , 1971 .

[7]  M. Priestley,et al.  Non‐Parametric Function Fitting , 1972 .

[8]  G. Nemhauser,et al.  Integer Programming , 2020 .

[9]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[10]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[11]  C. J. Stone,et al.  Consistent Nonparametric Regression , 1977 .

[12]  Sung Mo Kang,et al.  Section-wise piecewise-linear functions: Canonical representation, properties, and applications , 1977, Proceedings of the IEEE.

[13]  L. Chua,et al.  A global representation of multidimensional piecewise-linear functions with linear partitions , 1978 .

[14]  Jerome Sacks,et al.  LINEAR ESTIMATION FOR APPROXIMATELY LINEAR MODELS , 1978 .

[15]  W. Cleveland.  Robust Locally Weighted Regression and Smoothing Scatterplots , 1979 .

[16]  Richard C. Larson,et al.  Model Building in Mathematical Programming , 1979 .

[17]  H. Müller,et al.  Kernel estimation of regression functions , 1979 .

[18]  W. Strawderman,et al.  IMPROVEMENTS ON LINEAR MINIMAX ESTIMATES , 1982 .

[19]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[20]  H. Müller,et al.  Kernels for Nonparametric Curve Estimation , 1985 .

[21]  Editors , 1986, Brain Research Bulletin.

[22]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[23]  S. Billings,et al.  Piecewise linear identification of non-linear systems , 1987 .

[24]  Lawrence Davis,et al.  Genetic Algorithms and Simulated Annealing , 1987 .

[25]  David J. Reinkensmeyer,et al.  Using associative content-addressable memories to control robots , 1988, Proceedings of the 27th IEEE Conference on Decision and Control.

[26]  Leon O. Chua,et al.  Canonical piecewise-linear representation , 1988 .

[27]  W. Cleveland,et al.  Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting , 1988 .

[28]  Anders Skeppstedt.  Construction of composite models from large data-sets , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[29]  Jan-Erik Strömberg,et al.  Trees as Black-Box Model Structures for Dynamical Systems , 1990 .

[30]  Jörg A. Walter,et al.  Nonlinear prediction with self-organizing maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[31]  Roy Batruni,et al.  A multilayer neural network with piecewise-linear structure and back-propagation learning , 1991, IEEE Trans. Neural Networks.

[32]  Antonio Vicino,et al.  Optimal estimation theory for dynamic systems with set membership uncertainty: An overview , 1991, Autom..

[33]  S. Vavasis.  Nonlinear optimization: complexity issues , 1991 .

[34]  C. Guzelis,et al.  A canonical representation for piecewise-affine maps and its applications to circuit analysis , 1991 .

[35]  J.-N. Lin,et al.  Canonical piecewise-linear approximations , 1992 .

[36]  Léon Bottou,et al.  Local Learning Algorithms , 1992, Neural Computation.

[37]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[38]  Asymptotic effectiveness of some higher order kernels , 1992 .

[39]  Kumpati S. Narendra,et al.  Neural networks in control systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[40]  Lennart Ljung,et al.  Construction of Composite Models from Observed Data , 1992 .

[41]  L. Chua,et al.  The complete canonical piecewise-linear representation. I. The geometry of the domain space , 1992 .

[42]  Andrew C. Singer,et al.  Codebook prediction: a nonlinear signal modeling paradigm , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[43]  Thomas Martinetz,et al.  'Neural-gas' network for vector quantization and its application to time-series prediction , 1993, IEEE Trans. Neural Networks.

[44]  Leo Breiman,et al.  Hinging hyperplanes for regression, classification, and function approximation , 1993, IEEE Trans. Inf. Theory.

[45]  Saul B. Gelfand,et al.  A tree-structured piecewise linear adaptive filter , 1993, IEEE Trans. Inf. Theory.

[46]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[47]  Thomas A. Henzinger,et al.  Automatic symbolic verification of embedded systems , 1993, 1993 Proceedings Real-Time Systems Symposium.

[48]  Torbjörn Wigren,et al.  Recursive prediction error identification using the nonlinear wiener model , 1993, Autom..

[49]  T. Johansen,et al.  Identification of non-linear system structure and parameters using regime decomposition , 1994, Autom..

[50]  R. Unbehauen,et al.  A generalization of canonical piecewise-linear functions , 1994 .

[51]  M. Wand,et al.  Multivariate Locally Weighted Least Squares Regression , 1994 .

[52]  Chong-Ho Choi,et al.  Constructive neural networks with piecewise interpolation capabilities for function approximations , 1994, IEEE Trans. Neural Networks.

[53]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[54]  Henrik Gollee,et al.  A constructive learning algorithm for local model networks , 1994 .

[55]  Dick den Hertog,et al.  Interior Point Approach to Linear, Quadratic and Convex Programming: Algorithms and Complexity , 1994 .

[56]  Roderick Murray-Smith,et al.  Local model networks and local learning , 1994 .

[57]  Wolfgang Härdle,et al.  Applied Nonparametric Regression , 1991 .

[58]  Carl E. Rasmussen,et al.  In Advances in Neural Information Processing Systems , 2011 .

[59]  Eduardo D. Sontag,et al.  Interconnected Automata and Linear Systems: A Theoretical Framework in Discrete-Time , 1996, Hybrid Systems.

[60]  C. Floudas.  Nonlinear and Mixed-Integer Optimization: Fundamentals and Applications , 1995 .

[61]  Clive R. Loader.  Old Faithful Erupts: Bandwidth Selection Reviewed , 1995 .

[62]  Thomas A. Henzinger,et al.  The Algorithmic Analysis of Hybrid Systems , 1995, Theor. Comput. Sci..

[63]  Matthew P. Wand,et al.  Kernel Smoothing , 1995 .

[64]  Lennart Ljung,et al.  Nonlinear black-box modeling in system identification: a unified overview , 1995, Autom..

[65]  Gonzalo R. Arce,et al.  Piecewise linear system modeling based on a continuous threshold decomposition , 1996, IEEE Trans. Signal Process..

[66]  W. Cleveland,et al.  Smoothing by Local Regression: Principles and Methods , 1996 .

[67]  Manfred Morari,et al.  The false nearest neighbors algorithm: An overview , 1997 .

[68]  M. A. Jordan,et al.  Persistency of excitation and richness in continuous-time piecewise linear systems , 1997, 1997 1st International Conference, Control of Oscillations and Chaos Proceedings (Cat. No.97TH8329).

[69]  David Mackay,et al.  Gaussian Processes - A Replacement for Supervised Neural Networks? , 1997 .

[70]  Olaf Stursberg,et al.  A Case Study in Tool-Aided Analysis of Discretely Controlled Continuous Systems: The Two Tanks Problem , 1997, Hybrid Systems.

[71]  Geoffrey E. Hinton,et al.  Evaluation of Gaussian processes and other methods for non-linear regression , 1997 .

[72]  Thomas A. Henzinger,et al.  HYTECH: a model checker for hybrid systems , 1997, International Journal on Software Tools for Technology Transfer.

[73]  Radford M. Neal.  Monte Carlo Implementation of Gaussian Process Models for Bayesian Regression and Classification , 1997, physics/9701026.

[74]  Bruce H. Krogh,et al.  Computing Approximating Automata for a Class of Linear Hybrid Systems , 1997, Hybrid Systems.

[75]  Robert Azencott,et al.  Piecewise Affine Neural Networks and Nonlinear Control , 1998 .

[76]  Jukka Heikkonen,et al.  Recurrent SOM with local linear models in time series prediction , 1998, ESANN.

[77]  Clifford M. Hurvich,et al.  Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion , 1998 .

[78]  Vassilios Petridis,et al.  Identification of switching dynamical systems using multiple models , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[79]  B. Krogh,et al.  Computing polyhedral approximations to flow pipes for dynamic systems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[80]  V. Borkar,et al.  A unified framework for hybrid control: model and optimal control theory , 1998, IEEE Trans. Autom. Control..

[81]  Ingo Hoffmann,et al.  Identification of hybrid systems , 1998, Proceedings of the 1998 American Control Conference. ACC (IEEE Cat. No.98CH36207).

[82]  Alfredo C. Desages,et al.  Canonical piecewise-linear approximation of smooth functions , 1998 .

[83]  S. Ernst,et al.  Hinging hyperplane trees for approximation and identification , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[84]  Paolo Pellizzari,et al.  Adaptive local linear models for financial time series , 1998 .

[85]  Computation of piecewise quadratic Lyapunov functions for hybrid systems , 1998, IEEE Trans. Autom. Control..

[86]  Valur Einarsson.  On Verification of Switched Systems using Abstractions , 1998 .

[87]  M. Branicky.  Multiple Lyapunov functions and other analysis tools for switched and hybrid systems , 1998, IEEE Trans. Autom. Control..

[88]  Don R. Hush,et al.  Efficient algorithms for function approximation with piecewise linear sigmoidal networks , 1998, IEEE Trans. Neural Networks.

[89]  P. Pucar,et al.  On the Hinge-Finding Algorithm for Hinging Hyperplanes , 1998, IEEE Trans. Inf. Theory.

[90]  P. Julián,et al.  High-level canonical piecewise linear representation using a simplicial partition , 1999 .

[91]  Anna Hagenblad,et al.  Aspects of the Identification of Wiener Models , 1999 .

[92]  Sergei Leonov.  Remarks on extremal problems in nonparametric curve estimation , 1999 .

[93]  O. Stursberg,et al.  Approximating switched continuous systems by rectangular automata , 1999, 1999 European Control Conference (ECC).

[94]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[95]  Heinz A. Preisig,et al.  Control based on discrete-event models of continuous systems , 1999, 1999 European Control Conference (ECC).

[96]  M. Birattari,et al.  Lazy learning for local modelling and control design , 1999 .

[97]  J. Raisch,et al.  Discrete control of switched linear systems , 1999, 1999 European Control Conference (ECC).

[98]  Anders Stenman,et al.  Model on Demand: Algorithms, Analysis and Applications , 1999 .

[99]  Michel Verhaegen,et al.  Linear and Non-linear System Identification Using Separable Least-Squares , 1997, Eur. J. Control.

[100]  Alberto Bemporad,et al.  A framework for control, fault detection, state estimation, and verification of hybrid systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[101]  Silvio Simani,et al.  Parameter identification for piecewise-affine fuzzy models in noisy environment , 1999, Int. J. Approx. Reason..

[102]  Stefan Pettersson,et al.  Analysis and Design of Hybrid Systems , 1999 .

[103]  Ingo Hoffmann.  Identifikation hybrider dynamischer Systeme , 1999 .

[104]  Simin Nadjm-Tehrani,et al.  Formal Verification of Dynamic Properties in an Aerospace Application , 1999, Formal Methods Syst. Des..

[105]  John Lygeros,et al.  Controllers for reachability specifications for hybrid systems , 1999, Autom..

[106]  Fuzhen Zhang.  Matrix Theory: Basic Results and Techniques , 1999 .

[107]  C. Loader.  Bandwidth selection: classical or plug-in? , 1999 .

[108]  R. Azencott,et al.  Piecewise affine neural networks and nonlinear control: stability results , 1999 .

[109]  Jacob Roll,et al.  Invariance of Approximating Automata for Piecewise Linear Systems with Uncertainties , 2000, HSCC.

[110]  Daniel E. Koditschek,et al.  Piecewise linear homeomorphisms: the scalar case , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[111]  Amir F. Atiya,et al.  A new algorithm for learning in piecewise-linear neural networks , 2000, Neural Networks.

[112]  O. Stursberg,et al.  Continuous-discrete interactions in chemical processing plants , 2000, Proceedings of the IEEE.

[113]  Marcus Rubensson.  Discrete-time stability analysis of hybrid systems : a Lyapunov approach , 2000 .

[114]  R. Decarlo,et al.  Perspectives and results on the stability and stabilizability of hybrid systems , 2000, Proceedings of the IEEE.

[115]  Valur Einarsson.  Model Checking Methods for Mode Switching Systems , 2000 .

[116]  George J. Pappas,et al.  Discrete abstractions of hybrid systems , 2000, Proceedings of the IEEE.

[117]  C.G. Cassandras,et al.  Optimal control of hybrid systems in manufacturing , 2000, Proceedings of the IEEE.

[118]  Alberto Bemporad,et al.  Observability and controllability of piecewise affine and hybrid systems , 2000, IEEE Trans. Autom. Control..

[119]  Alberto Bemporad,et al.  miqp. m: a Matlab function for solving Mixed Integer Quadratic Programs Version 1.02 - User Guide , 2000 .

[120]  Colin L. Mallows,et al.  Some Comments on Cp , 2000, Technometrics.

[121]  Alberto Bemporad,et al.  Optimization-Based Verification and Stability Characterization of Piecewise Affine and Hybrid Systems , 2000, HSCC.

[122]  P.J. Antsaklis,et al.  Supervisory control of hybrid systems , 2000, Proceedings of the IEEE.

[123]  J. Lygeros,et al.  High-level modeling and analysis of the traffic alert and collision avoidance system (TCAS) , 2000, Proceedings of the IEEE.

[124]  Fredrik Gustafsson,et al.  Adaptive filtering and change detection , 2000 .

[125]  B. Mallick,et al.  Bayesian regression with multivariate linear splines , 2001 .

[126]  Mauricio G. C. Resende,et al.  Piecewise Linear Time Series Estimation with GRASP , 2001, Comput. Optim. Appl..

[127]  Shuning Wang,et al.  A canonical representation of high-dimensional continuous piecewise-linear functions , 2001 .

[128]  Ingela Lind.  Regressor Selection in System Identification using ANOVA , 2001 .

[129]  Jozef Vörös.  Parameter identification of Wiener systems with discontinuous nonlinearities , 2001, Syst. Control. Lett..

[130]  Gaëtan Kerschen,et al.  THEORETICAL AND EXPERIMENTAL IDENTIFICATION OF A NON-LINEAR BEAM , 2001 .

[131]  Bart De Schutter,et al.  Equivalence of hybrid dynamical models , 2001, Autom..

[132]  L. Ljung,et al.  Identification of hybrid systems via mixed-integer programming , 2001 .

[133]  Jacob Roll,et al.  A non-asymptotic approach to local modelling , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[134]  Eberhard Münz,et al.  Identification of hybrid systems using a priori knowledge , 2002 .

[135]  M. Resende,et al.  A Combinatorial Approach to Piecewise Linear Time Series Analysis , 2002 .

[136]  Jacob Roll,et al.  Robust Verification of Piecewise Affine Systems , 2002 .

[137]  Jacob Roll,et al.  Local Modelling of Non linear Dynamic Systems Using Direct Weight Optimization , 2003 .

[138]  Alberto Bemporad,et al.  A Greedy Approach to Identification of Piecewise Affine Models , 2003, HSCC.

[139]  Manfred Morari,et al.  A clustering technique for the identification of piecewise affine systems , 2001, Autom..

[140]  M. Johansson,et al.  Piecewise Linear Control Systems , 2003 .

[141]  Jacob Roll,et al.  Local modelling with a priori known bounds using direct weight optimization , 2003, 2003 European Control Conference (ECC).

[142]  Andrew W. Moore,et al.  Locally Weighted Learning for Control , 1997, Artificial Intelligence Review.

[143]  Alberto Bemporad,et al.  Identification of piecewise affine systems via mixed-integer programming , 2004, Autom..

[144]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.