A Tree Adjoining Grammar Representation for Models Of Stochastic Dynamical Systems

Abstract Model structure and complexity selection remains a challenging problem in system identification, especially for parametric non-linear models. Many Evolutionary Algorithm (EA) based methods have been proposed in the literature for estimating model structure and complexity. In most cases, the proposed methods are devised for estimating structure and complexity within a specified model class and hence these methods do not extend to other model structures without significant changes. In this paper, we propose a Tree Adjoining Grammar (TAG) for stochastic parametric models. TAGs can be used to generate models in an EA framework while imposing desirable structural constraints and incorporating prior knowledge. In this paper, we propose a TAG that can systematically generate models ranging from FIRs to polynomial NARMAX models. Furthermore, we demonstrate that TAGs can be easily extended to more general model classes, such as the non-linear Box–Jenkins model class, enabling the realization of flexible and automatic model structure and complexity selection via EA.

[1]  Roland Tóth,et al.  Grammar-based Representation and Identification of Dynamical Systems , 2018, 2019 18th European Control Conference (ECC).

[2]  Carlos A. Coello Coello,et al.  Multiobjective Evolutionary Algorithms in Aeronautical and Aerospace Engineering , 2012, IEEE Transactions on Evolutionary Computation.

[3]  Kamran Shafi,et al.  Prediction of dynamical systems by symbolic regression. , 2016, Physical review. E.

[4]  Aravind K. Joshi,et al.  Tree-Adjoining Grammars , 1997, Handbook of Formal Languages.

[5]  Alessandro Chiuso,et al.  Prediction error identification of linear systems: A nonparametric Gaussian regression approach , 2011, Autom..

[6]  David J. Murray-Smith,et al.  Nonlinear model structure identification using genetic programming , 1998 .

[7]  Carlos M. Fonseca,et al.  'Identifying the structure of nonlinear dynamic systems using multiobjective genetic programming , 2004, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[8]  C. Fonseca,et al.  Non-Linear System Identification with Multiobjective Genetic Algorithms , 1996 .

[9]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[10]  Saul Corn,et al.  Explicit Definitions and Linguistic Dominoes , 1967 .

[11]  Laura Kallmeyer.  A Declarative Characterization of Different Types of Multicomponent Tree Adjoining Grammars , 2009 .

[12]  Peter J. Fleming,et al.  Use of Genetic Programming in the Identification of Rational Model Structures , 2000, EuroGP.

[13]  I. J. Leontaritis,et al.  Input-output parametric models for non-linear systems Part II: stochastic non-linear systems , 1985 .

[14]  Guy Albert Dumont,et al.  System identification and control using genetic algorithms , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Håkan Hjalmarsson,et al.  Sparse Estimation of Polynomial and Rational Dynamical Models , 2014, IEEE Transactions on Automatic Control.

[16]  Ferenc Szeifert,et al.  Genetic programming for the identification of nonlinear input-output models , 2005 .

[17]  M. Stone.  The Generalized Weierstrass Approximation Theorem , 1948 .

[18]  Dario Piga,et al.  Sparse RKHS estimation via globally convex optimization and its application in LPV-IO identification , 2020, Autom..

[19]  S. Billings.  Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains , 2013 .

[20]  Lennart Ljung,et al.  System identification (2nd ed.): theory for the user , 1999 .

[21]  Roland Tóth,et al.  Data-driven Modelling of Dynamical Systems Using Tree Adjoining Grammar and Genetic Programming , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).