Identification of Underlying Dynamic System from Noisy Data with Splines

In this paper, we propose a two-stage method called Spline Assisted Partial Differential Equation involved Model Identification (SAPDEMI) to efficiently identify the underlying partial differential equation (PDE) models from the noisy data. In the first stage – functional estimation stage – we employ the cubic spline to estimate the unobservable derivatives, which serve as candidates included the underlying PDE models. The contribution of this stage is that, it is computational efficient because it only requires the computational complexity of the linear polynomial of the sample size, which achieves the lowest possible order of complexity. In the second stage – model identification stage – we apply Least Absolute Shrinkage and Selection Operator (Lasso) to identify the underlying PDE models. The contribution of this stage is that, we focus on the model selections, while the existing literature mostly focuses on parameter estimations. Moreover, we develop statistical properties of our method for correct identification, where the main tool we use is the primal-dual witness (PDW) method. Finally, we validate our theory through various numerical examples.

[1]  Jiguo Cao,et al.  Parameter Estimation of Partial Differential Equation Models , 2013, Journal of the American Statistical Association.

[2]  George Trapp,et al.  Using Complex Variables to Estimate Derivatives of Real Functions , 1998, SIAM Rev..

[3]  Steven L. Brunton,et al.  Data-driven discovery of partial differential equations , 2016, Science Advances.

[4]  M. Rosenblatt,et al.  Smoothing Splines: Regression, Derivatives and Deconvolution , 1983 .

[5]  J. Kurths,et al.  Amplitude equations from spatiotemporal binary-fluid convection data , 1999 .

[6]  B. Silverman,et al.  Spline Smoothing: The Equivalent Variable Kernel Method , 1984 .

[7]  M. Rosenblatt Remarks on a Multivariate Transformation , 1952 .

[8]  J N Kutz,et al.  Model selection for dynamical systems via sparse regression and information criteria , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[9]  Davide Ambrosi,et al.  BLOOD fLOw VeLOCITY fIeLD eSTIMATION VIA SPATIAL ReGReSSION wITh PDe PeNALIzATION , 2014 .

[10]  Daniel J. Arrigo,et al.  An Introduction to Partial Differential Equations , 2017, An Introduction to Partial Differential Equations.

[11]  Holger Kantz,et al.  FITTING PARTIAL DIFFERENTIAL EQUATIONS TO SPACE-TIME DYNAMICS , 1999 .

[12]  Christoph W. Ueberhuber Numerical computation : methods, software, and analysis , 1997 .

[13]  Jiguo Cao,et al.  Parameter estimation for differential equations: a generalized smoothing approach , 2007 .

[14]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[15]  Karen Messer,et al.  A Comparison of a Spline Estimate to its Equivalent Kernel Estimate , 1991 .

[16]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[17]  Hulin Wu,et al.  Parameter Estimation for Differential Equation Models Using a Framework of Measurement Error in Regression Models , 2008, Journal of the American Statistical Association.

[18]  Jalil Rashidinia,et al.  Non-polynomial cubic spline methods for the solution of parabolic equations , 2008, Int. J. Comput. Math..

[19]  Yingjie Liu,et al.  IDENT: Identifying Differential Equations with Numerical Time Evolution , 2019, Journal of Scientific Computing.

[20]  Steven L. Brunton,et al.  Inferring Biological Networks by Sparse Identification of Nonlinear Dynamics , 2016, IEEE Transactions on Molecular, Biological and Multi-Scale Communications.

[21]  Di Wang,et al.  Spatiotemporal Thermal Field Modeling Using Partial Differential Equations With Time-Varying Parameters , 2020, IEEE Transactions on Automation Science and Engineering.

[22]  Hulin Wu,et al.  Numerical Discretization‐Based Estimation Methods for Ordinary Differential Equation Models via Penalized Spline Smoothing with Applications in Biomedical Research , 2012, Biometrics.

[23]  Andreas Winkelbauer,et al.  Moments and Absolute Moments of the Normal Distribution , 2012, ArXiv.

[24]  Trevor Hastie,et al.  Statistical Learning with Sparsity: The Lasso and Generalizations , 2015 .

[25]  P. Tseng Convergence of a Block Coordinate Descent Method for Nondifferentiable Minimization , 2001 .

[26]  Hulin Wu,et al.  Differential Equation Modeling of HIV Viral Fitness Experiments: Model Identification, Model Selection, and Multimodel Inference , 2009, Biometrics.

[27]  J. L. Walsh,et al.  The theory of splines and their applications , 1969 .

[28]  H. Schaeffer,et al.  Learning partial differential equations via data discovery and sparse optimization , 2017, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[29]  Giang Tran,et al.  Exact Recovery of Chaotic Systems from Highly Corrupted Data , 2016, Multiscale Model. Simul..

[30]  B. Silverman,et al.  Weak and strong uniform consistency of kernel regression estimates , 1982 .

[31]  S. G. Rubin,et al.  A cubic spline approximation for problems in fluid mechanics , 1975 .

[32]  B. Silverman,et al.  Weak and Strong Uniform Consistency of the Kernel Estimate of a Density and its Derivatives , 1978 .

[33]  Parlitz,et al.  Prediction of spatiotemporal time series based on reconstructed local states , 2000, Physical review letters.

[34]  김정민,et al.  Cubic Spline Interpolation을 이용한 얼굴 영상의 단순화 , 2010 .

[35]  G. Tusnády,et al.  A remark on the approximation of the sample df in the multidimensional case , 1977 .

[36]  James O. Ramsay,et al.  Principal differential analysis : Data reduction by differential operators , 1996 .

[37]  S. Osher,et al.  Sparse dynamics for partial differential equations , 2012, Proceedings of the National Academy of Sciences.

[38]  Jianqing Fan,et al.  Local Polynomial Regression: Optimal Kernels and Asymptotic Minimax Efficiency , 1997 .

[39]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[40]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[41]  Amir Beck,et al.  On the Convergence of Block Coordinate Descent Type Methods , 2013, SIAM J. Optim..

[42]  Bengt Fornberg,et al.  Numerical Differentiation of Analytic Functions , 1981, TOMS.