Kernel-Based Random Vector Functional-Link Network for Fast Learning of Spatiotemporal Dynamic Processes

Distributed parameter systems widely exist in many industrial thermal processes. Estimation of their temperature distribution in the entire operating area is not easy as the dynamics are time/space coupled, and there are only a few sensors available for measurement. In this paper, an effective spatiotemporal model is proposed for prediction of the temperature distribution. After the dominant spatial basis functions are obtained by the Karhunen–Loève method under the time/space separation, a kernel-based random vector functional-link network is developed for learning unknown temporal dynamics. After time/space synthesis, the spatiotemporal model can be constructed to effectively estimate the temperature distribution in high learning speed. The generalization performance of this model is discussed using Rademacher complexity. Simulations on two typical industrial thermal processes show that the proposed method has superior model performance than neural networks and least square support vector machine.

[1]  Yoh-Han Pao,et al.  The ensemble approach to neural-network learning and generalization , 1999, IEEE Trans. Neural Networks.

[2]  Wei Zou,et al.  An adaptive modeling method for time-varying distributed parameter processes with curing process applications , 2015 .

[3]  Mehryar Mohri,et al.  New Generalization Bounds for Learning Kernels , 2009, ArXiv.

[4]  Stephen A. Billings,et al.  Identification of finite dimensional models of infinite dimensional dynamical systems , 2002, Autom..

[5]  Stephen A. Billings,et al.  State-Space Reconstruction and Spatio-Temporal Prediction of Lattice Dynamical Systems , 2007, IEEE Transactions on Automatic Control.

[6]  Derong Liu,et al.  Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems , 2016, IEEE Transactions on Cybernetics.

[7]  Chenkun Qi,et al.  Modeling of distributed parameter systems for applications—A synthesized review from time–space separation , 2010 .

[8]  C. L. Philip Chen,et al.  A rapid learning and dynamic stepwise updating algorithm for flat neural networks and the application to time-series prediction , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[9]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[10]  Huai-Ning Wu,et al.  $H_\infty $ Disturbance Attenuation for Nonlinear Coupled Parabolic PDE–ODE Systems via Fuzzy-Model-Based Control Approach , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[11]  Derong Liu,et al.  Finite-Approximation-Error-Based Discrete-Time Iterative Adaptive Dynamic Programming , 2014, IEEE Transactions on Cybernetics.

[12]  Shaoyuan Li,et al.  Time/Space-Separation-Based SVM Modeling for Nonlinear Distributed Parameter Processes , 2011 .

[13]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[14]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[15]  Shaoyuan Li,et al.  Embedded Interval Type-2 T-S Fuzzy Time/Space Separation Modeling Approach for Nonlinear Distributed Parameter System , 2011 .

[16]  Haralambos Sarimveis,et al.  Nonlinear model predictive control for distributed parameter systems using data driven artificial neural network models , 2008, Comput. Chem. Eng..

[17]  Ghazal Montaseri,et al.  Predictive control of uncertain nonlinear parabolic PDE systems using a Galerkin/neural-network-based model , 2012 .

[18]  Qinglai Wei,et al.  Data-Driven Zero-Sum Neuro-Optimal Control for a Class of Continuous-Time Unknown Nonlinear Systems With Disturbance Using ADP , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Jie Shen,et al.  Spectral Methods: Algorithms, Analysis and Applications , 2011 .

[20]  Chenkun Qi,et al.  A LS-SVM modeling approach for nonlinear distributed parameter processes , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[21]  Xin Chen,et al.  Deep Learning-Based Model Reduction for Distributed Parameter Systems , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[22]  Sondipon Adhikari,et al.  Distributed parameter model updating using the Karhunen–Loève expansion , 2010 .

[23]  Han-Xiong Li,et al.  Real-Time Estimation of Temperature Distribution for Cylindrical Lithium-Ion Batteries Under Boundary Cooling , 2017, IEEE Transactions on Industrial Electronics.

[24]  Belinda B. King,et al.  Proper orthogonal decomposition for reduced basis feedback controllers for parabolic equations , 2001 .

[25]  Yoh-Han Pao,et al.  Visualization and self-organization of multidimensional data through equalized orthogonal mapping , 2000, IEEE Trans. Neural Networks Learn. Syst..

[26]  Wu Jigang,et al.  Pinning Control for Synchronization of Coupled Reaction-Diffusion Neural Networks With Directed Topologies , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Derong Liu,et al.  Infinite Horizon Self-Learning Optimal Control of Nonaffine Discrete-Time Nonlinear Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Ambuj Tewari,et al.  On the Complexity of Linear Prediction: Risk Bounds, Margin Bounds, and Regularization , 2008, NIPS.

[29]  Derong Liu,et al.  Generalized Policy Iteration Adaptive Dynamic Programming for Discrete-Time Nonlinear Systems , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[30]  Chenkun Qi,et al.  A time/space separation-based Hammerstein modeling approach for nonlinear distributed parameter processes , 2009, Comput. Chem. Eng..

[31]  Rubens Sampaio,et al.  Proper Orthogonal Decomposition for Model Reduction of a Vibroimpact System , 2012 .

[32]  Chenkun Qi,et al.  A spatio-temporal Volterra modeling approach for a class of distributed industrial processes , 2009 .

[33]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.