A Spatiotemporal Neural Network Modeling Method for Nonlinear Distributed Parameter Systems

Neural network (NN) has been widely used in the field of modeling of lumped parameter systems. However, an NN approach cannot be used to model complex nonlinear distributed parameter systems (DPSs) because it does not account for this type of system's relationship with space. In this article, we propose a novel spatiotemporal NN (SNN) method to model nonlinear DPSs, which considers not only nonlinear dynamics regarding time, but also a nonlinear relationship with space. A temporal NN model was first constructed to represent the nonlinear temporal dynamics of each sensor's position. A spatial distribution function was then developed to represent the nonlinear relationship between spatial points. This strategy results in inherent consideration of any spatial dynamics. Finally, by integrating both the temporal NN model and the spatial distribution function, a novel SNN model was created to represent the spatiotemporal dynamics of the nonlinear DPSs. A two-step solving approach was further developed to learn the model. Additional analysis and proof of concept showed the effectiveness of this proposed method. This proposed method is different from traditional data-driven modeling methods in that it uses full information from all sensors and does not require model reduction technology. Case studies not only demonstrate the effectiveness of this proposed method, but also its superior modeling performance as compared with several commonly used methods.

[1]  Yi Zhang,et al.  Construction of Confidence Intervals for Distributed Parameter Processes Under Noise , 2018, IEEE Access.

[2]  Panagiotis D. Christofides,et al.  Output feedback control of parabolic PDE systems with nonlinear spatial differential operators , 1999 .

[3]  Takanori Kochiyama,et al.  Spatiotemporal neural network dynamics for the processing of dynamic facial expressions , 2015, Scientific Reports.

[4]  Muhammad R. Hajj,et al.  Global nonlinear distributed-parameter model of parametrically excited piezoelectric energy harvesters , 2012 .

[5]  Chang Liu,et al.  Online Spatiotemporal Extreme Learning Machine for Complex Time-Varying Distributed Parameter Systems , 2017, IEEE Transactions on Industrial Informatics.

[6]  Shaoyuan Li,et al.  Embedded Interval Type-2 T-S Fuzzy Time/Space Separation Modeling Approach for Nonlinear Distributed Parameter System , 2011 .

[7]  Minghui Huang,et al.  A Novel Spatiotemporal LS-SVM Method for Complex Distributed Parameter Systems With Applications to Curing Thermal Process , 2016, IEEE Transactions on Industrial Informatics.

[8]  XinJiang Lu,et al.  A Novel Spatiotemporal Fuzzy Method for Modeling of Complex Distributed Parameter Processes , 2019, IEEE Transactions on Industrial Electronics.

[9]  Chenkun Qi,et al.  Nonlinear dimension reduction based neural modeling for distributed parameter processes , 2009 .

[10]  Yinlai Jiang,et al.  Knowledge Acquisition Method Based on Singular Value Decomposition for Human Motion Analysis , 2014, IEEE Transactions on Knowledge and Data Engineering.

[11]  Han-Xiong Li,et al.  A Galerkin/Neural-Network-Based Design of Guaranteed Cost Control for Nonlinear Distributed Parameter Systems , 2008, IEEE Transactions on Neural Networks.

[12]  Pau-Choo Chung,et al.  A spatiotemporal neural network for recognizing partially occluded objects , 1998, IEEE Trans. Signal Process..

[13]  Chenkun Qi,et al.  Modeling of distributed parameter systems for applications—A synthesized review from time–space separation , 2010 .

[14]  Thomas Gustafsson,et al.  Application of reduced models for robust control and state estimation of a distributed parameter system , 2009 .

[15]  H. Park,et al.  The use of the Karhunen-Loève decomposition for the modeling of distributed parameter systems , 1996 .

[16]  Han-Xiong Li,et al.  Local-Properties-Embedding-Based Nonlinear Spatiotemporal Modeling for Lithium-Ion Battery Thermal Process , 2018, IEEE Transactions on Industrial Electronics.

[17]  Fadhel M. Ghannouchi,et al.  Distributed Spatiotemporal Neural Network for Nonlinear Dynamic Transmitter Modeling and Adaptive Digital Predistortion , 2012, IEEE Transactions on Instrumentation and Measurement.

[18]  Hao Zhang,et al.  Distributed $H_{\infty}$ Filtering for Switched Repeated Scalar Nonlinear Systems With Randomly Occurred Sensor Nonlinearities and Asynchronous Switching , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[19]  Stephen A. Billings,et al.  Identification of finite dimensional models of infinite dimensional dynamical systems , 2002, Autom..

[20]  Shuqiang Wang,et al.  Dominant-Modes-Based Sliding-Mode Observer for Estimation of Temperature Distribution in Rapid Thermal Processing System , 2019, IEEE Transactions on Industrial Informatics.

[21]  Shuzhi Sam Ge,et al.  Adaptive Control of a Flexible Crane System With the Boundary Output Constraint , 2014, IEEE Transactions on Industrial Electronics.

[22]  Han-Xiong Li,et al.  Dynamic switching based fuzzy control strategy for a class of distributed parameter system , 2014 .

[23]  Shaoyuan Li,et al.  A fuzzy-based spatio-temporal multi-modeling for nonlinear distributed parameter processes , 2014, Appl. Soft Comput..

[24]  Stephen Duncan,et al.  Control of temperature profile for a spray deposition process , 2003, IEEE Trans. Control. Syst. Technol..

[25]  Fuwen Yang,et al.  Event-Triggered Asynchronous Guaranteed Cost Control for Markov Jump Discrete-Time Neural Networks With Distributed Delay and Channel Fading , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Stephen A. Billings,et al.  State-Space Reconstruction and Spatio-Temporal Prediction of Lattice Dynamical Systems , 2007, IEEE Transactions on Automatic Control.

[27]  Fuwen Yang,et al.  Event-Based Distributed $H_{\infty }$ Filtering Networks of 2-DOF Quarter-Car Suspension Systems , 2016, IEEE Transactions on Industrial Informatics.

[28]  Dan Givoli,et al.  Towards automating the finite element method: a test-bed for soft computing , 2003, Appl. Soft Comput..

[29]  Huaicheng Yan,et al.  Hybrid neural network predictor for distributed parameter system based on nonlinear dimension reduction , 2016, Neurocomputing.

[30]  Jie Shen,et al.  Spectral Methods: Algorithms, Analysis and Applications , 2011 .

[31]  Changyin Sun,et al.  Iterative Learning Control for a Flapping Wing Micro Aerial Vehicle Under Distributed Disturbances , 2019, IEEE Transactions on Cybernetics.

[32]  M. Haeri,et al.  Robust model predictive control of nonlinear processes represented by Wiener or Hammerstein models , 2015 .

[33]  Han-Xiong Li,et al.  ISOMAP-Based Spatiotemporal Modeling for Lithium-Ion Battery Thermal Process , 2018, IEEE Transactions on Industrial Informatics.

[34]  Mengling Wang,et al.  Spatiotemporal prediction for nonlinear parabolic distributed parameter system using an artificial neural network trained by group search optimization , 2013, Neurocomputing.

[35]  Karlene A. Hoo,et al.  System identification and model-based control for distributed parameter systems , 2004, Comput. Chem. Eng..