A novel extreme learning Machine-based Hammerstein-Wiener model for complex nonlinear industrial processes

Abstract In this paper, a novel extreme learning machine (ELM) based Hammerstein-Wiener model is developed for the approximation of complex nonlinear systems. The proposed model has two static ELM networks surround a dynamic linear part. Estimation of this model can be summarized into the following three aspects: The first one is to approximate the static nonlinear elements of Hammerstein-Wiener model with two independent ELM networks, which are single-hidden layer feedforward network (SLFN) essentially. The second one is to estimate the structure of linear part of the proposed model using lipschitz quotient criterion with respect to the measurements. The final one is to determine the parameters of the two SLFNs and the linear block using ELM algorithm. To evaluate the generalization performance, Rademacher complexity will be used to give the generalization bound of the proposed model with theoretical proof. The proposed model can track and handle the strong nonlinearity and time-varying dynamics over the whole operating domain for its inherent two nonlinear structure. Furthermore, with ELM algorithms, the proposed model can achieve fast learning speed and less computation complexity. Simulations on two typical industrial thermal processes demonstrate the accuracy and efficiency of the researched model.

[1]  G. P. Gualtieri,et al.  A modified Volterra series approach for nonlinear dynamic systems modeling , 2002 .

[2]  Vladimir Koltchinskii,et al.  Rademacher Complexities and Bounding the Excess Risk in Active Learning , 2010, J. Mach. Learn. Res..

[3]  Narasimhan Sundararajan,et al.  Online Sequential Fuzzy Extreme Learning Machine for Function Approximation and Classification Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[5]  Oliver Nelles,et al.  Nonlinear internal model control based on local linear neural networks , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[6]  Nan Zhang,et al.  Twin support vector machine: theory, algorithm and applications , 2017, Neural Computing and Applications.

[7]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[8]  Maciej Ławryńczuk,et al.  Modelling and predictive control of a neutralisation reactor using sparse support vector machine Wiener models , 2016 .

[9]  H. Toivonen,et al.  Support vector method for identification of Wiener models , 2009 .

[10]  Guangyi Cao,et al.  Identification of the Hammerstein model of a PEMFC stack based on least squares support vector machines , 2008 .

[11]  Dan Zhang,et al.  Robust Fuzzy-Model-Based Filtering for Nonlinear Cyber-Physical Systems With Multiple Stochastic Incomplete Measurements , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Yucai Zhu,et al.  Estimation of an N-L-N Hammerstein-Wiener model , 2002, Autom..

[13]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Peter L. Bartlett,et al.  Rademacher and Gaussian Complexities: Risk Bounds and Structural Results , 2003, J. Mach. Learn. Res..

[15]  Xiangdong He,et al.  A New Method for Identifying Orders of Input-Output Models for Nonlinear Dynamic Systems , 1993, 1993 American Control Conference.

[16]  Eric Rogers,et al.  Recursive identification of Hammerstein systems with application to electrically stimulated muscle , 2012 .

[17]  Shaoyuan Li,et al.  Hammerstein Modeling with Structure Identification for Multi-input Multi-output Nonlinear Industrial Processes , 2011 .

[18]  Johan Schoukens,et al.  Initializing Wiener-Hammerstein models based on partitioning of the best linear approximation , 2012, Autom..

[19]  Er-Wei Bai An optimal two-stage identification algorithm for Hammerstein-Wiener nonlinear systems , 1998, Autom..

[20]  Paramasivan Saratchandran,et al.  Sequential Adaptive Fuzzy Inference System (SAFIS) for nonlinear system identification and prediction , 2006, Fuzzy Sets Syst..

[21]  Senjian An,et al.  Fast cross-validation algorithms for least squares support vector machine and kernel ridge regression , 2007, Pattern Recognit..

[22]  Keum-Shik Hong,et al.  Maximum likelihood identification of Wiener–Hammerstein models , 2013 .

[23]  Lennart Ljung,et al.  Identification of Hammerstein-Wiener models , 2013, Autom..

[24]  Guang-Bin Huang,et al.  FUZZY EXTREME LEARNING MACHINE FOR A CLASS OF FUZZY INFERENCE SYSTEMS , 2013 .

[25]  Rui Zhang,et al.  Sparse least square support vector machine via coupled compressive pruning , 2014, Neurocomputing.

[26]  Yu Nan,et al.  Hierarchical multi-class classification in multimodal spacecraft data using DNN and weighted support vector machine , 2017, Neurocomputing.

[27]  Jeen-Shing Wang,et al.  A fully automated recurrent neural network for unknown dynamic system identification and control , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[28]  Fouad Giri,et al.  Wiener–Hammerstein system identification – an evolutionary approach , 2016, Int. J. Syst. Sci..

[29]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[30]  Yang Chunhua,et al.  Identification of Hammerstein-Wiener Model with Least Squares Support Vector Machine , 2006, 2007 Chinese Control Conference.

[31]  Hai-Dong Yang,et al.  Dual least squares support vector machines based spatiotemporal modeling for nonlinear distributed thermal processes , 2017 .

[32]  Xinping Guan,et al.  Identification of nonlinear system using extreme learning machine based Hammerstein model , 2014, Commun. Nonlinear Sci. Numer. Simul..

[33]  Johan A. K. Suykens,et al.  Least-Squares Support Vector Machines for the Identification of Wiener-Hammerstein Systems , 2012 .

[34]  V. Filipovic Outlier robust stochastic approximation algorithm for identification of MIMO Hammerstein models , 2017 .