An enhanced extreme learning machine with a double parallel structure and its application to modeling complex chemical processes

Extreme learning machine (ELM) with a hidden layer has been successfully applied in many fields. In order to enhance the generalization performance of ELM, an enhanced ELM with a double parallel structure (DP-ELM) was proposed. In the proposed DP-ELM, a special connection between the input nodes and the output nodes was built. With the connection between the hidden nodes and output nodes, the output nodes of DP-ELM can receive the information from hidden nodes. With the special connection, the self-information from inputs can be directly passed to the output nodes. To verify the performance of the proposed DP-ELM, simulations are carried out using 5 regression datasets, including two process modeling applications. Simulation results show that, compared with ELM, the proposed DP-ELM could achieve higher accuracy better stable ability.

[1]  Qunxiong Zhu,et al.  A hierarchical structure of extreme learning machine (HELM) for high-dimensional datasets with noise , 2014, Neurocomputing.

[2]  Yuan Lan,et al.  Random search enhancement of error minimized extreme learning machine , 2010, ESANN.

[3]  Yan-Lin He,et al.  Soft-sensing model development using PLSR-based dynamic extreme learning machine with an enhanced hidden layer , 2016 .

[4]  Yan-Lin He,et al.  Data driven soft sensor development for complex chemical processes using extreme learning machine , 2015 .

[5]  Amaury Lendasse,et al.  OP-ELM: Optimally Pruned Extreme Learning Machine , 2010, IEEE Transactions on Neural Networks.

[6]  Wei Wu,et al.  Double parallel feedforward neural network based on extreme learning machine with L1/2 regularizer , 2014, Neurocomputing.

[7]  Wenting Li,et al.  Double Parallel Extreme Learning Machine , 2011 .

[8]  Qunxiong Zhu,et al.  Positive and negative correlation input attributes oriented subnets based double parallel extreme learning machine (PNIAOS-DPELM) and its application to monitoring chemical processes in steady state , 2015, Neurocomputing.

[9]  Mingyi He,et al.  Feature selection using Double Parallel Feedforward Neural Networks and Particle Swarm Optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[10]  Yan-Lin He,et al.  A robust hybrid model integrating enhanced inputs based extreme learning machine with PLSR (PLSR-EIELM) and its application to intelligent measurement. , 2015, ISA transactions.

[11]  Mingyi He,et al.  Feature Selection for Hyperspectral Data Classification Using Double Parallel Feedforward Neural Networks , 2005, FSKD.

[12]  Qunxiong Zhu,et al.  A data-attribute-space-oriented double parallel (DASODP) structure for enhancing extreme learning machine: Applications to regression datasets , 2015, Eng. Appl. Artif. Intell..

[13]  Terrence L. Fine,et al.  Feedforward Neural Network Methodology , 1999, Information Science and Statistics.

[14]  Robert K. L. Gay,et al.  Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning , 2009, IEEE Transactions on Neural Networks.

[15]  Yan-Lin He,et al.  A Monte Carlo and PSO based virtual sample generation method for enhancing the energy prediction and energy optimization on small data problem: An empirical study of petrochemical industries , 2017 .

[16]  Yan-Lin He,et al.  Soft sensor development for the key variables of complex chemical processes using a novel robust bagging nonlinear model integrating improved extreme learning machine with partial least square , 2016 .

[17]  Guang-Bin Huang,et al.  Learning capability and storage capacity of two-hidden-layer feedforward networks , 2003, IEEE Trans. Neural Networks.

[18]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[19]  Narasimhan Sundararajan,et al.  Online Sequential Fuzzy Extreme Learning Machine for Function Approximation and Classification Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).