Selective ensemble simulate metamodeling approach based on latent features extraction and kernel learning

Simulate metamodeling technique based on complex physical model is one of the key methods to improve simulation effectiveness and assist decision maker to cognize behavior of complex system. There are strong collinearity among input variables of the simulate metamodel. Moreover, number of the training samples is also limited. Popularly used back propagation neural network (BPNN) model suffers from lower learning speed and over-fitting problems. Although random vector functional-link (RVFL) networks have faster learning speed, its prediction performance stability isn't satisfied for modeling little sample data. Thus, a new selective ensemble simulates meta-modeling approach based on latent features extraction and kernel learning is proposed. Partial least square (PLS) is used to extract the latent features from original input variables, which can eliminate collinearity among inputs and simplify structure of the simulate metamodel. Kernel based RVFL (KRVFL) networks, selective ensemble learning and global optimization viewpoint based modeling parameters selection algorithms are used to improve prediction accuracy and satiability of the simulate metamodel. Simulate results show that the proposed approach is effective.

[1]  Bogdan Gabrys,et al.  Data-driven Soft Sensors in the process industry , 2009, Comput. Chem. Eng..

[2]  Robert W. Blanning,et al.  The construction and implementation of metamodels , 1975 .

[3]  Application of Partial Least Squares Support Vector Machines (PLS-SVM) in Spectroscopy Quantitative Analysis , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[4]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[5]  Ian T. Jolliffe,et al.  Principal Component Analysis , 2002, International Encyclopedia of Statistical Science.

[6]  J. Friedman Exploratory Projection Pursuit , 1987 .

[7]  Paul K. Davis,et al.  Preface , 2021 .

[8]  I. Jolliffe Principal Component Analysis , 2002 .

[9]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[11]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[12]  L. Cooper,et al.  When Networks Disagree: Ensemble Methods for Hybrid Neural Networks , 1992 .

[13]  H. PaoY.,et al.  Functional-link net computing , 1992 .

[14]  Russell R. Barton,et al.  Simulation metamodels , 1998, 1998 Winter Simulation Conference. Proceedings (Cat. No.98CH36274).