Robust Regularized Random Vector Functional Link Network and Its Industrial Application

Production quality indices of complex industrial processes are usually hard to be measured in real time, which leads to unavailability of closed-loop operational optimization and control. Therefore, data-driven modeling techniques have been extensively employed to estimate production quality indices online. However, the conventional data-driven modeling methods often fail to achieve good performance because of interference from outliers. To solve the above-mentioned problem, this paper proposes an improved random vector functional link network (RVFLN) using a novel training method, which adopts a ridge regularized model with weighted factor for each training sample to evaluate the output weights. The robustness of the model has been achieved by employing a nonparametric kernel density estimation method to assign the weighted factors according to the training sample. To ensure the quality and computational load of the network in online applications, various online learning versions are presented according to the scope of data sampling. The improved RVFLN called robust regularized RVFLN has been validated using UCI, Statlib standard data sets, and an industrial grinding operation data. Results show that our proposed modeling technique perform favorably, and demonstrate its good potential for real world applications.

[1]  Tianyou Chai,et al.  Multivariable dynamic modeling for molten iron quality using online sequential random vector functional-link networks with self-feedback connections , 2015, Inf. Sci..

[2]  Robert P. W. Duin,et al.  Feedforward neural networks with random weights , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[3]  Dianhui Wang,et al.  Stochastic Configuration Networks: Fundamentals and Algorithms , 2017, IEEE Transactions on Cybernetics.

[4]  Ponnuthurai N. Suganthan,et al.  Random vector functional link network for short-term electricity load demand forecasting , 2016, Inf. Sci..

[5]  Yu-Lin He,et al.  Fuzzy nonlinear regression analysis using a random weight network , 2016, Inf. Sci..

[6]  Feilong Cao,et al.  Sparse algorithms of Random Weight Networks and applications , 2014, Expert Syst. Appl..

[7]  Dirk Husmeier,et al.  Neural Networks for Predicting Conditional Probability Densities: Improved Training Scheme Combining EM and RVFL , 1998, Neural Networks.

[8]  Tianyou Chai Optimal Operational Control for Complex Industrial Processes , 2012 .

[9]  Tianyou Chai,et al.  Data-Driven Optimization Control for Safety Operation of Hematite Grinding Process , 2015, IEEE Transactions on Industrial Electronics.

[10]  Ming Li,et al.  Insights into randomized algorithms for neural networks: Practical issues and common pitfalls , 2017, Inf. Sci..

[11]  P. Hansen Rank-Deficient and Discrete Ill-Posed Problems: Numerical Aspects of Linear Inversion , 1987 .

[12]  D. W. Scott,et al.  Multivariate Density Estimation, Theory, Practice and Visualization , 1992 .

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  A. E. Hoerl,et al.  Ridge Regression: Applications to Nonorthogonal Problems , 1970 .

[15]  Qiang Liu,et al.  Particle size estimate of grinding processes using random vector functional link networks with improved robustness , 2015, Neurocomputing.

[16]  Yalin Wang,et al.  Wet grindability of an industrial ore and its breakage parameters estimation using population balances , 2011 .

[17]  Dejan J. Sobajic,et al.  Learning and generalization characteristics of the random vector Functional-link net , 1994, Neurocomputing.

[18]  Tianyou Chai,et al.  Data-Driven Soft-Sensor Modeling for Product Quality Estimation Using Case-Based Reasoning and Fuzzy-Similarity Rough Sets , 2014, IEEE Transactions on Automation Science and Engineering.

[19]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[20]  Chris Aldrich,et al.  Online monitoring and control of froth flotation systems with machine vision: A review , 2010 .

[21]  Dianhui Wang,et al.  Randomness in neural networks: an overview , 2017, WIREs Data Mining Knowl. Discov..

[22]  Yonggwan Won,et al.  Regularized online sequential learning algorithm for single-hidden layer feedforward neural networks , 2011, Pattern Recognit. Lett..

[23]  Dianhui Wang,et al.  Bayesian Random Vector Functional-Link Networks for Robust Data Modeling , 2018, IEEE Transactions on Cybernetics.

[24]  Peter L. Bartlett,et al.  The Sample Complexity of Pattern Classification with Neural Networks: The Size of the Weights is More Important than the Size of the Network , 1998, IEEE Trans. Inf. Theory.

[25]  Yoh-Han Pao,et al.  Stochastic choice of basis functions in adaptive function approximation and the functional-link net , 1995, IEEE Trans. Neural Networks.

[26]  Ming Li,et al.  Robust stochastic configuration networks with kernel density estimation for uncertain data regression , 2017, Inf. Sci..

[27]  Y. Takefuji,et al.  Functional-link net computing: theory, system architecture, and functionalities , 1992, Computer.

[28]  Dianhui Wang,et al.  A probabilistic learning algorithm for robust modeling using neural networks with random weights , 2015, Inf. Sci..

[29]  Tianyou Chai,et al.  Multivariable Disturbance Observer Based Advanced Feedback Control Design and Its Application to a Grinding Circuit , 2014, IEEE Transactions on Control Systems Technology.

[30]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .