Constructing Multiple Kernel Learning Framework for Blast Furnace Automation

This paper constructs the framework of the reproducing kernel Hilbert space for multiple kernel learning, which provides clear insights into the reason that multiple kernel support vector machines (SVM) outperform single kernel SVM. These results can serve as a fundamental guide to account for the superiority of multiple kernel to single kernel learning. Subsequently, the constructed multiple kernel learning algorithms are applied to model a nonlinear blast furnace system only based on its input-output signals. The experimental results not only confirm the superiority of multiple kernel learning algorithms, but also indicate that multiple kernel SVM is a kind of highly competitive data-driven modeling method for the blast furnace system and can provide reliable indication for blast furnace operators to take control actions.

[1]  Jieping Ye,et al.  Multi-class Discriminant Kernel Learning via Convex Programming , 2008, J. Mach. Learn. Res..

[2]  Gunnar Rätsch,et al.  Large Scale Multiple Kernel Learning , 2006, J. Mach. Learn. Res..

[3]  Chuanhou Gao,et al.  Application of Least Squares Support Vector Machines to Predict the Silicon Content in Blast Furnace Hot Metal , 2008 .

[4]  Francis R. Bach,et al.  Consistency of the group Lasso and multiple kernel learning , 2007, J. Mach. Learn. Res..

[5]  Tatsuro Ariyama,et al.  Recent Progress and Future Perspective on Mathematical Modeling of Blast Furnace , 2010 .

[6]  Frank Pettersson,et al.  Nonlinear Modeling Method Applied to Prediction of Hot Metal Silicon in the Ironmaking Blast Furnace , 2011 .

[7]  Michael I. Jordan,et al.  Multiple kernel learning, conic duality, and the SMO algorithm , 2004, ICML.

[8]  P. Warren,et al.  Development and implementation of a generic blast-furnace expert system , 2001 .

[9]  Saburou Saitoh,et al.  Theory of Reproducing Kernels and Its Applications , 1988 .

[10]  Bart Baesens,et al.  Decompositional Rule Extraction from Support Vector Machines by Active Learning , 2009, IEEE Transactions on Knowledge and Data Engineering.

[11]  Nello Cristianini,et al.  Learning the Kernel Matrix with Semidefinite Programming , 2002, J. Mach. Learn. Res..

[12]  Kristin P. Bennett,et al.  MARK: a boosting algorithm for heterogeneous kernel models , 2002, KDD.

[13]  F. Obeso,et al.  Hot metal temperature prediction in blast furnace using advanced model based on fuzzy logic tools , 2007 .

[14]  Jian Chen,et al.  A predictive system for blast furnaces by integrating a neural network with qualitative analysis , 2001 .

[15]  Chuanhou Gao,et al.  Modeling of the Thermal State Change of Blast Furnace Hearth With Support Vector Machines , 2012, IEEE Transactions on Industrial Electronics.

[16]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[17]  Zenglin Xu,et al.  An Extended Level Method for Efficient Multiple Kernel Learning , 2008, NIPS.

[18]  Nirupam Chakraborti,et al.  Analysing blast furnace data using evolutionary neural network and multiobjective genetic algorithms , 2010 .

[19]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[20]  Saibal Ganguly,et al.  A reduced order thermo-chemical model for blast furnace for real time simulation , 2007, Comput. Chem. Eng..

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Ling Jian,et al.  A Sliding‐window Smooth Support Vector Regression Model for Nonlinear Blast Furnace System , 2011 .

[23]  Johan A. K. Suykens,et al.  L2-norm multiple kernel learning and its application to biomedical data fusion , 2010, BMC Bioinformatics.

[24]  Chuanhou Gao,et al.  Identification of multiscale nature and multiple dynamics of the blast furnace system from operating data , 2011 .

[25]  F. Pettersson,et al.  Evolving Nonlinear Time-Series Models of the Hot Metal Silicon Content in the Blast Furnace , 2007 .

[26]  T. Bhattacharya.  Prediction of Silicon Content in Blast Furnace Hot Metal Using Partial Least Squares (PLS) , 2005 .

[27]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[28]  Ivor W. Tsang,et al.  Efficient hyperkernel learning using second-order cone programming , 2004, IEEE Transactions on Neural Networks.

[29]  W. Chen,et al.  Prediction and control for silicon content in pig iron of blast furnace by integrating artificial neural network with genetic algorithm , 2010 .

[30]  Chuanhou Gao,et al.  Design of a multiple kernel learning algorithm for LS-SVM by convex programming , 2011, Neural Networks.

[31]  Jhing-Fa Wang,et al.  Robust Environmental Sound Recognition for Home Automation , 2008, IEEE Transactions on Automation Science and Engineering.

[32]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[33]  Hiroshi Nogami,et al.  Multi-dimensional transient mathematical simulator of blast furnace process based on multi-fluid and kinetic theories , 2005, Comput. Chem. Eng..

[34]  Yiqiang Chen,et al.  Building Sparse Multiple-Kernel SVM Classifiers , 2009, IEEE Transactions on Neural Networks.

[35]  Frank Pettersson,et al.  Nonlinear Prediction of the Hot Metal Silicon Content in the Blast Furnace , 2007 .

[36]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[37]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[38]  Kok-Meng Lee,et al.  Effects of Classification Methods on Color-Based Feature Detection With Food Processing Applications , 2007, IEEE Transactions on Automation Science and Engineering.

[39]  Alain Rakotomamonjy,et al.  Variable Selection Using SVM-based Criteria , 2003, J. Mach. Learn. Res..

[40]  Jiming Chen,et al.  A chaos‐based iterated multistep predictor for blast furnace ironmaking process , 2009 .

[41]  Alexander J. Smola,et al.  Learning the Kernel with Hyperkernels , 2005, J. Mach. Learn. Res..

[42]  Zhao Lu,et al.  Linear Programming SVM-ARMA $_{\rm 2K}$ With Application in Engine System Identification , 2011, IEEE Transactions on Automation Science and Engineering.

[43]  Knud D. Andersen,et al.  The Mosek Interior Point Optimizer for Linear Programming: An Implementation of the Homogeneous Algorithm , 2000 .