A semi-supervised Laplacian extreme learning machine and feature fusion with CNN for industrial superheat identification

Abstract The superheat degree (SD) in industrial aluminum electrolysis cell is a critical index that can maintain the energy balance, improve the current efficiency and improve production. However, the existing SD identification is mainly relying on artificial experience and the accuracy of SD is far from satisfactory. Further, artificial costs and physical equipment are expensive and time-consuming. In this paper, we propose a deep soft sensor method for SD detection. First, CNN is utilized for flame hole image feature extraction. Second, a semi-supervised extreme learning machine (ELM) that integrates Laplacian regularization is further used for SD classification. The main contributions of the paper are: (1) The proposed CNN-LapsELM utilizes the CNN for flame hole image feature extraction and then ELM for further classification, which fully takes advantage of CNN’s ability for complex feature extraction, ELM’s excellent generalization ability, and high computation efficiency. (2) Both the labeled and unlabeled samples are utilized for the CNN-LapsELM training process. It fully leverages the information contained in unlabeled data. At the same time, Laplacian regularization is utilized for learning the manifold structure of hole image samples, so the performance of the proposed CNN-LapsELM are improved. (3) The proposed CNN-LapsELM algorithm improves the generalization ability and robustness. The comparison result demonstrates that the CNN-LapsELM is superior to the existing SD identification and the accuracy is 87%.

[1]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[2]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[3]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[4]  Qinghua Zheng,et al.  Regularized Extreme Learning Machine , 2009, 2009 IEEE Symposium on Computational Intelligence and Data Mining.

[5]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[6]  Chen Xiaofang,et al.  Identification of superheat of aluminum electrolytic cell based on computer vision and expert rule , 2017, 2017 Chinese Automation Congress (CAC).

[7]  Hui Xue,et al.  Semi-supervised classification learning by discrimination-aware manifold regularization , 2015, Neurocomputing.

[8]  Xingquan Zhu,et al.  Cross-Domain Semi-Supervised Learning Using Feature Formulation , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[10]  Qingshan She,et al.  Safe Semi-Supervised Extreme Learning Machine for EEG Signal Classification , 2018, IEEE Access.

[11]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[12]  Weihua Gui,et al.  Semantic Network Based on Intuitionistic Fuzzy Directed Hyper-Graphs and Application to Aluminum Electrolysis Cell Condition Identification , 2017, IEEE Access.

[13]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Quan Z. Sheng,et al.  Nonrigid Point Set Registration With Robust Transformation Learning Under Manifold Regularization , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[15]  Punyaphol Horata,et al.  Robust extreme learning machine , 2013, Neurocomputing.

[16]  Li Ma,et al.  Manifold Regularized Distribution Adaptation for Classification of Remote Sensing Images , 2018, IEEE Access.

[17]  Ge Yu,et al.  Breast tumor detection in digital mammography based on extreme learning machine , 2014, Neurocomputing.

[18]  Fang Liu,et al.  Bayesian convolutional neural network based MRI brain extraction on nonhuman primates , 2018, NeuroImage.

[19]  Yiqiang Chen,et al.  ASELM: Adaptive semi-supervised ELM with application in question subjectivity identification , 2016, Neurocomputing.

[20]  Xin Du,et al.  Distributed Semi-Supervised Metric Learning , 2016, IEEE Access.

[21]  Paul T. Sheeba,et al.  Hybrid features-enabled dragon deep belief neural network for activity recognition , 2018, The Imaging Science Journal.

[22]  Cong Wang,et al.  Kernel Semi-supervised Extreme Learning Machine Applied in Urban Traffic Congestion Evaluation , 2016, CDVE.

[23]  Zhiqiang Ge,et al.  Deep Learning of Semisupervised Process Data With Hierarchical Extreme Learning Machine and Soft Sensor Application , 2018, IEEE Transactions on Industrial Electronics.

[24]  Martin Vetterli,et al.  Adaptive wavelet thresholding for image denoising and compression , 2000, IEEE Trans. Image Process..

[25]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[26]  Yu-Dong Yao,et al.  Breast Cancer Detection Using Extreme Learning Machine Based on Feature Fusion With CNN Deep Features , 2019, IEEE Access.

[27]  Jayson Tessier,et al.  Towards On‐Line Monitoring of Alumina Properties at a Pot Level , 2012 .

[28]  Hwa Jen Yap,et al.  A Truly Online Learning Algorithm using Hybrid Fuzzy ARTMAP and Online Extreme Learning Machine for Pattern Classification , 2015, Neural Processing Letters.

[29]  Weihua Gui,et al.  A knowledge reasoning Fuzzy-Bayesian network for root cause analysis of abnormal aluminum electrolysis cell condition , 2017, Frontiers of Chemical Science and Engineering.