Forecasting the power consumption of a rotor spinning machine by using an adaptive squeeze and excitation convolutional neural network with imbalanced data

Abstract Forecasting the specific power consumption is crucial for cleaner production and energy saving in yarn manufacturing. A power consumption forecast can provide indicators for process parameter optimization to improve energy efficiency. In industrial scenarios, the current methods always fail to accurately forecast the abnormal values that are crucial for the prevention of unnecessary energy consumption, since the imbalanced data (the normal and abnormal power consumption sample sizes are different) misleads prediction models. Aiming to tackle the problem of imbalanced data, the root cause of abnormal power consumption is analysed to obtain the potential influencing factors of reactive power consumption in the rotor spinning process. To rebalance the prediction model, an adaptive squeeze and excitation convolutional neural network (adaptive SE-CNN) is proposed with a dual-input network architecture to discriminatively address the factors that affect the reactive power consumption (RPC) and active power consumption (APC). Then, a unilateral squeeze and excitation block is designed to automatically learn the discriminative features. It squeezes the feature information into a channel descriptor and reweights the channel feature responses with an adaptive RPC-sensitive learning rate during the training process. The experimental results based on real-world data show that the proposed approach achieves the highest prediction accuracy of 92.6252%, which indicates that 1,0331.74 k W ⋅ h of electrical energy can be saved for a rotor spinning machine over one month in the investigated workshop.

[1]  Abdulsalam Yassine,et al.  Big Data Mining of Energy Time Series for Behavioral Analytics and Energy Consumption Forecasting , 2018 .

[2]  M. Thirugnanasambandam,et al.  Specific Energy Consumption and Co2 Emission Reduction Analysis in a Textile Industry , 2015 .

[3]  I. Hernández-Pérez,et al.  Assessment of Resource and Forecast Modeling of Wind Speed through An Evolutionary Programming Approach for the North of Tehuantepec Isthmus (Cuauhtemotzin, Mexico) , 2018, Energies.

[4]  Luís Torgo,et al.  Resampling strategies for regression , 2015, Expert Syst. J. Knowl. Eng..

[5]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Francisco Herrera,et al.  SMOTE-RSB*: a hybrid preprocessing approach based on oversampling and undersampling for high imbalanced data-sets using SMOTE and rough sets theory , 2012, Knowledge and Information Systems.

[7]  Hui Han,et al.  Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning , 2005, ICIC.

[8]  Mohamed Bekkar,et al.  Imbalanced Data Learning Approaches Review , 2013 .

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Junliang Wang,et al.  AdaBalGAN: An Improved Generative Adversarial Network With Imbalanced Learning for Wafer Defective Pattern Recognition , 2019, IEEE Transactions on Semiconductor Manufacturing.

[11]  Nathalie Japkowicz,et al.  Boosting support vector machines for imbalanced data sets , 2008, Knowledge and Information Systems.

[12]  Guillem Quintana,et al.  Modelling Power Consumption in Ball-End Milling Operations , 2011 .

[13]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[14]  Mehmet Kitis,et al.  Sustainable textile production: cleaner production assessment/eco-efficiency analysis study in a textile mill , 2016 .

[15]  Xiaojun Zhou,et al.  Energy Consumption Forecasting for the Nonferrous Metallurgy Industry Using Hybrid Support Vector Regression with an Adaptive State Transition Algorithm , 2019, Cognitive Computation.

[16]  Hakki Ozgur Unver,et al.  Energy efficiency of machining operations: A review , 2017 .

[17]  Luís Torgo,et al.  Precision and Recall for Regression , 2009, Discovery Science.

[18]  Erdem Koç,et al.  An Investigation on Energy Consumption in Yarn Production with Special Reference to Ring Spinning , 2007 .

[19]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[20]  Xungai Wang,et al.  Minimizing Energy Consumption of Yarn Winding in Ring Spinning , 2004 .

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  O. May Tzuc,et al.  Estimation of the operating temperature of photovoltaic modules using artificial intelligence techniques and global sensitivity analysis: A comparative approach , 2018 .

[23]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[24]  Yuebin Guo,et al.  Energy consumption in machining: Classification, prediction, and reduction strategy , 2017 .

[25]  Jing Li,et al.  Energy consumption model and energy efficiency of machine tools: a comprehensive literature review , 2016 .

[26]  Erry Yulian Triblas Adesta,et al.  Energy cost modeling for high speed hard turning , 2011 .

[27]  Jun Xie,et al.  A method for predicting the energy consumption of the main driving system of a machine tool in a machining process , 2015 .

[28]  Levent Eren,et al.  Bearing Fault Detection by One-Dimensional Convolutional Neural Networks , 2017 .

[29]  Xue-wen Chen,et al.  FAST: a roc-based feature selection metric for small samples and imbalanced data classification problems , 2008, KDD.

[30]  Junliang Wang,et al.  Fog-IBDIS: Industrial Big Data Integration and Sharing with Fog Computing for Manufacturing Systems , 2019, Engineering.

[31]  Zhi-Hua Zhou,et al.  The Influence of Class Imbalance on Cost-Sensitive Learning: An Empirical Study , 2006, Sixth International Conference on Data Mining (ICDM'06).

[32]  Hao Tang,et al.  An operation-mode based simulation approach to enhance the energy conservation of machine tools , 2015 .

[33]  Chang Ouk Kim,et al.  A Convolutional Neural Network for Fault Classification and Diagnosis in Semiconductor Manufacturing Processes , 2017, IEEE Transactions on Semiconductor Manufacturing.

[34]  Wei Cai,et al.  An energy-consumption model for establishing energy-consumption allowance of a workpiece in a machining system , 2016 .

[35]  M. Dolores del Castillo,et al.  A multistrategy approach for digital text categorization from imbalanced documents , 2004, SKDD.

[36]  Lin Li,et al.  Energy requirements evaluation of milling machines based on thermal equilibrium and empirical modelling , 2013 .

[37]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[38]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Yong Zhang,et al.  Imbalanced data classification based on scaling kernel-based support vector machine , 2014, Neural Computing and Applications.

[40]  Yacine Rezgui,et al.  Predictive modelling for solar thermal energy systems: A comparison of support vector regression, random forest, extra trees and regression trees , 2018, Journal of Cleaner Production.

[41]  B. Dong,et al.  Applying support vector machines to predict building energy consumption in tropical region , 2005 .

[42]  Haibo He,et al.  ADASYN: Adaptive synthetic sampling approach for imbalanced learning , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[43]  Lihui Wang,et al.  Imbalanced data fault diagnosis of rotating machinery using synthetic oversampling and feature learning , 2018, Journal of Manufacturing Systems.

[44]  Y. El Hamzaoui,et al.  Multivariate optimization of Pb(II) removal for clinoptilolite-rich tuffs using genetic programming: A computational approach , 2018, Chemometrics and Intelligent Laboratory Systems.

[45]  Junliang Wang,et al.  A collaborative architecture of the industrial internet platform for manufacturing systems , 2020, Robotics Comput. Integr. Manuf..

[46]  S. Palamutcu,et al.  Electric energy consumption in the cotton textile processing stages , 2010 .

[47]  Rohini K. Srihari,et al.  Feature selection for text categorization on imbalanced data , 2004, SKDD.

[48]  T. S. Wu,et al.  Prediction of CNC Machine Tool Cutting Energy Consumption by BP Neural Network , 2015 .

[49]  Yingfeng Zhang,et al.  A big data driven analytical framework for energy-intensive manufacturing industries , 2018, Journal of Cleaner Production.

[50]  Erdem Koç,et al.  Investigation of Energy Consumption in Yarn Production with Special Reference to Open-End Rotor Spinning , 2010 .

[51]  Chumphol Bunkhumpornpat,et al.  Safe-Level-SMOTE: Safe-Level-Synthetic Minority Over-Sampling TEchnique for Handling the Class Imbalanced Problem , 2009, PAKDD.

[52]  Dazhe Zhao,et al.  A PSO-Based Cost-Sensitive Neural Network for Imbalanced Data Classification , 2013, PAKDD Workshops.

[53]  Mark Goadrich,et al.  The relationship between Precision-Recall and ROC curves , 2006, ICML.

[54]  Daniel L. Marino,et al.  Deep neural networks for energy load forecasting , 2017, 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE).