GraphEL: A Graph-Based Ensemble Learning Method for Distributed Diagnostics and Prognostics in the Industrial Internet of Things

Ensemble learning (EL)methods have been shown to be effective for diagnostics and prognostics in industrial systems. By combining the learning ability of different base learners, EL has the potential to reduce the total complexity of the learning system while solving a difficult problem satisfactorily. Recent advantages in Industrial Internet of Things (IIoT)and edge computing technologies have started a new paradigm of distributed diagnostics and prognostics. However, existing EL methods that mainly focus on a centralized setting cannot adapt to the edge computing scenario, which significantly constrains the application of these EL methods in real industrial environments. In this paper, we present a new approach to EL called Graph-based Ensemble Learning (GraphEL)to enable distributed diagnostics and prognostics in real industrial environments. Comparing with existing methods, the proposed GraphEL framework builds different base learners for different subsystems. Furthermore, a graphical model is constructed to define the correlation structures among the outputs of different base learners in the ensemble such that they can be collaboratively trained to optimize the learning performance of the ensemble. Via simple message passing, the proposed GraphEL framework can be executed in a fully distributed manner which is suitable for edge computing. The performance of the proposed GraphEL framework is evaluated using two real-world industrial data sets where we demonstrate the advantages of GraphEL compared to existing EL methods. Index Terms-Industrial Internet of Things (IIoT), smart manufacturing, diagnostics and prognostics, distributed ensemble learning.

[1]  Robert E. Schapire,et al.  The strength of weak learnability , 1990, Mach. Learn..

[2]  Silvio Simani,et al.  Identification and fault diagnosis of a simulated model of an industrial gas turbine , 2005, IEEE Transactions on Industrial Informatics.

[3]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[4]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[5]  Pedro Antonio Gutiérrez,et al.  Negative Correlation Ensemble Learning for Ordinal Regression , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[7]  Frank L. Lewis,et al.  Intelligent Diagnosis and Prognosis of Tool Wear Using Dominant Feature Identification , 2009, IEEE Transactions on Industrial Informatics.

[8]  Tao Zhang,et al.  Fog and IoT: An Overview of Research Opportunities , 2016, IEEE Internet of Things Journal.

[9]  Shengli Wu,et al.  Effective Neural Network Ensemble Approach for Improving Generalization Performance , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Sudip Misra,et al.  Assessment of the Suitability of Fog Computing in the Context of Internet of Things , 2018, IEEE Transactions on Cloud Computing.

[11]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Huanhuan Chen,et al.  Multiobjective Neural Network Ensembles Based on Regularized Negative Correlation Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Mehul Motani,et al.  Finding Decomposable Models for Efficient Distributed Inference over Sensor Networks , 2019, IEEE Transactions on Mobile Computing.

[14]  Andreas Seitz,et al.  The Conjunction of Fog Computing and the Industrial Internet of Things - An Applied Approach , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[15]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[16]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[17]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[19]  Soundar Kumara,et al.  Machinery Fault Diagnosis and Prognosis: Application of Advanced Signal Processing Techniques , 1999 .

[20]  Gian Antonio Susto,et al.  Machine Learning for Predictive Maintenance: A Multiple Classifier Approach , 2015, IEEE Transactions on Industrial Informatics.

[21]  Jiafu Wan,et al.  Toward Dynamic Resources Management for IoT-Based Manufacturing , 2018, IEEE Communications Magazine.

[22]  Chen-Khong Tham,et al.  Information-Driven Distributed Sensing for Efficient Bayesian Inference in Internet of Things Systems , 2018, 2018 15th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[23]  Tao Liu,et al.  Identification and Autotuning of Temperature-Control System With Application to Injection Molding , 2009, IEEE Transactions on Control Systems Technology.

[24]  Xiang Li,et al.  A Physically Segmented Hidden Markov Model Approach for Continuous Tool Condition Monitoring: Diagnostics and Prognostics , 2012, IEEE Transactions on Industrial Informatics.

[25]  Yang Liu,et al.  A SNCCDBAGG-Based NN Ensemble Approach for Quality Prediction in Injection Molding Process , 2011, IEEE Transactions on Automation Science and Engineering.

[26]  Nikola K. Kasabov,et al.  Fast neural network ensemble learning via negative-correlation data correction , 2005, IEEE Transactions on Neural Networks.

[27]  Tung-Kuan Liu,et al.  Solving Distributed and Flexible Job-Shop Scheduling Problems for a Real-World Fastener Manufacturer , 2014, IEEE Access.

[28]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.