Temporal-Logic-Based Semantic Fault Diagnosis With Time-Series Data From Industrial Internet of Things

The maturity of sensor network technologies has facilitated the emergence of an Industrial Internet of Things (IIoT), which has collected an increasing volume of data. Converting these data into actionable intelligence for fault diagnosis is key to, e.g., reducing unscheduled downtime and performance degradation. This paper formalizes a problem called semantic fault diagnosis–to construct the formal specifications of faults directly from data collected from IIoT-enabled systems. The specifications are written as signal temporal logic formulas, which can be easily interpreted by humans. To tackle the issue of the combinatorial explosion which arises, we propose an algorithm that combines ideas from agenda-based searching and imitation learning to train a policy that searches formulas in a strategic order. Specifically, we formulate the problem as a Markov decision process, which is further solved with a reinforcement learning algorithm. Our algorithm is applied to time series data collected from an IIoT-enabled iron-making factory. The results show empirically that our proposed algorithm is both scalable to the size of the data set and interpretable, therefore allowing human users to take actions for, e.g., predictive maintenance.

[1]  Peter G. Neumann,et al.  The future of the internet of things , 2017, Commun. ACM.

[2]  Christian Brecher,et al.  Industrial Internet of Things and Cyber Manufacturing Systems , 2017 .

[3]  Maryam Farajzadeh-Zanjani,et al.  A Semi-Supervised Diagnostic Framework Based on the Surface Estimation of Faulty Distributions , 2019, IEEE Transactions on Industrial Informatics.

[4]  Ezio Bartocci,et al.  Temporal Logic Based Monitoring of Assisted Ventilation in Intensive Care Patients , 2014, ISoLA.

[5]  Jianwei Yang,et al.  Feature Trend Extraction and Adaptive Density Peaks Search for Intelligent Fault Diagnosis of Machines , 2019, IEEE Transactions on Industrial Informatics.

[6]  Daniel Neider,et al.  Learning Linear Temporal Properties , 2018, 2018 Formal Methods in Computer Aided Design (FMCAD).

[7]  Shahin Hedayati Kia,et al.  Information Fusion and Semi-Supervised Deep Learning Scheme for Diagnosing Gear Faults in Induction Machine Systems , 2019, IEEE Transactions on Industrial Electronics.

[8]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[9]  Bo Zhou,et al.  Process monitoring of iron-making process in a blast furnace with PCA-based methods , 2016 .

[10]  Dogan Ulus,et al.  First-order temporal logic monitoring with BDDs , 2017, Formal Methods in System Design.

[11]  Yang Xin,et al.  Research on a knowledge modelling methodology for fault diagnosis of machine tools based on formal semantics , 2017, Adv. Eng. Informatics.

[12]  Miguel Angel Ferrer-Ballester,et al.  Review of Automatic Fault Diagnosis Systems Using Audio and Vibration Signals , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[13]  Jonathan Berant,et al.  Imitation Learning of Agenda-based Semantic Parsers , 2015, TACL.

[14]  Shiyan Hu,et al.  Design Automation of Cyber-Physical Systems: Challenges, Advances, and Opportunities , 2017, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[15]  Ezio Bartocci,et al.  Data-Driven Statistical Learning of Temporal Logic Properties , 2014, FORMATS.

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  Ezio Bartocci,et al.  A Robust Genetic Algorithm for Learning Temporal Specifications from Data , 2018, QEST.

[18]  Calin Belta,et al.  Temporal Logics for Learning and Detection of Anomalous Behavior , 2017, IEEE Transactions on Automatic Control.

[19]  Sanjit A. Seshia,et al.  Logical Clustering and Learning for Time-Series Data , 2016, 1612.07823.

[20]  Zhiwei Gao,et al.  A Novel Fault Detection with Minimizing the Noise-Signal Ratio Using Reinforcement Learning , 2018, Sensors.

[21]  Calin Belta,et al.  A Decision Tree Approach to Data Classification using Signal Temporal Logic , 2016, HSCC.

[22]  Alexandre Donzé,et al.  On Signal Temporal Logic , 2013, RV.

[23]  Marco Montali,et al.  Monitoring Business Constraints with Linear Temporal Logic: An Approach Based on Colored Automata , 2011, BPM.

[24]  Reid G. Simmons,et al.  Complexity Analysis of Real-Time Reinforcement Learning , 1993, AAAI.

[25]  Sanjit A. Seshia,et al.  Mining Requirements From Closed-Loop Control Models , 2015, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[26]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[27]  Song-Chun Zhu,et al.  Attributed Grammars for Joint Estimation of Human Attributes, Part and Pose , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Valérie Issarny,et al.  Unified IoT ontology to enable interoperability and federation of testbeds , 2016, 2016 IEEE 3rd World Forum on Internet of Things (WF-IoT).

[29]  David A. Basin,et al.  Almost Event-Rate Independent Monitoring of Metric Temporal Logic , 2017, TACAS.

[30]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.