Tackling Faults in the Industry 4.0 Era—A Survey of Machine-Learning Solutions and Key Aspects

The recent advancements in the fields of artificial intelligence (AI) and machine learning (ML) have affected several research fields, leading to improvements that could not have been possible with conventional optimization techniques. Among the sectors where AI/ML enables a plethora of opportunities, industrial manufacturing can expect significant gains from the increased process automation. At the same time, the introduction of the Industrial Internet of Things (IIoT), providing improved wireless connectivity for real-time manufacturing data collection and processing, has resulted in the culmination of the fourth industrial revolution, also known as Industry 4.0. In this survey, we focus on the vital processes of fault detection, prediction and prevention in Industry 4.0 and present recent developments in ML-based solutions. We start by examining various proposed cloud/fog/edge architectures, highlighting their importance for acquiring manufacturing data in order to train the ML algorithms. In addition, as faults might also occur from sources beyond machine degradation, the potential of ML in safeguarding cyber-security is thoroughly discussed. Moreover, a major concern in the Industry 4.0 ecosystem is the role of human operators and workers. Towards this end, a detailed overview of ML-based human–machine interaction techniques is provided, allowing humans to be in-the-loop of the manufacturing processes in a symbiotic manner with minimal errors. Finally, open issues in these relevant fields are given, stimulating further research.

[1]  Peigen Li,et al.  Toward New-Generation Intelligent Manufacturing , 2018 .

[2]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[3]  James Moyne,et al.  Big Data Analytics for Smart Manufacturing: Case Studies in Semiconductor Manufacturing , 2017 .

[4]  Namhun Kim,et al.  Analytical Modeling of Human Choice Complexity in a Mixed Model Assembly Line Using Machine Learning-Based Human in the Loop Simulation , 2017, IEEE Access.

[5]  Sung-Hoon Ahn,et al.  Smart Machining Process Using Machine Learning: A Review and Perspective on Machining Industry , 2018, International Journal of Precision Engineering and Manufacturing-Green Technology.

[6]  Nada Golmie,et al.  A Survey on Industrial Internet of Things: A Cyber-Physical Systems Perspective , 2018, IEEE Access.

[7]  Jiankun Hu,et al.  A New Threat Intelligence Scheme for Safeguarding Industry 4.0 Systems , 2018, IEEE Access.

[8]  Fangming Ye,et al.  Board-Level Functional Fault Diagnosis Using Artificial Neural Networks, Support-Vector Machines, and Weighted-Majority Voting , 2013, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[9]  Prem Prakash Jayaraman,et al.  The Role of Big Data Analytics in Industrial Internet of Things , 2019, Future Gener. Comput. Syst..

[10]  Jong-Myon Kim,et al.  A Hybrid Feature Model and Deep-Learning-Based Bearing Fault Diagnosis , 2017, Sensors.

[11]  Seong-Taek Park,et al.  A study on smart factory-based ambient intelligence context-aware intrusion detection system using machine learning , 2018, J. Ambient Intell. Humaniz. Comput..

[12]  James Hensman,et al.  Natural computing for mechanical systems research: A tutorial overview , 2011 .

[13]  Der-Jiunn Deng,et al.  Concept Drift Detection and Adaption in Big Imbalance Industrial IoT Data Using an Ensemble Learning Method of Offline Classifiers , 2019, IEEE Access.

[14]  Weihai Chen,et al.  Industrial IoT in 5G environment towards smart manufacturing , 2018, J. Ind. Inf. Integr..

[15]  Jiafu Wan,et al.  Artificial Intelligence for Cloud-Assisted Smart Factory , 2018, IEEE Access.

[16]  Zhiqiang Ge,et al.  Data Mining and Analytics in the Process Industry: The Role of Machine Learning , 2017, IEEE Access.

[17]  Feng Jia,et al.  An Intelligent Fault Diagnosis Method Using Unsupervised Feature Learning Towards Mechanical Big Data , 2016, IEEE Transactions on Industrial Electronics.

[18]  Stamatis Karnouskos,et al.  Stuxnet worm impact on industrial cyber-physical system security , 2011, IECON 2011 - 37th Annual Conference of the IEEE Industrial Electronics Society.

[19]  E. F. Vogel,et al.  A plant-wide industrial process control problem , 1993 .

[20]  Yang Lu,et al.  Industry 4.0: A survey on technologies, applications and open research issues , 2017, J. Ind. Inf. Integr..

[21]  Andrew Kusiak,et al.  Data-driven smart manufacturing , 2018, Journal of Manufacturing Systems.

[22]  Concha Bielza,et al.  Machine Learning-based CPS for Clustering High throughput Machining Cycle Conditions , 2017 .

[23]  Shi Jin,et al.  Efficient Board-Level Functional Fault Diagnosis With Missing Syndromes , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[24]  Mianxiong Dong,et al.  Deep Learning for Smart Industry: Efficient Manufacture Inspection System With Fog Computing , 2018, IEEE Transactions on Industrial Informatics.

[25]  Bin Li,et al.  Early Fault Detection of Machine Tools Based on Deep Learning and Dynamic Identification , 2019, IEEE Transactions on Industrial Electronics.

[26]  Oliver Niggemann,et al.  Big Data and Machine Learning for the Smart Factory—Solutions for Condition Monitoring, Diagnosis and Optimization , 2017 .

[27]  Xin Yao,et al.  DDD: A New Ensemble Approach for Dealing with Concept Drift , 2012, IEEE Transactions on Knowledge and Data Engineering.

[28]  Jiafu Wan,et al.  Industrial Big Data Analytics for Prediction of Remaining Useful Life Based on Deep Learning , 2018, IEEE Access.

[29]  Ali Hassan Sodhro,et al.  Artificial Intelligence-Driven Mechanism for Edge Computing-Based Industrial Applications , 2019, IEEE Transactions on Industrial Informatics.

[30]  Mahesh Sooriyabandara,et al.  The Tactile Internet for Industries: A Review , 2019, Proceedings of the IEEE.

[31]  Dazhong Wu,et al.  A fog computing-based framework for process monitoring and prognosis in cyber-manufacturing , 2017 .

[32]  G. Seliger,et al.  Opportunities of Sustainable Manufacturing in Industry 4.0 , 2016 .

[33]  Jongtae Rhee,et al.  Performance Analysis of IoT-Based Sensor, Big Data Processing, and Machine Learning Model for Real-Time Monitoring System in Automotive Manufacturing , 2018, Sensors.

[34]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[35]  Jun Wu,et al.  Machine Health Monitoring Using Adaptive Kernel Spectral Clustering and Deep Long Short-Term Memory Recurrent Neural Networks , 2019, IEEE Transactions on Industrial Informatics.

[36]  Nour Moustafa,et al.  UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set) , 2015, 2015 Military Communications and Information Systems Conference (MilCIS).

[37]  S. Nahavandi Industry 5.0—A Human-Centric Solution , 2019, Sustainability.

[38]  Gerhard P. Hancke,et al.  A Survey of Anomaly Detection in Industrial Wireless Sensor Networks with Critical Water System Infrastructure as a Case Study , 2018, Sensors.

[39]  Chun-Wei Yang,et al.  Applications of artificial intelligence in intelligent manufacturing: a review , 2017, Frontiers of Information Technology & Electronic Engineering.

[40]  Jan Reimann,et al.  The Intelligent Factory Space – A Concept for Observing, Learning and Communicating in the Digitalized Factory , 2019, IEEE Access.

[41]  Theodore B. Zahariadis,et al.  Hybrid Clouds for Data-Intensive, 5G-Enabled IoT Applications: An Overview, Key Issues and Relevant Architecture , 2019, Sensors.

[42]  Fei Tao,et al.  Data and knowledge mining with big data towards smart production , 2017, J. Ind. Inf. Integr..

[43]  Xian-Bo Wang,et al.  Representational Learning for Fault Diagnosis of Wind Turbine Equipment: A Multi-Layered Extreme Learning Machines Approach , 2016 .

[44]  Connor Jennings,et al.  A Comparative Study on Machine Learning Algorithms for Smart Manufacturing: Tool Wear Prediction Using Random Forests , 2017 .

[45]  Daniel Sonntag,et al.  Overview of the CPS for Smart Factories Project: Deep Learning, Knowledge Acquisition, Anomaly Detection and Intelligent User Interfaces , 2017 .

[46]  Gian Antonio Susto,et al.  A Predictive Maintenance System for Epitaxy Processes Based on Filtering and Prediction Techniques , 2012, IEEE Transactions on Semiconductor Manufacturing.

[47]  Paulo Leitão,et al.  IDARTS - Towards intelligent data analysis and real-time supervision for industry 4.0 , 2018, Comput. Ind..

[48]  Soundar R. T. Kumara,et al.  Cyber-physical systems in manufacturing , 2016 .

[49]  Der-Jiunn Deng,et al.  A MapReduce-Based Ensemble Learning Method with Multiple Classifier Types and Diversity for Condition-Based Maintenance with Concept Drifts , 2018, IEEE Cloud Computing.

[50]  Minyi Guo,et al.  On Traffic-Aware Partition and Aggregation in MapReduce for Big Data Applications , 2016, IEEE Transactions on Parallel and Distributed Systems.

[51]  Chang Ouk Kim,et al.  Performance of Machine Learning Algorithms for Class-Imbalanced Process Fault Detection Problems , 2016, IEEE Transactions on Semiconductor Manufacturing.

[52]  Thomas H. Morris,et al.  Machine learning for power system disturbance and cyber-attack discrimination , 2014, 2014 7th International Symposium on Resilient Control Systems (ISRCS).

[53]  Amy J. C. Trappey,et al.  A review of essential standards and patent landscapes for the Internet of Things: A key enabler for Industry 4.0 , 2017, Adv. Eng. Informatics.

[54]  Lin Li,et al.  Industrial Big Data in an Industry 4.0 Environment: Challenges, Schemes, and Applications for Predictive Maintenance , 2017, IEEE Access.

[55]  Jouni Helske,et al.  Mixture Hidden Markov Models for Sequence Data: The seqHMM Package in R , 2017, Journal of Statistical Software.

[56]  Joaquín B. Ordieres Meré,et al.  Comparison of Data Preprocessing Approaches for Applying Deep Learning to Human Activity Recognition in the Context of Industry 4.0 , 2018, Sensors.

[57]  Javier Del Ser,et al.  Data fusion and machine learning for industrial prognosis: Trends and perspectives towards Industry 4.0 , 2019, Inf. Fusion.

[58]  Lida Xu,et al.  Big data for cyber physical systems in industry 4.0: a survey , 2019, Enterp. Inf. Syst..

[59]  Ray Y. Zhong,et al.  Intelligent Manufacturing in the Context of Industry 4.0: A Review , 2017 .

[60]  Chee Khiang Pang,et al.  Classification of Imbalanced Data by Oversampling in Kernel Space of Support Vector Machines , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[61]  Biao Wang,et al.  LiftingNet: A Novel Deep Learning Network With Layerwise Feature Learning From Noisy Mechanical Data for Fault Classification , 2018, IEEE Transactions on Industrial Electronics.

[62]  Dominic T. J. O'Sullivan,et al.  A fog computing industrial cyber-physical system for embedded low-latency machine learning Industry 4.0 applications , 2018 .

[63]  Li Da Xu,et al.  Industry 4.0: state of the art and future trends , 2018, Int. J. Prod. Res..

[64]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[65]  Pedro Ferreira,et al.  A Symbiotic Human–Machine Learning Approach for Production Ramp-up , 2018, IEEE Transactions on Human-Machine Systems.

[66]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[67]  Tharam S. Dillon,et al.  A Global Manufacturing Big Data Ecosystem for Fault Detection in Predictive Maintenance , 2020, IEEE Transactions on Industrial Informatics.

[68]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[69]  Michail Maniatakos,et al.  Machine learning-based defense against process-aware attacks on Industrial Control Systems , 2016, 2016 IEEE International Test Conference (ITC).

[70]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[71]  Johannes Winter,et al.  Hardware-security technologies for industrial IoT: TrustZone and security controller , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[72]  Peng Li,et al.  Artificial intelligence/machine learning in manufacturing and inspection: A GE perspective , 2019, MRS Bulletin.

[73]  Qingsong Hua,et al.  Industrial Big Data Analysis in Smart Factory: Current Status and Research Strategies , 2017, IEEE Access.

[74]  Ercan Öztemel,et al.  Literature review of Industry 4.0 and related technologies , 2018, J. Intell. Manuf..

[75]  Young B. Moon,et al.  Detecting cyber-physical attacks in CyberManufacturing systems with machine learning methods , 2017, Journal of Intelligent Manufacturing.

[76]  Lei Shu,et al.  Smart Factory of Industry 4.0: Key Technologies, Application Case, and Challenges , 2018, IEEE Access.

[77]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[78]  János Abonyi,et al.  Enabling Technologies for Operator 4.0: A Survey , 2018, Applied Sciences.

[79]  Vagan Y. Terziyan,et al.  Patented intelligence: Cloning human decision models for Industry 4.0 , 2018, Journal of Manufacturing Systems.

[80]  Eriko Nurvitadhi,et al.  Can FPGAs Beat GPUs in Accelerating Next-Generation Deep Neural Networks? , 2017, FPGA.

[81]  Stefan Wrobel,et al.  A review of machine learning for the optimization of production processes , 2019, The International Journal of Advanced Manufacturing Technology.

[82]  Tim Baines,et al.  Humans: the missing link in manufacturing simulation? , 2004, Simul. Model. Pract. Theory.

[83]  Don-Lin Yang,et al.  Automatic machine status prediction in the era of Industry 4.0: Case study of machines in a spring factory , 2017, J. Syst. Archit..

[84]  Shuai Yang,et al.  Spur Gear Fault Diagnosis Using a Multilayer Gated Recurrent Unit Approach With Vibration Signal , 2019, IEEE Access.

[85]  Chang-Heon Oh,et al.  SVM-Based Dynamic Reconfiguration CPS for Manufacturing System in Industry 4.0 , 2018, Wirel. Commun. Mob. Comput..

[86]  Tingting Zhang,et al.  Combining Fog Computing with Sensor Mote Machine Learning for Industrial IoT , 2018, Sensors.

[87]  A. Santanaa,et al.  Rethinking Human-Machine Learning in Industry 4 . 0 : How Does the Paradigm Shift Treat the Role of Human Learning ? , 2018 .

[88]  Mohammad Abdullah Al Faruque,et al.  Manufacturing Supply Chain and Product Lifecycle Security in the Era of Industry 4.0 , 2018, J. Hardw. Syst. Secur..

[89]  George Panoutsos,et al.  Using Multiple-Feature-Spaces-Based Deep Learning for Tool Condition Monitoring in Ultraprecision Manufacturing , 2019, IEEE Transactions on Industrial Electronics.

[90]  Geert Gins,et al.  Industrial Process Monitoring in the Big Data/Industry 4.0 Era: from Detection, to Diagnosis, to Prognosis , 2017 .

[91]  Jill Slay,et al.  Novel Geometric Area Analysis Technique for Anomaly Detection Using Trapezoidal Area Estimation on Large-Scale Networks , 2019, IEEE Transactions on Big Data.

[92]  Hyunsoo Lee,et al.  Framework and development of fault detection classification using IoT device and cloud environment , 2017 .

[93]  Ajith Abraham,et al.  Industry 4.0: A bibliometric analysis and detailed overview , 2019, Eng. Appl. Artif. Intell..

[94]  Rahat Iqbal,et al.  Fault Detection and Isolation in Industrial Processes Using Deep Learning Approaches , 2019, IEEE Transactions on Industrial Informatics.

[95]  Gian Antonio Susto,et al.  Machine Learning for Predictive Maintenance: A Multiple Classifier Approach , 2015, IEEE Transactions on Industrial Informatics.

[96]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[97]  Xinyu Li,et al.  A New Snapshot Ensemble Convolutional Neural Network for Fault Diagnosis , 2019, IEEE Access.

[98]  Sherali Zeadally,et al.  Deploying Fog Computing in Industrial Internet of Things and Industry 4.0 , 2018, IEEE Transactions on Industrial Informatics.

[99]  Ying Liu,et al.  A categorical framework of manufacturing for industry 4.0 and beyond , 2016 .

[100]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.