A Systematic Mapping of the Advancing Use of Machine Learning Techniques for Predictive Maintenance in the Manufacturing Sector

The increasing availability of data, gathered by sensors and intelligent machines, is changing the way decisions are made in the manufacturing sector. In particular, based on predictive approach and facilitated by the nowadays growing capabilities of hardware, cloud-based solutions, and new learning approaches, maintenance can be scheduled—over cell engagement and resource monitoring—when required, for minimizing (or managing) unexpected equipment failures, improving uptime through less aggressive maintenance schedules, shortening unplanned downtime, reducing excess (direct and indirect) cost, reducing long-term damage to machines and processes, and improve safety plans. With access to increased levels of data (and over learning mechanisms), companies have the capability to conduct statistical tests using machine learning algorithms, in order to uncover root causes of problems previously unknown. This study analyses the maturity level and contributions of machine learning methods for predictive maintenance. An upward trend in publications for predictive maintenance using machine learning techniques was identified with the USA and China leading. A mapping study—steady set until early 2019 data—was employed as a formal and well-structured method to synthesize material and to report on pervasive areas of research. Type of equipment, sensors, and data are mapped to properly assist new researchers in positioning new research activities in the domain of smart maintenance. Hence, in this paper, we focus on data-driven methods for predictive maintenance (PdM) with a comprehensive survey on applications and methods until, for the sake of commenting on stable proposal, 2019 (early included). An equal repartition between evaluation and validation studies was identified, this being a symptom of an immature but growing research area. In addition, the type of contribution is mainly in the form of models and methodologies. Vibrational signal was marked as the most used data set for diagnosis in manufacturing machinery monitoring; furthermore, supervised learning is reported as the most used predictive approach (ensemble learning is growing fast). Neural networks, followed by random forests and support vector machines, were identified as the most applied methods encompassing 40% of publications, of which 67% related to deep neural network with long short-term memory predominance. Notwithstanding, there is no robust approach (no one reported optimal performance over different case tests) that works best for every problem. We finally conclude the research in this area is moving fast to gather a separate focused analysis over the last two years (whenever stable implementations will appear).

[1]  Dirk Werth,et al.  Predictive Quality: Towards a New Understanding of Quality Assurance Using Machine Learning Tools , 2018, BIS.

[2]  Christoph M. Flath,et al.  Towards a data science toolbox for industrial analytics applications , 2018, Comput. Ind..

[3]  Andrei Tolstikov,et al.  Machine Learning Approaches for Failure Type Detection and Predictive Maintenance , 2015 .

[4]  Kai Petersen,et al.  Guidelines for conducting systematic mapping studies in software engineering: An update , 2015, Inf. Softw. Technol..

[5]  Ravi Shankar,et al.  A big data driven sustainable manufacturing framework for condition-based maintenance prediction , 2017, J. Comput. Sci..

[6]  Kai Petersen,et al.  Systematic Mapping Studies in Software Engineering , 2008, EASE.

[7]  Gian Antonio Susto,et al.  Machine Learning for Predictive Maintenance: A Multiple Classifier Approach , 2015, IEEE Transactions on Industrial Informatics.

[8]  Praveen R. Rao,et al.  Predictive Maintenance for Supermarket Refrigeration Systems Using Only Case Temperature Data , 2018, 2018 Annual American Control Conference (ACC).

[9]  Lei Ren,et al.  Bearing remaining useful life prediction based on deep autoencoder and deep neural networks , 2018, Journal of Manufacturing Systems.

[10]  Xiang Li,et al.  Deep learning-based cross-sensor domain adaptation for fault diagnosis of electro-mechanical actuators , 2020 .

[11]  P. Groumpos Deep Learning vs. Wise Learning: A Critical and Challenging Overview , 2016 .

[12]  Zenghui Wang,et al.  An Effective Predictive Maintenance Framework for Conveyor Motors Using Dual Time-Series Imaging and Convolutional Neural Network in an Industry 4.0 Environment , 2020, IEEE Access.

[13]  Jay Lee,et al.  Service Innovation and Smart Analytics for Industry 4.0 and Big Data Environment , 2014 .

[14]  Jay Lee,et al.  Industrial Artificial Intelligence for industry 4.0-based manufacturing systems , 2018, Manufacturing Letters.

[15]  M. Feki,et al.  Biochemical and clinical profiles of 52 Tunisian patients affected by Zellweger syndrome. , 2017, Pediatrics and neonatology.

[16]  Ji Xia,et al.  A Data Driven Model for Predicting Tool Health Condition in High Speed Milling of Titanium Plates Using Real-Time SCADA , 2017 .

[17]  Pantjawarni Prihatini,et al.  Feature extraction for document text using Latent Dirichlet Allocation , 2018 .

[18]  Peng Jiang,et al.  Unsupervised Deep Learning for Data-Driven Reliability and Risk Analysis of Engineered Systems , 2017 .

[19]  Alberto Regattieri,et al.  On the use of machine learning methods to predict component reliability from data-driven industrial case studies , 2017, The International Journal of Advanced Manufacturing Technology.

[20]  Goran D. Putnik,et al.  Scalability in manufacturing systems design and operation: State-of-the-art and future developments roadmap , 2013 .

[21]  Radu Stefan Niculescu,et al.  Predictive maintenance applications for machine learning , 2017, 2017 Annual Reliability and Maintainability Symposium (RAMS).

[22]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[23]  MengChu Zhou,et al.  A Supervised Learning and Control Method to Improve Particle Swarm Optimization Algorithms , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Stephen D. J. McArthur,et al.  Machine Learning Model for Event-Based Prognostics in Gas Circulator Condition Monitoring , 2017, IEEE Transactions on Reliability.

[25]  Subutai Ahmad,et al.  Unsupervised real-time anomaly detection for streaming data , 2017, Neurocomputing.

[26]  Kai Sun,et al.  Predictive Maintenance of Power Substation Equipment by Infrared Thermography Using a Machine-Learning Approach , 2017 .

[27]  Peng Wang,et al.  Long short-term memory for machine remaining life prediction , 2018, Journal of Manufacturing Systems.

[28]  Jong-Myon Kim,et al.  A Hybrid Prognostics Technique for Rolling Element Bearings Using Adaptive Predictive Models , 2018, IEEE Transactions on Industrial Electronics.

[29]  Klaus-Dieter Thoben,et al.  Machine learning in manufacturing: advantages, challenges, and applications , 2016 .

[30]  Matteo Terzi,et al.  Anomaly Detection Approaches for Semiconductor Manufacturing , 2017 .

[31]  Luís C. Oliveira-Lopes,et al.  Fault Detection and Diagnosis Using Support Vector Machines - A SVC and SVR Comparison , 2014 .

[32]  Hau-Wei Lee,et al.  A Review of Artificial Intelligence Algorithms Used for Smart Machine Tools , 2018, Inventions.

[33]  Hongchao Wang,et al.  Data-Driven Methods for Predictive Maintenance of Industrial Equipment: A Survey , 2019, IEEE Systems Journal.

[34]  Sangje Cho,et al.  A Hybrid Machine Learning Approach for Predictive Maintenance in Smart Factories of the Future , 2018, APMS.

[35]  Chiara Franciosi,et al.  Multi-stakeholder perspectives on indicators for sustainable maintenance performance in production contexts: an exploratory study , 2020, Journal of Quality in Maintenance Engineering.

[36]  Manu Kohli,et al.  Using Machine Learning Algorithms on data residing in SAP ERP Application to predict equipment failures , 2018 .

[37]  Pedro M. B. Torres,et al.  Industrial IoT Devices and Cyber-Physical Production Systems: Review and Use Case , 2018 .

[38]  P. Koprinkova-Hristova,et al.  Reinforcement Learning for Predictive Maintenance of Industrial Plants , 2013 .

[39]  Mehdi Bagheri,et al.  Transformer Fault Condition Prognosis Using Vibration Signals Over Cloud Environment , 2018, IEEE Access.

[40]  Petter Kyösti,et al.  Machine learning for detection of anomalies in press-hardening: Selection of efficient methods , 2018 .

[41]  Jorge Luis Victória Barbosa,et al.  Machine learning and reasoning for predictive maintenance in Industry 4.0: Current status and challenges , 2020, Comput. Ind..

[42]  Hamid Reza Shaker,et al.  Predictive Maintenance for Pump Systems and Thermal Power Plants: State-of-the-Art Review, Trends and Challenges , 2020, Sensors.

[43]  Concha Bielza,et al.  Machine Learning-based CPS for Clustering High throughput Machining Cycle Conditions , 2017 .

[44]  Rodrigo da Rosa Righi,et al.  Predictive maintenance in the Industry 4.0: A systematic literature review , 2020, Comput. Ind. Eng..

[45]  Feng Zhu,et al.  Adaptive virtual metrology method based on Just-in-time reference and particle filter for semiconductor manufacturing , 2021 .

[46]  Sathyan Munirathinam Feed Forward Backpropagation Neural Network Model to Predict Remaining Useful Life Estimation of Ion Implant Tool , 2015 .

[47]  José-Raúl Ruiz-Sarmiento,et al.  A predictive model for the maintenance of industrial machinery in the context of industry 4.0 , 2020, Eng. Appl. Artif. Intell..

[48]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[49]  Riccardo Satta,et al.  A dissimilarity-based approach to predictive maintenance with application to HVAC systems , 2017, ArXiv.

[50]  Thyago P. Carvalho,et al.  A systematic literature review of machine learning methods applied to predictive maintenance , 2019, Comput. Ind. Eng..

[51]  Eric Li,et al.  Prediction of pipe performance with stacking ensemble learning based approaches , 2018, J. Intell. Fuzzy Syst..

[52]  Stefan Bosse Structural Monitoring with Distributed-Regional and Event-based NN-Decision Tree Learning Using Mobile Multi-Agent Systems and Common Java Script Platforms , 2016 .

[53]  P. O'Donovan,et al.  Big data in manufacturing: a systematic mapping study , 2015, Journal of Big Data.

[54]  Rixin Wang,et al.  A new intelligent fault identification method based on transfer locality preserving projection for actual diagnosis scenario of rotating machinery , 2020 .

[55]  Erwin Rauch,et al.  A Review of Further Directions for Artificial Intelligence, Machine Learning, and Deep Learning in Smart Logistics , 2020, Sustainability.

[56]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[57]  Bereket Tanju,et al.  A Machine Learning Decision-Support System Improves the Internet of Things’ Smart Meter Operations , 2017, IEEE Internet of Things Journal.

[58]  Xuejiao Li Remaining Useful Life Prediction of Bearings Using Fuzzy Multimodal Extreme Learning Regression , 2017, 2017 International Conference on Sensing, Diagnostics, Prognostics, and Control (SDPC).

[59]  Chiara Franciosi,et al.  Maintenance for Sustainability in the Industry 4.0 context: a Scoping Literature Review , 2018 .

[60]  Yeong-gwang Oh,et al.  Adaptive SVM-based real-time quality assessment for primer-sealer dispensing process of sunroof assembly line , 2019, Reliab. Eng. Syst. Saf..

[61]  J. Terpenny,et al.  Forecasting Obsolescence Risk and Product Life Cycle With Machine Learning , 2016, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[62]  Mianxiong Dong,et al.  Deep Learning for Smart Industry: Efficient Manufacture Inspection System With Fog Computing , 2018, IEEE Transactions on Industrial Informatics.

[63]  Claudio Geisert,et al.  Decentralized Data Analytics for Maintenance in Industrie 4.0 , 2017 .

[64]  Jay Lee,et al.  Integration of digital twin and deep learning in cyber‐physical systems: towards smart manufacturing , 2020 .

[65]  Sudarsan Rachuri,et al.  A Classification Scheme for Smart Manufacturing Systems' Performance Metrics. , 2017, Smart and sustainable manufacturing systems.

[66]  Appa Iyer Sivakumar,et al.  Reinforcement Learning Based Predictive Maintenance for a Machine with Multiple Deteriorating Yield Levels , 2014 .

[67]  Amos H. C. Ng,et al.  Towards data mining based decision support in manufacturing maintenance , 2018 .

[68]  Durán Prioritization of Physical Assets for Maintenance and Production Sustainability , 2019, Sustainability.

[69]  Supratik Mukhopadhyay,et al.  Automated diagnostics for manufacturing machinery based on well-regularized deep neural networks , 2017, Integr..

[70]  Bin Hu,et al.  A data-driven two-stage maintenance framework for degradation prediction in semiconductor manufacturing industries , 2015, Comput. Ind. Eng..

[71]  Ayon Dey,et al.  Machine Learning Algorithms : A Review , 2016 .

[72]  Chao Li,et al.  Machinery condition prediction based on wavelet and support vector machine , 2013, 2013 International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering (QR2MSE).

[73]  Mattia Zanon,et al.  An adaptive machine learning decision system for flexible predictive maintenance , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[74]  Robert X. Gao,et al.  Deep Learning for Improved System Remaining Life Prediction , 2018 .

[75]  Ronay Ak,et al.  A Survey of the Advancing Use and Development of Machine Learning in Smart Manufacturing. , 2018, Journal of manufacturing systems.

[76]  Yajie Zhang,et al.  An Unexpected Green and Facile Synthesis of 2,6‐Diaryl‐4‐styrylpyridines via Multi‐component Reactions in Microwave‐assisted Solvent‐free Conditions , 2009 .