Prognostic Model Development with Missing Labels

Condition-based maintenance (CBM) has emerged as a proactive strategy for determining the best time for maintenance activities. In this paper, a case of a milling process with imperfect maintenance at a German automotive manufacturer is considered. Its major challenge is that only data with missing labels are available, which does not provide a sufficient basis for classical prognostic maintenance models. To overcome this shortcoming, a data science study is carried out that combines several analytical methods, especially from the field of machine learning (ML). These include time-domain and time–frequency domain techniques for feature extraction, agglomerative hierarchical clustering and time series clustering for unsupervised pattern detection, as well as a recurrent neural network for prognostic model training. With the approach developed, it is possible to replace decisions that were made based on subjective criteria with data-driven decisions to increase the tool life of the milling machines. The solution can be employed beyond the presented case to similar maintenance scenarios as the basis for decision support and prognostic model development. Moreover, it helps to further close the gap between ML research and the practical implementation of CBM.

[1]  Ratna Babu Chinnam,et al.  An Autonomous Diagnostics and Prognostics Framework for Condition-Based Maintenance , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[2]  Radu Stefan Niculescu,et al.  Predictive maintenance applications for machine learning , 2017, 2017 Annual Reliability and Maintainability Symposium (RAMS).

[3]  Zhigang Tian,et al.  A neural network approach for remaining useful life prediction utilizing both failure and suspension histories , 2010 .

[4]  Shahrul Kamaruddin,et al.  An overview of time-based and condition-based maintenance in industrial application , 2012, Comput. Ind. Eng..

[5]  Ying Peng,et al.  Current status of machine prognostics in condition-based maintenance: a review , 2010 .

[6]  A. H. Christer,et al.  Towards a general condition based maintenance model for a stochastic dynamic system , 2000, J. Oper. Res. Soc..

[7]  Marcantonio Catelani,et al.  Architecture for hybrid modelling and its application to diagnosis and prognosis with missing data , 2017 .

[8]  B. S. Pabla,et al.  Condition based maintenance of machine tools—A review , 2015 .

[9]  W. Klingenberg,et al.  Typology of condition based maintenance , 2011 .

[10]  Xiang Li,et al.  Machine health condition prediction via online dynamic fuzzy neural networks , 2014, Eng. Appl. Artif. Intell..

[11]  Alaa Mohamed Riad,et al.  Prognostics: a literature review , 2016, Complex & Intelligent Systems.

[12]  Abhinav Saxena,et al.  Performance Benchmarking and Analysis of Prognostic Methods for CMAPSS Datasets , 2020, International Journal of Prognostics and Health Management.

[13]  Sirkka-Liisa Jämsä-Jounela,et al.  A process monitoring system based on the Kohonen self-organizing maps , 2003 .

[14]  E. Taşdemiroğlu Incentives for solar water heating systems , 1985 .

[15]  Manoj Kumar Tiwari,et al.  Data mining in manufacturing: a review based on the kind of knowledge , 2009, J. Intell. Manuf..

[16]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[17]  Kai Sun,et al.  Predictive Maintenance of Power Substation Equipment by Infrared Thermography Using a Machine-Learning Approach , 2017 .

[18]  Guy N. Brock,et al.  clValid , an R package for cluster validation , 2008 .

[19]  Brian Everitt,et al.  Cluster analysis , 1974 .

[20]  Noureddine Zerhouni,et al.  Strategies to Face Imbalanced and Unlabelled Data in Phm Applications , 2013 .

[21]  Ronald J. Williams,et al.  Adaptive state representation and estimation using recurrent connectionist networks , 1990 .

[22]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[23]  Peter H. A. Sneath,et al.  Numerical Taxonomy: The Principles and Practice of Numerical Classification , 1973 .

[24]  Brian A. Weiss,et al.  A review of diagnostic and prognostic capabilities and best practices for manufacturing , 2019, J. Intell. Manuf..

[25]  Noureddine Zerhouni,et al.  Review of prognostic problem in condition-based maintenance , 2009, 2009 European Control Conference (ECC).

[26]  Daming Lin,et al.  A review on machinery diagnostics and prognostics implementing condition-based maintenance , 2006 .

[27]  Ling Li,et al.  Integrated production, quality control and condition-based maintenance for imperfect production systems , 2018, Reliab. Eng. Syst. Saf..

[28]  M. J. van der Laan,et al.  A new partitioning around medoids algorithm , 2003 .

[29]  Hichem Sahli,et al.  Hidden Semi-Markov Models for Predictive Maintenance , 2015 .

[30]  W. Fuller,et al.  Distribution of the Estimators for Autoregressive Time Series with a Unit Root , 1979 .

[31]  Xuemei Liu,et al.  Semi-supervised learning and condition fusion for fault diagnosis , 2013 .

[32]  Lifeng Xi,et al.  Residual life predictions for ball bearings based on self-organizing map and back propagation neural network methods , 2007 .

[33]  Ludo Gelders,et al.  Development of maintenance function performance measurement framework and indicators , 2011 .

[34]  Richard S. Sutton,et al.  Adaptive State Representation and Estimation Using Recurrent Connectionist Networks , 1995 .

[35]  MusílekPetr,et al.  A survey of Knowledge Discovery and Data Mining process models , 2006 .

[36]  J. Manyika Big data: The next frontier for innovation, competition, and productivity , 2011 .

[37]  Douglas D. Gemmill,et al.  Smart Maintenance Decision Support Systems (SMDSS) based on corporate big data analytics , 2017, Expert Syst. Appl..

[38]  Leo Breiman,et al.  Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) , 2001 .

[39]  Gregoris Mentzas,et al.  Review, analysis and synthesis of prognostic-based decision support methods for condition based maintenance , 2018, J. Intell. Manuf..

[40]  Gangbing Song,et al.  An effective procedure exploiting unlabeled data to build monitoring system , 2011, Expert Syst. Appl..

[41]  Gian Antonio Susto,et al.  Machine Learning for Predictive Maintenance: A Multiple Classifier Approach , 2015, IEEE Transactions on Industrial Informatics.

[42]  Ying Wah Teh,et al.  Time-series clustering - A decade review , 2015, Inf. Syst..

[43]  A. Rinaldo,et al.  Bootstrapping and sample splitting for high-dimensional, assumption-lean inference , 2016, The Annals of Statistics.

[44]  Alan R. Hevner,et al.  POSITIONING AND PRESENTING DESIGN SCIENCE RESEARCH FOR MAXIMUM IMPACT 1 , 2013 .

[45]  Donghua Zhou,et al.  Remaining useful life estimation - A review on the statistical data driven approaches , 2011, Eur. J. Oper. Res..

[46]  B. Everitt,et al.  Cluster Analysis: Everitt/Cluster Analysis , 2011 .

[47]  Patrick Zschech,et al.  A Taxonomy of Recurring Data Analysis Problems in Maintenance Analytics , 2018, ECIS.

[48]  Yili Hong,et al.  Reliability Meets Big Data: Opportunities and Challenges , 2014 .

[49]  G. Vachtsevanos,et al.  Reasoning about uncertainty in prognosis: a confidence prediction neural network approach , 2005, NAFIPS 2005 - 2005 Annual Meeting of the North American Fuzzy Information Processing Society.

[50]  Galit Shmueli,et al.  Predictive Analytics in Information Systems Research , 2010, MIS Q..

[51]  Uday Kumar,et al.  Remaining Useful Life Estimation using Time Trajectory Tracking and Support Vector Machines , 2012 .

[52]  B. Hansen Sample Splitting and Threshold Estimation , 2000 .