Review and Analysis of Algorithmic Approaches Developed for Prognostics on CMAPSS Dataset

Benchmarking of prognostic algorithms has been challenging due to limited availability of common datasets suitable for prognostics. In an attempt to alleviate this problem , several benchmarking datasets have been collected by NASA's prognostic center of excellence and made available to the Prognostics and Health Management (PHM) community to allow evaluation and comparison of prognostics algorithms. Among those datasets are five C-MAPSS datasets that have been extremely popular due to their unique characteristics making them suitable for prognostics. The C-MAPSS datasets pose several challenges that have been tackled by different methods in the PHM literature. In particular, management of high variability due to sensor noise, effects of operating conditions, and presence of multiple simultaneous fault modes are some factors that have great impact on the generalization capabilities of prognostics algorithms. More than 70 publications have used the C-MAPSS datasets for developing data-driven prognostic algorithms. The C-MAPSS datasets are also shown to be well-suited for development of new machine learning and pattern recognition tools for several key preprocessing steps such as feature extraction and selection, failure mode assessment, operating conditions assessment , health status estimation, uncertainty management, and prognostics performance evaluation. This paper summarizes a comprehensive literature review of publications using C-MAPSS datasets and provides guidelines and references to further usage of these datasets in a manner that allows clear and consistent comparison between different approaches.

[1]  Jonathan S. Litt,et al.  User's Guide for the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) , 2007 .

[2]  Jamie B. Coble,et al.  Applying the General Path Model to Estimation of Remaining Useful Life , 2011, International Journal of Prognostics and Health Management.

[3]  Rafael Gouriveau,et al.  Prognostics in switching systems: Evidential markovian classification of real-time neuro-fuzzy predictions , 2010, 2010 Prognostics and System Health Management Conference.

[4]  Jianbo Yu,et al.  A similarity-based prognostics approach for Remaining Useful Life estimation of engineered systems , 2008, 2008 International Conference on Prognostics and Health Management.

[5]  Chao Hu,et al.  A Copula-based sampling method for data-driven prognostics and health management , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[6]  Benoît Iung,et al.  Remaining useful life estimation based on stochastic deterioration models: A comparative study , 2013, Reliab. Eng. Syst. Saf..

[7]  Peter Willett,et al.  Comparison of data reduction techniques based on SVM classifier and SVR performance , 2011, Optical Engineering + Applications.

[8]  Emmanuel Ramasso,et al.  Investigating Computational Geometry for Failure Prognostics in Presence of Imprecise Health Indicator: Results and Comparisons on C-MAPSS Datasets , 2014 .

[9]  M. Bodruzzaman,et al.  Decision fusion software system for turbine engine fault diagnostics , 2012, 2012 Proceedings of IEEE Southeastcon.

[10]  Michael Pecht,et al.  Study of ensemble learning-based fusion prognostics , 2010, 2010 Prognostics and System Health Management Conference.

[11]  K. Goebel,et al.  Metrics for evaluating performance of prognostic techniques , 2008, 2008 International Conference on Prognostics and Health Management.

[12]  Hatem M. Elattar,et al.  Evaluation of Neural Networks in the Subject of Prognostics As Compared To Linear Regression Model , 2010 .

[13]  Noureddine Zerhouni,et al.  Reducing arbitrary choices in model building for prognostics: An approach by applying parsimony principle on an evolving neuro-fuzzy system , 2011, Microelectron. Reliab..

[14]  Jianjun Shi,et al.  A Data-Level Fusion Model for Developing Composite Health Indices for Degradation Modeling and Prognostic Analysis , 2013, IEEE Transactions on Automation Science and Engineering.

[15]  Saleh Zein-Sabatto,et al.  Statistical approach to online prognostics of turbine engine components , 2013, 2013 Proceedings of IEEE Southeastcon.

[16]  J.W. Hines,et al.  Prognostic algorithm categorization with PHM Challenge application , 2008, 2008 International Conference on Prognostics and Health Management.

[17]  Khanh Le Son,et al.  Remaining useful life estimation on the non-homogenous gamma with noise deterioration based on Gibbs filtering: A case study , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[18]  Jianbo Yu,et al.  A nonlinear probabilistic method and contribution analysis for machine condition monitoring , 2013 .

[19]  Emmanuel Ramasso,et al.  Investigating computational geometry for failure prognostics , 2014, International Journal of Prognostics and Health Management.

[20]  Hanz Richter Engine Models and Simulation Tools , 2012 .

[21]  Xiaobin Li,et al.  Fault Prognostic Based on Hybrid Method of State Judgment and Regression , 2013 .

[22]  Noureddine Zerhouni,et al.  Novel failure prognostics approach with dynamic thresholds for machine degradation , 2013, IECON 2013 - 39th Annual Conference of the IEEE Industrial Electronics Society.

[23]  Jamie B. Coble,et al.  Merging Data Sources to Predict Remaining Useful Life – An Automated Method to Identify Prognostic Parameters , 2010 .

[24]  Yu Peng,et al.  A modified echo state network based remaining useful life estimation approach , 2012, 2012 IEEE Conference on Prognostics and Health Management.

[25]  L. Peel,et al.  Data driven prognostics using a Kalman filter ensemble of neural network models , 2008, 2008 International Conference on Prognostics and Health Management.

[26]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[27]  Jian Sun,et al.  Nonparametric and Semi-Parametric Sensor Recovery in Multichannel Condition Monitoring Systems , 2011, IEEE Transactions on Automation Science and Engineering.

[28]  Chao Hu,et al.  Ensemble of data-driven prognostic algorithms for robust prediction of remaining useful life , 2011, 2011 IEEE Conference on Prognostics and Health Management.

[29]  Noureddine Zerhouni,et al.  Joint Prediction of Continuous and Discrete States in Time-Series Based on Belief Functions , 2013, IEEE Transactions on Cybernetics.

[30]  G. Klir,et al.  Uncertainty-based information: Elements of generalized information theory (studies in fuzziness and soft computing). , 1998 .

[31]  Byeng D. Youn,et al.  A generic probabilistic framework for structural health prognostics and uncertainty management , 2012 .

[32]  A. Raftery,et al.  Using Bayesian Model Averaging to Calibrate Forecast Ensembles , 2005 .

[33]  Emmanuel Ramasso,et al.  Contribution of belief functions to hidden markov models with an application to fault diagnosis , 2009, 2009 IEEE International Workshop on Machine Learning for Signal Processing.

[34]  Noureddine Zerhouni,et al.  Strategies to Face Imbalanced and Unlabelled Data in Phm Applications , 2013 .

[35]  Noureddine Zerhouni,et al.  E2GKpro: An evidential evolving multi-modeling approach for system behavior prediction with applications , 2013 .

[36]  Donghua Zhou,et al.  Online probabilistic operational safety assessment of multi-mode engineering systems using Bayesian methods , 2013, Reliab. Eng. Syst. Saf..

[37]  Michael Pecht,et al.  Application of a state space modeling technique to system prognostics based on a health index for condition-based maintenance , 2012 .

[38]  Thierry Denoeux,et al.  Making Use of Partial Knowledge About Hidden States in HMMs: An Approach Based on Belief Functions , 2014, IEEE Transactions on Fuzzy Systems.

[39]  Manzar Abbas System-level health assessment of complex engineered processes , 2010 .

[40]  Rafael Gouriveau,et al.  Remaining Useful Life Estimation by Classification of Predictions Based on a Neuro-Fuzzy System and Theory of Belief Functions , 2014, IEEE Transactions on Reliability.

[41]  David P. Williams,et al.  Classification with imperfect labels for fault prediction , 2011, KDD4Service '11.

[42]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[43]  Noureddine Zerhouni,et al.  Features Selection Procedure for Prognostics: An Approach Based on Predictability , 2012 .

[44]  Pingfeng Wang,et al.  Failure diagnosis using deep belief learning based health state classification , 2013, Reliab. Eng. Syst. Saf..

[45]  David Siegel Evaluation of health assessment techniques for rotating machinery , 2009 .

[46]  Peng Xiyuan,et al.  Sensor Selection with Grey Correlation Analysis for Remaining Useful Life Evaluation , 2012 .

[47]  Tianyi Wang,et al.  Trajectory Similarity Based Prediction for Remaining Useful Life Estimation , 2010 .

[48]  Noureddine Zerhouni,et al.  Connexionist-Systems-Based Long Term Prediction Approaches for Prognostics , 2012, IEEE Transactions on Reliability.

[49]  Sankalita Saha,et al.  Metrics for Offline Evaluation of Prognostic Performance , 2021, International Journal of Prognostics and Health Management.

[50]  Asok Ray,et al.  Data-Driven Fault Detection in Aircraft Engines With Noisy Sensor Measurements , 2011 .

[51]  Cairo Lucio Nascimento Junior,et al.  GFRBS-PHM: A Genetic Fuzzy Rule-Based System for PHM with improved interpretability , 2013, 2013 IEEE Conference on Prognostics and Health Management (PHM).

[52]  Noureddine Zerhouni,et al.  E2GK-pro : An evidential evolving multimodeling approach for systems behavior prediction. , 2011 .