A novel deep capsule neural network for remaining useful life estimation

With the availability of cheaper multi-sensor systems, one has access to massive and multi-dimensional sensor data for fault diagnostics and prognostics. However, from a time, engineering and computational perspective, it is often cost prohibitive to manually extract useful features and to label all the data. To address these challenges, deep learning techniques have been used in the recent years. Within these, convolutional neural networks have shown remarkable performance in fault diagnostics and prognostics. However, this model present limitations from a prognostics and health management perspective: to improve its feature extraction generalization capabilities and reduce computation time, ill-based pooling operations are employed, which require sub-sampling of the data, thus loosing potentially valuable information regarding an asset’s degradation process. Capsule neural networks have been recently proposed to address these problems with strong results in computer vision–related classification tasks. This has motivated us to extend capsule neural networks for fault prognostics and, in particular, remaining useful life estimation. The proposed model, architecture and algorithm are tested and compared to other state-of-the art deep learning models on the benchmark Commercial Modular Aero Propulsion System Simulation turbofans data set. The results indicate that the proposed capsule neural networks are a promising approach for remaining useful life prognostics from multi-dimensional sensor data.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Zhigang Tian,et al.  An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring , 2012, J. Intell. Manuf..

[3]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[4]  Lovekesh Vig,et al.  Multi-Sensor Prognostics using an Unsupervised Health Index based on LSTM Encoder-Decoder , 2016, ArXiv.

[5]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Jonathan Tompson,et al.  Efficient object localization using Convolutional Networks , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Emmanuel Ramasso,et al.  Investigating computational geometry for failure prognostics , 2014, International Journal of Prognostics and Health Management.

[8]  Enrico Zio,et al.  Failure and reliability prediction by support vector machines regression of time series data , 2011, Reliab. Eng. Syst. Saf..

[9]  Mohammad Modarres,et al.  Acoustic emission based fault diagnosis via a novel deep convolutional neural network method , 2018 .

[10]  Lixiang Duan,et al.  A multi-scale convolution neural network for featureless fault diagnosis , 2016, 2016 International Symposium on Flexible Automation (ISFA).

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[13]  Abhinav Saxena,et al.  Damage propagation modeling for aircraft engine run-to-failure simulation , 2008, 2008 International Conference on Prognostics and Health Management.

[14]  Enrico Zio,et al.  Predicting component reliability and level of degradation with complex-valued neural networks , 2014, Reliab. Eng. Syst. Saf..

[15]  Mohammad Modarres,et al.  Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings , 2017 .

[16]  ZhiQiang Chen,et al.  Gearbox Fault Identification and Classification with Convolutional Neural Networks , 2015 .

[17]  Enrique López Droguett,et al.  Convolutional neural networks for automated damage recognition and damage type identification , 2018, Structural Control and Health Monitoring.

[18]  Xiaoli Li,et al.  Deep Convolutional Neural Network Based Regression Approach for Estimation of Remaining Useful Life , 2016, DASFAA.

[19]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[20]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[21]  Márcio das Chagas Moura,et al.  Deep variational auto-encoders: A promising tool for dimensionality reduction and ball bearing elements fault diagnosis , 2018, Structural Health Monitoring.

[22]  Geoffrey E. Hinton,et al.  Transforming Autoencoders , 2011 .

[23]  Jin Cui,et al.  Multi-bearing remaining useful life collaborative prediction: A deep learning approach , 2017 .

[24]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Nagi Gebraeel,et al.  Residual life predictions from vibration-based degradation signals: a neural network approach , 2004, IEEE Transactions on Industrial Electronics.

[26]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[27]  Huijun Gao,et al.  A convolutional neural network based on a capsule network with strong generalization for bearing fault diagnosis , 2019, Neurocomputing.

[28]  Hong-Bae Jun,et al.  On condition based maintenance policy , 2015, J. Comput. Des. Eng..

[29]  SchmidhuberJürgen Deep learning in neural networks , 2015 .

[30]  Ping Xu,et al.  Prognostics and Health Management (PHM) system requirements and validation , 2010, 2010 Prognostics and System Health Management Conference.

[31]  Chetan Gupta,et al.  Long Short-Term Memory Network for Remaining Useful Life estimation , 2017, 2017 IEEE International Conference on Prognostics and Health Management (ICPHM).

[32]  Michael Pecht,et al.  Physics-of-failure-based prognostics for electronic products , 2009 .

[33]  Joseph Mathew,et al.  Rotating machinery prognostics. State of the art, challenges and opportunities , 2009 .

[34]  Takehisa Yairi,et al.  A review on the application of deep learning in system health management , 2018, Mechanical Systems and Signal Processing.

[35]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[36]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[37]  Geoffrey E. Hinton,et al.  Matrix capsules with EM routing , 2018, ICLR.

[38]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[40]  L. Peel,et al.  Data driven prognostics using a Kalman filter ensemble of neural network models , 2008, 2008 International Conference on Prognostics and Health Management.

[41]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[42]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[43]  K. Ohki,et al.  Mixed functional microarchitectures for orientation selectivity in the mouse primary visual cortex , 2016, Nature Communications.

[44]  Yoshua Bengio,et al.  Equilibrated adaptive learning rates for non-convex optimization , 2015, NIPS.

[45]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.