A Review on Deep Learning Applications in Prognostics and Health Management

Deep learning has attracted intense interest in Prognostics and Health Management (PHM), because of its enormous representing power, automated feature learning capability and best-in-class performance in solving complex problems. This paper surveys recent advancements in PHM methodologies using deep learning with the aim of identifying research gaps and suggesting further improvements. After a brief introduction to several deep learning models, we review and analyze applications of fault detection, diagnosis and prognosis using deep learning. The survey validates the universal applicability of deep learning to various types of input in PHM, including vibration, imagery, time-series and structured data. It also reveals that deep learning provides a one-fits-all framework for the primary PHM subfields: fault detection uses either reconstruction error or stacks a binary classifier on top of the network to detect anomalies; fault diagnosis typically adds a soft-max layer to perform multi-class classification; prognosis adds a continuous regression layer to predict remaining useful life. The general framework suggests the possibility of transfer learning across PHM applications. The survey reveals some common properties and identifies the research gaps in each PHM subfield. It concludes by summarizing some major challenges and potential opportunities in the domain.

[1]  David He,et al.  Gear Pitting Fault Diagnosis Using Integrated CNN and GRU Network with Both Vibration and Acoustic Emission Signals , 2019, Applied Sciences.

[2]  Mohammad R. Jahanshahi,et al.  NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion , 2018, IEEE Transactions on Industrial Electronics.

[3]  Jun-Geol Baek,et al.  A Novel Image Feature for the Remaining Useful Lifetime Prediction of Bearings Based on Continuous Wavelet Transform and Convolutional Neural Network , 2018, Applied Sciences.

[4]  Diego Cabrera,et al.  A review on data-driven fault severity assessment in rolling bearings , 2018 .

[5]  M. Pecht,et al.  Physics-of-Failure-Based Prognostics and Health Management for High-Power White Light-Emitting Diode Lighting , 2011, IEEE Transactions on Device and Materials Reliability.

[6]  David He,et al.  Using Deep Learning-Based Approach to Predict Remaining Useful Life of Rotating Components , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  J.W. Sheppard,et al.  IEEE Standards for Prognostics and Health Management , 2008, IEEE Aerospace and Electronic Systems Magazine.

[8]  Bo Jin,et al.  Sequential Fault Diagnosis Based on LSTM Neural Network , 2018, IEEE Access.

[9]  Wei Cai,et al.  Lightweight Deep Residual CNN for Fault Diagnosis of Rotating Machinery Based on Depthwise Separable Convolutions , 2019, IEEE Access.

[10]  Wei Zhang,et al.  A New Deep Learning Model for Fault Diagnosis with Good Anti-Noise and Domain Adaptation Ability on Raw Vibration Signals , 2017, Sensors.

[11]  Myeongsu Kang,et al.  Multiple Wavelet Coefficients Fusion in Deep Residual Networks for Fault Diagnosis , 2019, IEEE Transactions on Industrial Electronics.

[12]  Wei Jiang,et al.  A multi-step progressive fault diagnosis method for rolling element bearing based on energy entropy theory and hybrid ensemble auto-encoder. , 2019, ISA transactions.

[13]  Asok Ray,et al.  Temporal Learning in Video Data Using Deep Learning and Gaussian Processes , 2020, International Journal of Prognostics and Health Management.

[14]  Jasper Snoek,et al.  Nonparametric guidance of autoencoder representations using label information , 2012, J. Mach. Learn. Res..

[15]  Gehao Sheng,et al.  Dissolved gas analysis of insulating oil for power transformer fault diagnosis with deep belief network , 2017, IEEE Transactions on Dielectrics and Electrical Insulation.

[16]  김창욱,et al.  A Convolutional Neural Network for Fault Classification and Diagnosis in Semiconductor Manufacturing Processes , 2016 .

[17]  Zhencai Zhu,et al.  Health Monitoring for Balancing Tail Ropes of a Hoisting System Using a Convolutional Neural Network , 2018, Applied Sciences.

[18]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[19]  K. Goebel,et al.  Metrics for evaluating performance of prognostic techniques , 2008, 2008 International Conference on Prognostics and Health Management.

[20]  Duan-Yu Chen,et al.  Deep-Learning-Based Earth Fault Detection Using Continuous Wavelet Transform and Convolutional Neural Network in Resonant Grounding Distribution Systems , 2018, IEEE Sensors Journal.

[21]  Jing Lin,et al.  An angle-based subspace anomaly detection approach to high-dimensional data: With an application to industrial fault detection , 2015, Reliab. Eng. Syst. Saf..

[22]  Hyunseok Oh,et al.  Scalable and Unsupervised Feature Engineering Using Vibration-Imaging and Deep Learning for Rotor System Diagnosis , 2018, IEEE Transactions on Industrial Electronics.

[23]  Brigitte Chebel-Morello,et al.  PRONOSTIA : An experimental platform for bearings accelerated degradation tests. , 2012 .

[24]  Houxiang Zhang,et al.  Validation of Data-Driven Labeling Approaches Using a Novel Deep Network Structure for Remaining Useful Life Predictions , 2019, IEEE Access.

[25]  Douglas M. Hawkins Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[26]  Steven X. Ding,et al.  A Survey of Fault Diagnosis and Fault-Tolerant Techniques—Part II: Fault Diagnosis With Knowledge-Based and Hybrid/Active Approaches , 2015, IEEE Transactions on Industrial Electronics.

[27]  Qiang Yang,et al.  Deep Learning Based Module Defect Analysis for Large-Scale Photovoltaic Farms , 2019, IEEE Transactions on Energy Conversion.

[28]  Baoyu Ma,et al.  Fault Diagnosis of Motor in Frequency Domain Signal by Stacked De-noising Auto-encoder , 2018 .

[29]  Peng Wang,et al.  Long short-term memory for machine remaining life prediction , 2018, Journal of Manufacturing Systems.

[30]  Mehmet Karaköse,et al.  A new rail inspection method based on deep learning using laser cameras , 2017, 2017 International Artificial Intelligence and Data Processing Symposium (IDAP).

[31]  Chenglin Wen,et al.  A Novel Multimode Fault Classification Method Based on Deep Learning , 2017, J. Control. Sci. Eng..

[32]  Jing Lin,et al.  Sliding Window-Based Fault Detection From High-Dimensional Data Streams , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[33]  Wei Gao,et al.  An Intelligent Fault Diagnosis Method for Bearings with Variable Rotating Speed Based on Pythagorean Spatial Pyramid Pooling CNN , 2018, Sensors.

[34]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[35]  Yigang He,et al.  Analog Circuit Incipient Fault Diagnosis Method Using DBN Based Features Extraction , 2018, IEEE Access.

[36]  Jian Ma,et al.  Predicting the Remaining Useful Life of an Aircraft Engine Using a Stacked Sparse Autoencoder with Multilayer Self-Learning , 2018, Complex..

[37]  Jaewoo Kang,et al.  DeepNAP: Deep neural anomaly pre-detection in a semiconductor fab , 2018, Inf. Sci..

[38]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[39]  Xin Zhou,et al.  Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data , 2016 .

[40]  Yan Dong,et al.  A new ensemble residual convolutional neural network for remaining useful life estimation. , 2019, Mathematical biosciences and engineering : MBE.

[41]  Haibo He,et al.  Wind Turbine Fault Detection Using a Denoising Autoencoder With Temporal Information , 2017, IEEE/ASME Transactions on Mechatronics.

[42]  Pradeep Lall,et al.  Prognostics and health monitoring of electronic systems , 2011, 2011 12th Intl. Conf. on Thermal, Mechanical & Multi-Physics Simulation and Experiments in Microelectronics and Microsystems.

[43]  Lei Ren,et al.  Prediction of Bearing Remaining Useful Life With Deep Convolution Neural Network , 2018, IEEE Access.

[44]  Shahin Hedayati Kia,et al.  Information Fusion and Semi-Supervised Deep Learning Scheme for Diagnosing Gear Faults in Induction Machine Systems , 2019, IEEE Transactions on Industrial Electronics.

[45]  Geoffrey E. Hinton,et al.  A Better Way to Pretrain Deep Boltzmann Machines , 2012, NIPS.

[46]  Robert X. Gao,et al.  Deep Learning and Its Applications to Machine Health Monitoring: A Survey , 2016, ArXiv.

[47]  Robert X. Gao,et al.  Deep learning and its applications to machine health monitoring , 2019, Mechanical Systems and Signal Processing.

[48]  Wei Zhang,et al.  Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction , 2019, Reliab. Eng. Syst. Saf..

[49]  Yimin D. Zhang,et al.  Road Crack Detection Using Deep Convolutional Neural Network and Adaptive Thresholding , 2019, 2019 IEEE Intelligent Vehicles Symposium (IV).

[50]  Jun Ma,et al.  Deep auto-encoder observer multiple-model fast aircraft actuator fault diagnosis algorithm , 2017, International Journal of Control, Automation and Systems.

[51]  Ning Wang,et al.  An Intelligent Fault Diagnosis Method for Reciprocating Compressors Based on LMD and SDAE , 2019, Sensors.

[52]  Wenjing Jin,et al.  Enhanced Restricted Boltzmann Machine With Prognosability Regularization for Prognostics and Health Assessment , 2016, IEEE Transactions on Industrial Electronics.

[53]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[54]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[55]  Rama Chellappa,et al.  Deep Multitask Learning for Railway Track Inspection , 2015, IEEE Transactions on Intelligent Transportation Systems.

[56]  Hongmei Li,et al.  Bearing Fault Diagnosis with a Feature Fusion Method Based on an Ensemble Convolutional Neural Network and Deep Neural Network , 2019, Sensors.

[57]  Oliver Obst,et al.  Distributed Fault Detection in Sensor Networks using a Recurrent Neural Network , 2009, Neural Processing Letters.

[58]  Yu Cheng,et al.  Early Fault Detection Approach With Deep Architectures , 2018, IEEE Transactions on Instrumentation and Measurement.

[59]  Bin Li,et al.  Early Fault Detection of Machine Tools Based on Deep Learning and Dynamic Identification , 2019, IEEE Transactions on Industrial Electronics.

[60]  Zhigang Liu,et al.  Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network , 2018, IEEE Transactions on Instrumentation and Measurement.

[61]  Min Xia,et al.  Fault Diagnosis for Rotating Machinery Using Multiple Sensors and Convolutional Neural Networks , 2018, IEEE/ASME Transactions on Mechatronics.

[62]  Shunming Li,et al.  Construction of a batch-normalized autoencoder network and its application in mechanical intelligent fault diagnosis , 2018, Measurement Science and Technology.

[63]  Liang Gao,et al.  A transfer convolutional neural network for fault diagnosis based on ResNet-50 , 2019, Neural Computing and Applications.

[64]  Tanveer Ahmad,et al.  Deep learning-based fault diagnosis of variable refrigerant flow air-conditioning system for building energy saving , 2018, Applied Energy.

[65]  Robert X. Gao,et al.  A Deep Learning Approach for Fault Diagnosis of Induction Motors in Manufacturing , 2017, Chinese Journal of Mechanical Engineering.

[66]  Huan Wang,et al.  A Novel Deeper One-Dimensional CNN With Residual Learning for Fault Diagnosis of Wheelset Bearings in High-Speed Trains , 2019, IEEE Access.

[67]  Hong Wang,et al.  Early Fault Detection of Wind Turbines Based on Operational Condition Clustering and Optimized Deep Belief Network Modeling , 2019, Energies.

[68]  Hongmei Liu,et al.  Rolling Bearing Fault Diagnosis Based on STFT-Deep Learning and Sound Signals , 2016 .

[69]  Songyan Wang,et al.  Deep‐learning based fault diagnosis using computer‐visualised power flow , 2018, IET Generation, Transmission & Distribution.

[70]  Dongnan Hou,et al.  An SDP Characteristic Information Fusion-Based CNN Vibration Fault Diagnosis Method , 2019, Shock and Vibration.

[71]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[72]  Yan Han,et al.  An enhanced convolutional neural network with enlarged receptive fields for fault diagnosis of planetary gearboxes , 2019, Comput. Ind..

[73]  Robert Babuska,et al.  Railway Track Circuit Fault Diagnosis Using Recurrent Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[74]  Wei Liang,et al.  The early-warning model of equipment chain in gas pipeline based on DNN-HMM , 2015 .

[75]  Ruqiang Yan,et al.  Learning to Monitor Machine Health with Convolutional Bi-Directional LSTM Networks , 2017, Sensors.

[76]  Yuxin Cui,et al.  Transfer Learning with Deep Recurrent Neural Networks for Remaining Useful Life Estimation , 2018, Applied Sciences.

[77]  Yupu Yang,et al.  Intelligent simultaneous fault diagnosis for solid oxide fuel cell system based on deep learning , 2019, Applied Energy.

[78]  Zhou Pei,et al.  Rotor fault diagnosis using a convolutional neural network with symmetrized dot pattern images , 2019, Measurement.

[79]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[80]  De Xu,et al.  Automatic Metallic Surface Defect Detection and Recognition with Convolutional Neural Networks , 2018, Applied Sciences.

[81]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[82]  Weiming Shen,et al.  Bearing Fault Diagnosis Method Based on Deep Convolutional Neural Network and Random Forest Ensemble Learning , 2019, Sensors.

[83]  Fu Xiao,et al.  Analytical investigation of autoencoder-based methods for unsupervised anomaly detection in building energy data , 2018 .

[84]  Dongxiang Jiang,et al.  Fault diagnosis of wind turbine based on Long Short-term memory networks , 2019, Renewable Energy.

[85]  Jianbo Yu,et al.  A selective deep stacked denoising autoencoders ensemble with negative correlation learning for gearbox fault diagnosis , 2019, Comput. Ind..

[86]  Michael Pecht,et al.  Physics-of-failure-based prognostics for electronic products , 2009 .

[87]  Diego Cabrera,et al.  Fault Diagnosis for Rotating Machinery Using Vibration Measurement Deep Statistical Feature Learning , 2016, Sensors.

[88]  Jin Cui,et al.  Multi-bearing remaining useful life collaborative prediction: A deep learning approach , 2017 .

[89]  Kay Chen Tan,et al.  Multiobjective Deep Belief Networks Ensemble for Remaining Useful Life Estimation in Prognostics , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[90]  Liang Guo,et al.  A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines , 2018, Neurocomputing.

[91]  Lei Ren,et al.  Remaining Useful Life Prediction for Lithium-Ion Battery: A Deep Learning Approach , 2018, IEEE Access.

[92]  Li Lin,et al.  Remaining useful life estimation of engineered systems using vanilla LSTM neural networks , 2018, Neurocomputing.

[93]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[94]  Xinghua Zhang,et al.  Long Short-Term Memory Networks Based Automatic Feature Extraction for Photovoltaic Array Fault Diagnosis , 2019, IEEE Access.

[95]  Shibin Gao,et al.  Deep Architecture for High-Speed Railway Insulator Surface Defect Detection: Denoising Autoencoder With Multitask Learning , 2019, IEEE Transactions on Instrumentation and Measurement.

[96]  Wenjing Hu,et al.  Anomaly detection and fault analysis of wind turbine components based on deep learning network , 2018, Renewable Energy.

[97]  Lei Ren,et al.  Bearing remaining useful life prediction based on deep autoencoder and deep neural networks , 2018, Journal of Manufacturing Systems.

[98]  Yaguo Lei,et al.  Deep convolution feature learning for health indicator construction of bearings , 2017, 2017 Prognostics and System Health Management Conference (PHM-Harbin).

[99]  Houxiang Zhang,et al.  An Unsupervised Reconstruction-Based Fault Detection Algorithm for Maritime Components , 2019, IEEE Access.

[100]  Marc'Aurelio Ranzato,et al.  Efficient Learning of Sparse Representations with an Energy-Based Model , 2006, NIPS.

[101]  Yuanqing Xia,et al.  A deep Boltzmann machine and multi-grained scanning forest ensemble collaborative method and its application to industrial fault diagnosis , 2018, Comput. Ind..

[102]  Mengshi Li,et al.  A radically data-driven method for fault detection and diagnosis in wind turbines , 2018, International Journal of Electrical Power & Energy Systems.

[103]  Yang Liu,et al.  A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors , 2018, Neurocomputing.

[104]  Pengcheng Jiang,et al.  Intelligent fault diagnosis of rotating machinery based on one-dimensional convolutional neural network , 2019, Comput. Ind..

[105]  Haidong Shao,et al.  Improved Deep Transfer Auto-Encoder for Fault Diagnosis of Gearbox Under Variable Working Conditions With Small Training Samples , 2019, IEEE Access.

[106]  Linxia Liao,et al.  Review of Hybrid Prognostics Approaches for Remaining Useful Life Prediction of Engineered Systems, and an Application to Battery Life Prediction , 2014, IEEE Transactions on Reliability.

[107]  B. Santhi,et al.  Nuclear Power Plant Thermocouple Sensor-Fault Detection and Classification Using Deep Learning and Generalized Likelihood Ratio Test , 2017, IEEE Transactions on Nuclear Science.

[108]  David He,et al.  Remaining Useful Life Prediction of Hybrid Ceramic Bearings Using an Integrated Deep Learning and Particle Filter Approach , 2017 .

[109]  Steven Verstockt,et al.  Convolutional Neural Network Based Fault Detection for Rotating Machinery , 2016 .

[110]  Jianbo Yu,et al.  Stacked denoising autoencoder‐based feature learning for out‐of‐control source recognition in multivariate manufacturing process , 2018, Qual. Reliab. Eng. Int..

[111]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[112]  Yi Chai,et al.  Fisher Discriminative Sparse Representation Based on DBN for Fault Diagnosis of Complex System , 2018 .

[113]  Hee-Jun Kang,et al.  Rolling element bearing fault diagnosis using convolutional neural network and vibration image , 2019, Cognitive Systems Research.

[114]  Jing Lin,et al.  Adaptive kernel density-based anomaly detection for nonlinear systems , 2018, Knowl. Based Syst..

[115]  Yang Guo,et al.  A Weighted Deep Representation Learning Model for Imbalanced Fault Diagnosis in Cyber-Physical Systems , 2018, Sensors.

[116]  Ole Winther,et al.  Deep learning for automated drivetrain fault detection , 2018 .

[117]  Enrico Zio,et al.  Comparison of Data-Driven Reconstruction Methods For Fault Detection , 2015, IEEE Transactions on Reliability.

[118]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[119]  Oral Büyüköztürk,et al.  Deep Learning‐Based Crack Damage Detection Using Convolutional Neural Networks , 2017, Comput. Aided Civ. Infrastructure Eng..

[120]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[121]  Mark Schwabacher,et al.  A Survey of Data -Driven Prognostics , 2005 .

[122]  Xusheng Lei,et al.  Intelligent fault detection of high voltage line based on the Faster R-CNN , 2019, Measurement.

[123]  Moncef Gabbouj,et al.  Real-time vibration-based structural damage detection using one-dimensional convolutional neural networks , 2017 .

[124]  Wentian Zhao,et al.  Fault diagnosis network design for vehicle on-board equipments of high-speed railway: A deep learning approach , 2016, Eng. Appl. Artif. Intell..

[125]  Xiongbin Wu,et al.  SDD-CNN: Small Data-Driven Convolution Neural Networks for Subtle Roller Defect Inspection , 2019, Applied Sciences.

[126]  Selin Aviyente,et al.  Extended Kalman Filtering for Remaining-Useful-Life Estimation of Bearings , 2015, IEEE Transactions on Industrial Electronics.

[127]  Haidong Shao,et al.  Electric Locomotive Bearing Fault Diagnosis Using a Novel Convolutional Deep Belief Network , 2018, IEEE Transactions on Industrial Electronics.

[128]  Feng Gao,et al.  A Novel Hierarchical Algorithm for Bearing Fault Diagnosis Based on Stacked LSTM , 2019, Shock and Vibration.

[129]  Ruqiang Yan,et al.  Generative adversarial networks for data augmentation in machine fault diagnosis , 2019, Comput. Ind..

[130]  Yigang He,et al.  Open Switch Fault Diagnosis Method for PWM Voltage Source Rectifier Based on Deep Learning Approach , 2019, IEEE Access.

[131]  Liang Guo,et al.  A recurrent neural network based health indicator for remaining useful life prediction of bearings , 2017, Neurocomputing.

[132]  Xindong Wu,et al.  Data mining with big data , 2014, IEEE Transactions on Knowledge and Data Engineering.

[133]  Guanghua Xu,et al.  Learning deep representation of imbalanced SCADA data for fault detection of wind turbines , 2019, Measurement.

[134]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[135]  P.W. Kalgren,et al.  Defining PHM, A Lexical Evolution of Maintenance and Logistics , 2006, 2006 IEEE Autotestcon.

[136]  Weiwen Peng,et al.  Estimation of Bearing Remaining Useful Life Based on Multiscale Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[137]  Wei Jiang,et al.  Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks , 2018, Neurocomputing.

[138]  Meiqin Liu,et al.  Data-Based Line Trip Fault Prediction in Power Systems Using LSTM Networks and SVM , 2018, IEEE Access.

[139]  Yang Yu,et al.  An architecture of deep learning network based on ensemble empirical mode decomposition in precise identification of bearing vibration signal , 2019, Journal of Mechanical Science and Technology.

[140]  Xiang Li,et al.  Remaining useful life estimation in prognostics using deep convolution neural networks , 2018, Reliab. Eng. Syst. Saf..

[141]  Zhenbao Liu,et al.  A Rotating Machinery Fault Diagnosis Method Based on Feature Learning of Thermal Images , 2019, IEEE Access.

[142]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[143]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[144]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[145]  Huaguang Zhang,et al.  A Small-Sample Wind Turbine Fault Detection Method With Synthetic Fault Data Using Generative Adversarial Nets , 2019, IEEE Transactions on Industrial Informatics.

[146]  Jay Lee,et al.  Self-maintenance and engineering immune systems: Towards smarter machines and manufacturing systems , 2011, Annu. Rev. Control..

[147]  Chuang Sun,et al.  Deep Coupling Autoencoder for Fault Diagnosis With Multimodal Sensory Data , 2018, IEEE Transactions on Industrial Informatics.

[148]  Fanming Meng,et al.  An Improved Bearing Fault Diagnosis Method using One-Dimensional CNN and LSTM , 2018, Strojniški vestnik - Journal of Mechanical Engineering.

[149]  Javier Del Ser,et al.  Data fusion and machine learning for industrial prognosis: Trends and perspectives towards Industry 4.0 , 2019, Inf. Fusion.

[150]  F.O. Heimes,et al.  Recurrent neural networks for remaining useful life estimation , 2008, 2008 International Conference on Prognostics and Health Management.

[151]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[152]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[153]  Chien-Liang Liu,et al.  Time Series Classification With Multivariate Convolutional Neural Network , 2019, IEEE Transactions on Industrial Electronics.

[154]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[155]  이창기 Long Short-Term Memory 기반의 Recurrent Neural Network를 이용한 개체명 인식 , 2015 .

[156]  Jiangtao Wen,et al.  Intelligent Bearing Fault Diagnosis Method Combining Compressed Data Acquisition and Deep Learning , 2018, IEEE Transactions on Instrumentation and Measurement.

[157]  Yonghong Zhang,et al.  Motor Fault Diagnosis Based on Short-time Fourier Transform and Convolutional Neural Network , 2017, Chinese Journal of Mechanical Engineering.

[158]  Zhenyu Wang,et al.  Deep learning based monitoring of furnace combustion state and measurement of heat release rate , 2017 .

[159]  Liang Gao,et al.  A New Deep Transfer Learning Based on Sparse Auto-Encoder for Fault Diagnosis , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[160]  Zhifen Zhang,et al.  Rolling Bearing Incipient Degradation Monitoring and Performance Assessment Based on Signal Component Tracking , 2019, IEEE Access.

[161]  Jiafu Wan,et al.  Industrial Big Data for Fault Diagnosis: Taxonomy, Review, and Applications , 2017, IEEE Access.

[162]  Cunbao Ma,et al.  Deep quantum inspired neural network with application to aircraft fuel system fault diagnosis , 2017, Neurocomputing.

[163]  Hongkai Jiang,et al.  Intelligent fault diagnosis of rolling bearings using an improved deep recurrent neural network , 2018 .

[164]  Alexander Steinecker,et al.  Automated fault detection using deep belief networks for the quality inspection of electromotors , 2014 .

[165]  Chen Lu,et al.  Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification , 2017, Adv. Eng. Informatics.

[166]  Weiming Shen,et al.  Online Fault Diagnosis Method Based on Transfer Convolutional Neural Networks , 2020, IEEE Transactions on Instrumentation and Measurement.

[167]  Levente Tamas,et al.  Railway track following with the AR.Drone using vanishing point detection , 2014, 2014 IEEE International Conference on Automation, Quality and Testing, Robotics.

[168]  Sangdo Park,et al.  Diagnosis of Electric Vehicle Batteries Using Recurrent Neural Networks , 2017, IEEE Transactions on Industrial Electronics.

[169]  Yi Wang,et al.  A deep learning approach for anomaly detection based on SAE and LSTM in mechanical equipment , 2019, The International Journal of Advanced Manufacturing Technology.

[170]  Cong Wang,et al.  A novel bearing fault diagnosis method based on 2D image representation and transfer learning-convolutional neural network , 2019, Measurement Science and Technology.

[171]  Shuhui Wang,et al.  Convolutional neural network-based hidden Markov models for rolling element bearing fault identification , 2017, Knowl. Based Syst..

[172]  Mohammad Modarres,et al.  Deep Learning Enabled Fault Diagnosis Using Time-Frequency Image Analysis of Rolling Element Bearings , 2017 .

[173]  Nan Chen,et al.  Prognostics and Health Management: A Review on Data Driven Approaches , 2015 .

[174]  Gregory Levitin,et al.  Robust recurrent neural network modeling for software fault detection and correction prediction , 2007, Reliab. Eng. Syst. Saf..

[175]  Yaguo Lei,et al.  Deep normalized convolutional neural network for imbalanced fault classification of machinery and its understanding via visualization , 2018, Mechanical Systems and Signal Processing.

[176]  Nita Yodo,et al.  A Data-Driven Predictive Prognostic Model for Lithium-Ion Batteries based on a Deep Learning Algorithm , 2019, Energies.

[177]  Meiqin Liu,et al.  Stacked sparse autoencoder with PCA and SVM for data-based line trip fault diagnosis in power systems , 2019, Neural Computing and Applications.

[178]  Houxiang Zhang,et al.  Remaining useful life predictions for turbofan engine degradation using semi-supervised deep architecture , 2019, Reliab. Eng. Syst. Saf..

[179]  Francesco Piazza,et al.  Unsupervised electric motor fault detection by using deep autoencoders , 2019, IEEE/CAA Journal of Automatica Sinica.

[180]  Jaemin Yang,et al.  An accident diagnosis algorithm using long short-term memory , 2018 .

[181]  Jun Gao,et al.  A cable fault recognition method based on a deep belief network , 2018, Comput. Electr. Eng..

[182]  Tapani Raiko,et al.  Gaussian-Bernoulli deep Boltzmann machine , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[183]  Lei Ren,et al.  Multi-scale Dense Gate Recurrent Unit Networks for bearing remaining useful life prediction , 2019, Future Gener. Comput. Syst..

[184]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[185]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[186]  Zhiwei Gao,et al.  From Model, Signal to Knowledge: A Data-Driven Perspective of Fault Detection and Diagnosis , 2013, IEEE Transactions on Industrial Informatics.

[187]  Il Dong Yun,et al.  Residual Error Based Anomaly Detection Using Auto-Encoder in SMD Machine Sound , 2018, Sensors.

[188]  Shuai Yang,et al.  Transfer Learning Based Fault Diagnosis with Missing Data Due to Multi-Rate Sampling , 2019, Sensors.

[189]  Amir Asif,et al.  A multimodal and hybrid deep neural network model for Remaining Useful Life estimation , 2019, Comput. Ind..

[190]  Bo Zhao,et al.  A method for rapidly evaluating reliability and predicting remaining useful life using two-dimensional convolutional neural network with signal conversion , 2019, Journal of Mechanical Science and Technology.

[191]  Qiang Miao,et al.  Prognostics and Health Management: A Review of Vibration Based Bearing and Gear Health Indicators , 2018, IEEE Access.

[192]  Jun Yan,et al.  Multiscale Convolutional Neural Networks for Fault Diagnosis of Wind Turbine Gearbox , 2019, IEEE Transactions on Industrial Electronics.

[193]  Xu-Cheng Yin,et al.  A Denoising Based Autoassociative Model for Robust Sensor Monitoring in Nuclear Power Plants , 2016 .

[194]  Wu Bo,et al.  Anomaly detection in smart grid based on encoder-decoder framework with recurrent neural network , 2017 .

[195]  Tao Wang,et al.  Transformer Fault Diagnosis Using Self-Powered RFID Sensor and Deep Learning Approach , 2018, IEEE Sensors Journal.

[196]  Archana Singh,et al.  Vision based rail track extraction and monitoring through drone imagery , 2017, ICT Express.

[197]  Ye Wei,et al.  Deep features based on a DCNN model for classifying imbalanced weld flaw types , 2019, Measurement.

[198]  Marc Thomas,et al.  Tool condition monitoring using spectral subtraction algorithm and artificial intelligence methods in milling process , 2017 .

[199]  Guangquan Zhao,et al.  Research advances in fault diagnosis and prognostic based on deep learning , 2016, 2016 Prognostics and System Health Management Conference (PHM-Chengdu).

[200]  Dianhui Wang,et al.  Extreme learning machines: a survey , 2011, Int. J. Mach. Learn. Cybern..

[201]  Jialin Li,et al.  A Novel Method for Early Gear Pitting Fault Diagnosis Using Stacked SAE and GBRBM , 2019, Sensors.

[202]  Zhibin Zhao,et al.  Deep Transfer Learning Based on Sparse Autoencoder for Remaining Useful Life Prediction of Tool in Manufacturing , 2019, IEEE Transactions on Industrial Informatics.

[203]  Wentao Mao,et al.  Predicting remaining useful life of rolling bearings based on deep feature representation and long short-term memory neural network , 2018, Advances in Mechanical Engineering.

[204]  Huan Long,et al.  Wind Turbine Gearbox Failure Identification With Deep Neural Networks , 2017, IEEE Transactions on Industrial Informatics.

[205]  Rik Van de Walle,et al.  Deep Learning for Infrared Thermal Image Based Machine Health Monitoring , 2017, IEEE/ASME Transactions on Mechatronics.

[206]  Eric Levrat,et al.  Information and Communication Technologies Within E-maintenance , 2010 .