Method for Fault Diagnosis of Temperature-Related MEMS Inertial Sensors by Combining Hilbert–Huang Transform and Deep Learning

In this paper, we propose a novel method for fault diagnosis in micro-electromechanical system (MEMS) inertial sensors using a bidirectional long short-term memory (BLSTM)-based Hilbert–Huang transform (HHT) and a convolutional neural network (CNN). First, the method for fault diagnosis of inertial sensors is formulated into an HHT-based deep learning problem. Second, we present a new BLSTM-based empirical mode decomposition (EMD) method for converting one-dimensional inertial data into two-dimensional Hilbert spectra. Finally, a CNN is used to perform fault classification tasks that use time–frequency HHT spectrums as input. According to our experimental results, significantly improved performance can be achieved, on average, for the proposed BLSTM-based EMD algorithm in terms of EMD computational efficiency compared with state-of-the-art algorithms. In addition, the proposed fault diagnosis method achieves high accuracy in fault classification.

[1]  Bing Han,et al.  Comparisons of different deep learning-based methods on fault diagnosis for geared system , 2019, Int. J. Distributed Sens. Networks.

[2]  Raul Morais,et al.  Hyperspectral Imaging: A Review on UAV-Based Sensors, Data Processing and Applications for Agriculture and Forestry , 2017, Remote. Sens..

[3]  Guang-Hong Yang,et al.  Distributed Fault Detection and Isolation for Multiagent Systems: An Interval Observer Approach , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[4]  Ji Hui Pan,et al.  Design of Flight Control System Bus Controller of UAV Based on Double CAN-Bus , 2013 .

[5]  Jozue Vieira Filho,et al.  A New Structural Health Monitoring Strategy Based on PZT Sensors and Convolutional Neural Network , 2018, Sensors.

[6]  Chuan Li,et al.  Fault Diagnosis of Wind Turbine Gearbox Based on the Optimized LSTM Neural Network with Cosine Loss , 2020, Sensors.

[7]  Khashayar Khorasani,et al.  Data-driven fault detection, isolation and estimation of aircraft gas turbine engine actuator and sensors , 2017, 2017 IEEE 30th Canadian Conference on Electrical and Computer Engineering (CCECE).

[8]  Diego Cabrera,et al.  Automatic feature extraction of time-series applied to fault severity assessment of helical gearbox in stationary and non-stationary speed operation , 2017, Appl. Soft Comput..

[9]  Alan S. Willsky,et al.  F-8 DFBW sensor failure identification using analytic redundancy , 1977 .

[10]  Yi Liu,et al.  Roller Bearing Fault Diagnosis Based on Adaptive Sparsest Narrow-Band Decomposition and MMC-FCH , 2019, Shock and Vibration.

[11]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[12]  Jehn-Ruey Jiang,et al.  Time Series Multiple Channel Convolutional Neural Network with Attention-Based Long Short-Term Memory for Predicting Bearing Remaining Useful Life , 2019, Sensors.

[13]  Jong-Myon Kim,et al.  The Enhancement of Leak Detection Performance for Water Pipelines through the Renovation of Training Data , 2020, Sensors.

[14]  Wang Zhang,et al.  A Fault Diagnosis Intelligent Algorithm Based on Improved BP Neural Network , 2019, Int. J. Pattern Recognit. Artif. Intell..

[15]  Jianye Liu,et al.  A Thrust Model Aided Fault Diagnosis Method for the Altitude Estimation of a Quadrotor , 2018, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Lihong Guo,et al.  Thermal calibration of a tri-axial MEMS gyroscope based on Parameter-Interpolation method , 2017 .

[17]  Christian Napoli,et al.  IMF mode demixing in EMD for jitter analysis , 2017, J. Comput. Sci..

[18]  Khashayar Khorasani,et al.  A New Fault Diagnosis of Multifunctional Spoiler System Using Integrated Artificial Neural Network and Discrete Wavelet Transform Methods , 2018, IEEE Sensors Journal.

[19]  Jeong-Tae Kim,et al.  Bolt-Loosening Monitoring Framework Using an Image-Based Deep Learning and Graphical Model , 2020, Sensors.

[20]  Michael Pecht,et al.  Progressive Improved Convolutional Neural Network for Avionics Fault Diagnosis , 2019, IEEE Access.

[21]  Mehran Hosseini-Pishrobat,et al.  Robust Vibration Control and Angular Velocity Estimation of a Single-Axis MEMS Gyroscope Using Perturbation Compensation , 2019, J. Intell. Robotic Syst..

[22]  Feng Lu,et al.  A Data-Driven Method of Engine Sensor on Line Fault Diagnosis and Recovery , 2014 .

[23]  Huihui Miao,et al.  Joint Learning of Degradation Assessment and RUL Prediction for Aeroengines via Dual-Task Deep LSTM Networks , 2019, IEEE Transactions on Industrial Informatics.

[24]  Giorgos Mallinis,et al.  On the Use of Unmanned Aerial Systems for Environmental Monitoring , 2018, Remote. Sens..

[25]  Wei Liu,et al.  A Novel Fault Diagnosis Approach for Chillers Based on 1-D Convolutional Neural Network and Gated Recurrent Unit , 2020, Sensors.

[26]  Dongdong You,et al.  Bayesian Long Short-Term Memory Model for Fault Early Warning of Nuclear Power Turbine , 2020, IEEE Access.

[27]  Phil Lane,et al.  Railway Point-Operating Machine Fault Detection Using Unlabeled Signaling Sensor Data , 2020, Sensors.

[28]  Dong Li,et al.  A method of anomaly detection and fault diagnosis with online adaptive learning under small training samples , 2017, Pattern Recognit..

[29]  Dawei Zhong,et al.  An Intelligent Fault Diagnosis Method based on STFT and Convolutional Neural Network for Bearings Under Variable Working Conditions , 2019, 2019 Prognostics and System Health Management Conference (PHM-Qingdao).

[30]  Na Qin,et al.  Convolutional Recurrent Neural Network for Fault Diagnosis of High-Speed Train Bogie , 2018, Complex.

[31]  Cunbao Ma,et al.  Deep quantum inspired neural network with application to aircraft fuel system fault diagnosis , 2017, Neurocomputing.

[32]  S. E. Khadem,et al.  Modifying the Hilbert-Huang transform using the nonlinear entropy-based features for early fault detection of ball bearings , 2019, Applied Acoustics.

[33]  Shalabh Gupta,et al.  Optimal Sensor Selection and Fusion for Heat Exchanger Fouling Diagnosis in Aerospace Systems , 2016, IEEE Sensors Journal.

[34]  Tieying Li,et al.  A Fault Diagnosis Method of Temperature Sensor Based on Analytical Redundancy , 2019, 2019 Prognostics and System Health Management Conference (PHM-Paris).

[35]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[36]  Yang Liu,et al.  A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors , 2018, Neurocomputing.

[37]  S. Abolfazl. Mokhtari,et al.  Application of Hilbert–Huang Transform With Improved Ensemble Empirical Mode Decomposition in Nonlinear Flight Dynamic Mode Characteristics Estimation , 2018, Journal of Computational and Nonlinear Dynamics.

[38]  Uipil Chong,et al.  Signal Model-Based Fault Detection and Diagnosis for Induction Motors Using Features of Vibration Signal in Two- Dimension Domain , 2011 .

[39]  Suixian Yang,et al.  Learning Attention Representation with a Multi-Scale CNN for Gear Fault Diagnosis under Different Working Conditions , 2020, Sensors.

[40]  Mou-Fa Guo,et al.  Deep-Learning-Based Fault Classification Using Hilbert–Huang Transform and Convolutional Neural Network in Power Distribution Systems , 2019, IEEE Sensors Journal.

[41]  Jin Woo Song,et al.  1-Point RANSAC UKF with Inverse Covariance Intersection for Fault Tolerance , 2020, Sensors.

[42]  Hao Zhou,et al.  The In-Operation Drift Compensation of MEMS Gyroscope Based on Bagging-ELM and Improved CEEMDAN , 2019, IEEE Sensors Journal.

[43]  Wei Xing Zheng,et al.  Neural Network-Based Adaptive Consensus Control for a Class of Nonaffine Nonlinear Multiagent Systems With Actuator Faults , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Yingqing Guo,et al.  Long short-term memory neural network based fault detection and isolation for electro-mechanical actuators , 2019, Neurocomputing.

[45]  Daniel Delahaye,et al.  Fault detection & diagnosis for small UAVs via machine learning , 2017, 2017 IEEE/AIAA 36th Digital Avionics Systems Conference (DASC).

[46]  Umberto Papa,et al.  Experimental interval models for the robust Fault Detection of Aircraft Air Data Sensors , 2018, Control Engineering Practice.

[47]  Yimin Zhang,et al.  A Bearing Fault Diagnosis Method Based on VMD-SVD and Fuzzy Clustering , 2019, Int. J. Pattern Recognit. Artif. Intell..

[48]  Haibo Chen,et al.  A New Point Anomaly Detection Method About Aero Engine Based on Deep Learning , 2018, 2018 International Conference on Sensing,Diagnostics, Prognostics, and Control (SDPC).

[49]  Guijie Liu,et al.  Time-Frequency Distribution Map-Based Convolutional Neural Network (CNN) Model for Underwater Pipeline Leakage Detection Using Acoustic Signals , 2020, Sensors.

[50]  Bingsan Chen,et al.  The Modeling Method of a Vibrating Screen Efficiency Prediction Based on KPCA and LS-SVM , 2019, Int. J. Pattern Recognit. Artif. Intell..

[51]  J. C. Deckert,et al.  Dual-Sensor Failure Identification Using Analytic Redundancy , 1979 .

[52]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[53]  Davide Brunelli,et al.  Autonomous Gas Detection and Mapping With Unmanned Aerial Vehicles , 2016, IEEE Transactions on Instrumentation and Measurement.

[54]  Hailing Fu,et al.  A Convolutional Neural Network for Impact Detection and Characterization of Complex Composite Structures , 2019, Sensors.

[55]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[56]  Duan-Yu Chen,et al.  A Novel HVDC Double-Terminal Non-Synchronous Fault Location Method Based on Convolutional Neural Network , 2019, IEEE Transactions on Power Delivery.

[57]  Hua Zheng,et al.  Flutter Test Data Processing Based on Improved Hilbert-Huang Transform , 2018 .

[58]  Donghua Zhou,et al.  Multisensor Data-Fusion-Based Approach to Airspeed Measurement Fault Detection for Unmanned Aerial Vehicles , 2018, IEEE Transactions on Instrumentation and Measurement.

[59]  Yu Peng,et al.  A Structured Sparse Subspace Learning Algorithm for Anomaly Detection in UAV Flight Data , 2018, IEEE Transactions on Instrumentation and Measurement.

[60]  Delin Luo,et al.  FlexRay based treble-redundancy UAV flight control computer system , 2017, 2017 13th IEEE International Conference on Control & Automation (ICCA).

[61]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[62]  Davood Asadi,et al.  Detection of the ice assertion on aircraft using empirical mode decomposition enhanced by multi-objective optimization , 2017 .

[63]  Jiangjun Ruan,et al.  Condition Evaluation for Opening Damper of Spring Operated High-Voltage Circuit Breaker Using Vibration Time-Frequency Image , 2019, IEEE Sensors Journal.

[64]  Chih-Jer Lin,et al.  Fault Diagnosis of a Rotor and Ball-Bearing System Using DWT Integrated with SVM, GRNN, and Visual Dot Patterns , 2019, Sensors.

[65]  Bin Zhou,et al.  A Novel Tri-Axial MEMS Gyroscope Calibration Method over a Full Temperature Range , 2018, Sensors.

[66]  SchmidhuberJürgen.  Deep learning in neural networks , 2015 .

[67]  Norden E. Huang,et al.  Ensemble Empirical Mode Decomposition: a Noise-Assisted Data Analysis Method , 2009, Adv. Data Sci. Adapt. Anal..

[68]  Hong-Zhong Huang,et al.  A Bidirectional LSTM Prognostics Method Under Multiple Operational Conditions , 2019, IEEE Transactions on Industrial Electronics.

[69]  René Jr Landry,et al.  Temperature compensation model of MEMS inertial sensors based on neural network , 2018, 2018 IEEE/ION Position, Location and Navigation Symposium (PLANS).