A hybrid feature model and deep learning based fault diagnosis for unmanned aerial vehicle sensors

Abstract Fault diagnosis plays an important role in guaranteeing system safety and reliability for unmanned aerial vehicles (UAVs). In this study, a hybrid feature model and deep learning based fault diagnosis for UAV sensors is proposed. The residual signals of different sensor faults, including global positioning system (GPS), inertial measurement unit (IMU), air data system (ADS), were collected. This paper used short time fourier transform (STFT) to transform the residual signal to the corresponding time-frequency map. Then, a convolutional neural network (CNN) was used to extract the feature of the map and the fault diagnosis of the UAV sensors was implemented. Finally, the performance of the proposed methodology is evaluated through flight experiments of the UAV. From the visualization, the sensor faults information can be extracted by CNN and the fault diagnosis logic between the residuals and the health status can be constructed successfully.

[1]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[2]  Eugene A. Morelli,et al.  Aircraft system identification : theory and practice , 2006 .

[3]  Yonghong Zhang,et al.  Motor Fault Diagnosis Based on Short-time Fourier Transform and Convolutional Neural Network , 2017, Chinese Journal of Mechanical Engineering.

[4]  Alan S. Willsky,et al.  F-8 DFBW sensor failure identification using analytic redundancy , 1977 .

[5]  Masafumi Hagiwara,et al.  Natural language neural network and its application to question-answering system , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[6]  P. Maybeck,et al.  An MMAE failure detection system for the F-16 , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[8]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[9]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[10]  Peter S. Maybeck,et al.  Sensor/actuator failure detection in the Vista F-16 by multiple model adaptive estimation , 1995, IEEE Transactions on Aerospace and Electronic Systems.

[11]  Yongbo Li,et al.  Application of Bandwidth EMD and Adaptive Multiscale Morphology Analysis for Incipient Fault Diagnosis of Rolling Bearings , 2017, IEEE Transactions on Industrial Electronics.

[12]  Shalabh Gupta,et al.  Optimal Sensor Selection and Fusion for Heat Exchanger Fouling Diagnosis in Aerospace Systems , 2016, IEEE Sensors Journal.

[13]  Diego Cabrera,et al.  Multimodal deep support vector classification with homologous features and its application to gearbox fault diagnosis , 2015, Neurocomputing.

[14]  Guang-Hong Yang,et al.  Distributed Fault Detection and Isolation for Multiagent Systems: An Interval Observer Approach , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Chingiz Hajiyev,et al.  Fault diagnosis and reconfiguration in flight control systems , 2003 .

[16]  Min Meng,et al.  Ultrasonic signal classification and imaging system for composite materials via deep convolutional neural networks , 2017, Neurocomputing.

[17]  Steven C. H. Hoi,et al.  Face Detection using Deep Learning: An Improved Faster RCNN Approach , 2017, Neurocomputing.

[18]  Donghua Zhou,et al.  Multisensor Data-Fusion-Based Approach to Airspeed Measurement Fault Detection for Unmanned Aerial Vehicles , 2018, IEEE Transactions on Instrumentation and Measurement.

[19]  M.D. Srinath,et al.  A Fault-Tolerant Multisensor Navigation System Design , 1987, IEEE Transactions on Aerospace and Electronic Systems.

[20]  Davide Brunelli,et al.  Autonomous Gas Detection and Mapping With Unmanned Aerial Vehicles , 2016, IEEE Transactions on Instrumentation and Measurement.

[21]  Kaixiang Peng,et al.  Time-Varying Fault Diagnosis for Asynchronous Multisensor Systems Based on Augmented IMM and Strong Tracking Filtering , 2018, J. Control. Sci. Eng..

[22]  Thomas F. Quatieri,et al.  Short-time Fourier transform , 1987 .

[23]  Khashayar Khorasani,et al.  Dynamic neural network-based fault diagnosis of gas turbine engines , 2014, Neurocomputing.