MRD-Nets: Multi-Scale Residual Networks With Dilated Convolutions for Classification and Clustering Analysis of Spacecraft Electrical Signal

The fault detection of spacecraft electronic load systems is a crucial part of the spacecraft prognostics and health management system. To detect the abnormal state of spacecraft electronic load systems, complex electrical signals should be processed rapidly and accurately. For the fault detection of spacecraft electronic load systems, a robust unsupervised clustering analysis method and an accurate supervised classification method are of great importance. However, the traditional machine learning methods have poor performance when processing high-dimensional signal data because of the lack of ability to extract complex features from the signals. Therefore, neural-network-based deep learning (DL) models which can extract features from signals automatically are more suitable in this situation. In this paper, a novel convolutional neural network (CNN) module, the multi-branch residual module with dilated convolutions (MRD module), is proposed to extract multi-scale features from the electrical signal. Then, a well-designed CNN model named MRD-CNN is presented for the supervised classification task of signal. Furthermore, for the unsupervised clustering task, the clustering variational autoencoder with MRD modules (MRD-CluVAE) is proposed. The MRD-CluVAE can extract high-quality features from signal data and output the clustering results directly. To evaluate the performance of the proposed models, comparisons among the proposed models and other baseline algorithms are carried out. The experimental results show that the MRD-CNN model achieves higher classification performance and stability, while the MRD-CluVAE has a higher clustering accuracy than other algorithms. These methods can be utilized to resolve the classification and recognition problems of spacecraft electronic load signals.

[1]  Ming Zhao,et al.  A convolutional neural network based feature learning and fault diagnosis method for the condition monitoring of gearbox , 2017 .

[2]  Qiang Zhang,et al.  Classification of ECG signals based on 1D convolution neural network , 2017, 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom).

[3]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[4]  Matthew Daigle,et al.  Adaptation of an Electrochemistry-based Li-Ion Battery Model to Account for Deterioration Observed Under Randomized Use , 2014, Annual Conference of the PHM Society.

[5]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[6]  Pierre Baldi,et al.  Understanding Dropout , 2013, NIPS.

[7]  Yang Li,et al.  A Spacecraft Electrical Characteristics Multi-Label Classification Method Based on Off-Line FCM Clustering and On-Line WPSVM , 2015, PloS one.

[8]  Yu Nan,et al.  Hierarchical multi-class classification in multimodal spacecraft data using DNN and weighted support vector machine , 2017, Neurocomputing.

[9]  Jun Wang,et al.  Spacecraft electrical characteristics identification study based on offline FCM clustering and online SVM classifier , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[10]  Fei-Fei Li,et al.  Deep visual-semantic alignments for generating image descriptions , 2015, CVPR.

[11]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[12]  Lars Hertel,et al.  Approximate Inference for Deep Latent Gaussian Mixtures , 2016 .

[13]  Murray Shanahan,et al.  Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders , 2016, ArXiv.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[16]  Huachun Tan,et al.  Variational Deep Embedding: A Generative Approach to Clustering , 2016, ArXiv.

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Tim Oates,et al.  Time series classification from scratch with deep neural networks: A strong baseline , 2016, 2017 International Joint Conference on Neural Networks (IJCNN).

[20]  Hee-Jun Kang,et al.  Convolutional Neural Network Based Bearing Fault Diagnosis , 2017, ICIC.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Ali Farhadi,et al.  Unsupervised Deep Embedding for Clustering Analysis , 2015, ICML.

[23]  Xudong Cao,et al.  A practical theory for designing very deep convolutional neural networks , 2015 .

[24]  Ole Winther,et al.  How to Train Deep Variational Autoencoders and Probabilistic Ladder Networks , 2016, ICML 2016.

[25]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[26]  Dechang Pi,et al.  A data-driven method of health monitoring for spacecraft , 2018 .

[27]  Guang Wu,et al.  f-VAEs: Improve VAEs with Conditional Flows , 2018, ArXiv.

[28]  Houshang Darabi,et al.  LSTM Fully Convolutional Networks for Time Series Classification , 2017, IEEE Access.

[29]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[30]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[31]  Jianlin Su Variational Inference: A Unified Framework of Generative Models and Some Revelations , 2018, ArXiv.

[32]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[33]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Nan Yu,et al.  Multi-label spacecraft electrical signal classification method based on DBN and random forest , 2017, PloS one.

[36]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[37]  Levent Eren,et al.  Bearing Fault Detection by One-Dimensional Convolutional Neural Networks , 2017 .