Imbalanced Aircraft Data Anomaly Detection

Anomaly detection in temporal data from sensors under aviation scenarios is a practical but challenging task: 1) long temporal data is difficult to extract contextual information with temporal correlation; 2) the anomalous data are rare in time series, causing normal/abnormal imbalance in anomaly detection, making the detector classification degenerate or even fail. To remedy the aforementioned problems, we propose a Graphical Temporal Data Analysis (GTDA) framework. It consists three modules, named Series-to-Image (S2I), Cluster-based Resampling Approach using Euclidean Distance (CRD) and Variance-Based Loss (VBL). Specifically, for better extracts global information in temporal data from sensors, S2I converts the data to curve images to demonstrate abnormalities in data changes. CRD and VBL balance the classification to mitigate the unequal distribution of classes. CRD extracts minority samples with similar features to majority samples by clustering and over-samples them. And VBL fine-tunes the decision boundary by balancing the fitting degree of the network to each class. Ablation experiments on the Flights dataset indicate the effectiveness of CRD and VBL on precision and recall, respectively. Extensive experiments demonstrate the synergistic advantages of CRD and VBL on F1-score on Flights and three other temporal datasets.

[1]  Xingyu Li,et al.  Anomaly Detection via Reverse Distillation from One-Class Embedding , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Maoguo Gong,et al.  Audio-visual Representation Learning for Anomaly Events Detection in Crowds , 2021, ArXiv.

[3]  Lei Guo,et al.  Safety Flight Control Design of a Quadrotor UAV With Capability Analysis , 2021, IEEE Transactions on Cybernetics.

[4]  Chen Gong,et al.  Modeling Cardinality in Image Hashing , 2021, IEEE Transactions on Cybernetics.

[5]  Ashwani Kumar,et al.  AnSMart: A SVM-based anomaly detection scheme via system profiling in Smart Grids , 2021, 2021 2nd International Conference on Intelligent Engineering and Management (ICIEM).

[6]  Fang Dong,et al.  A hybrid unsupervised clustering-based anomaly detection method , 2021, Tsinghua Science and Technology.

[7]  Jinbo Li,et al.  Clustering-based anomaly detection in multivariate time series data , 2021, Appl. Soft Comput..

[8]  Xuelong Li,et al.  Looking Closer at the Scene: Multiscale Representation Learning for Remote Sensing Image Scene Classification , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Feiping Nie,et al.  Multiview Semi-Supervised Learning Model for Image Classification , 2020, IEEE Transactions on Knowledge and Data Engineering.

[10]  Mohammad Masdari,et al.  Improving security using SVM-based anomaly detection: issues and challenges , 2020, Soft Computing.

[11]  Yuan Yuan,et al.  Unsupervised Semantic Aggregation and Deformable Template Matching for Semi-Supervised Learning , 2020, NeurIPS.

[12]  Yong Wang,et al.  Joint Deployment and Task Scheduling Optimization for Large-Scale Mobile Users in Multi-UAV-Enabled Mobile Edge Computing , 2020, IEEE Transactions on Cybernetics.

[13]  Kai Chen,et al.  Seesaw Loss for Long-Tailed Instance Segmentation , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Junsong Yuan,et al.  Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentation , 2020, ACM Multimedia.

[15]  Feiping Nie,et al.  Decision Tree SVM: An extension of linear SVM for non-linear classification , 2020, Neurocomputing.

[16]  Hongsheng Li,et al.  Balanced Meta-Softmax for Long-Tailed Visual Recognition , 2020, NeurIPS.

[17]  Ankit Singh Rawat,et al.  Long-tail learning via logit adjustment , 2020, ICLR.

[18]  Steven L. Brunton,et al.  Physics-informed machine learning for sensor fault detection with flight test data , 2020, ArXiv.

[19]  Sheng Tang,et al.  Overcoming Classifier Imbalance for Long-Tail Object Detection With Balanced Group Softmax , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Simon S. Woo,et al.  OC-FakeDect: Classifying Deepfakes Using One-class Variational Autoencoder , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Yedid Hoshen,et al.  Classification-Based Anomaly Detection for General Data , 2020, ICLR.

[22]  Yan Wan,et al.  Robust Formation Control for Multiple Quadrotors With Nonlinearities and Disturbances , 2020, IEEE Transactions on Cybernetics.

[23]  Junjie Yan,et al.  Equalization Loss for Long-Tailed Object Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Hideaki Iiduka,et al.  Appropriate Learning Rates of Adaptive Learning Rate Optimization Algorithms for Training Deep Neural Networks , 2020, IEEE Transactions on Cybernetics.

[25]  Colin Wei,et al.  Learning Imbalanced Datasets with Label-Distribution-Aware Margin Loss , 2019, NeurIPS.

[26]  Cheng Cheng,et al.  A GAN-Based Anomaly Detection Approach for Imbalanced Industrial Time Series , 2019, IEEE Access.

[27]  Eamonn J. Keogh,et al.  The UCR time series archive , 2018, IEEE/CAA Journal of Automatica Sinica.

[28]  Alexander Binder,et al.  Deep One-Class Classification , 2018, ICML.

[29]  Ran El-Yaniv,et al.  Deep Anomaly Detection Using Geometric Transformations , 2018, NeurIPS.

[30]  Il Dong Yun,et al.  Residual Error Based Anomaly Detection Using Auto-Encoder in SMD Machine Sound , 2018, Sensors.

[31]  Chuan Sheng Foo,et al.  Efficient GAN-Based Anomaly Detection , 2018, ArXiv.

[32]  Charles C. Kemp,et al.  A Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder , 2017, IEEE Robotics and Automation Letters.

[33]  Washington Y. Ochieng,et al.  Integrated method for the UAV navigation sensor anomaly detection , 2017 .

[34]  Weiping Zhu,et al.  Recent Developments in Speech Enhancement in the Short-Time Fourier Transform Domain , 2016, IEEE Circuits and Systems Magazine.

[35]  Aritra Ghosh,et al.  Anomaly detection in web graphs using vertex neighbourhood based signature similarity methods , 2016, 2016 International Conference on Data Science and Engineering (ICDSE).

[36]  Xiufeng Liu,et al.  Regression-based Online Anomaly Detection for Smart Grid Data , 2016, ArXiv.

[37]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  Wen-Hsien Fang,et al.  Gaussian Process Regression-Based Video Anomaly Detection and Localization With Hierarchical Feature Representation , 2015, IEEE Transactions on Image Processing.

[39]  Taghi M. Khoshgoftaar,et al.  Using Random Undersampling to Alleviate Class Imbalance on Tweet Sentiment Data , 2015, 2015 IEEE International Conference on Information Reuse and Integration.

[40]  Tim Oates,et al.  Imaging Time-Series to Improve Classification and Imputation , 2015, IJCAI.

[41]  Piroska Haller,et al.  Data clustering-based anomaly detection in industrial control systems , 2014, 2014 IEEE 10th International Conference on Intelligent Computer Communication and Processing (ICCP).

[42]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[43]  Tomoharu Iwata,et al.  Clustering-based anomaly detection in multi-view data , 2013, CIKM.

[44]  Yue-Shi Lee,et al.  Cluster-based under-sampling approaches for imbalanced data distributions , 2009, Expert Syst. Appl..

[45]  Guofei Gu,et al.  Using an Ensemble of One-Class SVM Classifiers to Harden Payload-based Anomaly Detection Systems , 2006, Sixth International Conference on Data Mining (ICDM'06).

[46]  Hui Han,et al.  Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning , 2005, ICIC.

[47]  Huamin Jia,et al.  A Review of Multisensor Fusion Methodologies for Aircraft Navigation Systems , 2005 .

[48]  J. Kurths,et al.  Recurrence-plot-based measures of complexity and their application to heart-rate-variability data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[50]  Katharina Morik,et al.  Combining Statistical Learning with a Knowledge-Based Approach - A Case Study in Intensive Care Monitoring , 1999, ICML.

[51]  Thomas G. Dietterich.  Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[52]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[53]  H Hermansky,et al.  Perceptual linear predictive (PLP) analysis of speech. , 1990, The Journal of the Acoustical Society of America.

[54]  C. Manski,et al.  The Logit Model and Response-Based Samples , 1989 .

[55]  D. Ruelle,et al.  Recurrence Plots of Dynamical Systems , 1987 .

[56]  Xuelong Li,et al.  Learning to detect anomaly events in crowd scenes from synthetic data , 2021, Neurocomputing.

[57]  Linrang Zhang,et al.  VAE-based Deep SVDD for anomaly detection , 2021, Neurocomputing.

[58]  Kisung Seo,et al.  GAN-Based Anomaly Detection In Imbalance Problems , 2020, ECCV Workshops.

[59]  Sungzoon Cho,et al.  Variational Autoencoder based Anomaly Detection using Reconstruction Probability , 2015 .

[60]  Andreas Dengel,et al.  Histogram-based Outlier Score (HBOS): A fast Unsupervised Anomaly Detection Algorithm , 2012 .

[61]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[62]  Yue-Shi Lee,et al.  Under-Sampling Approaches for Improving Prediction of the Minority Class in an Imbalanced Dataset , 2006 .

[63]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..