A Two-Phase Method of Detecting Abnormalities in Aircraft Flight Data and Ranking Their Impact on Individual Flights

A two-phase novelty detection approach to locating abnormalities in the descent phase of aircraft flight data is presented. It has the ability to model normal time series data by analyzing snapshots at chosen heights in the descent, weight individual abnormalities, and quantitatively assess the overall level of abnormality of a flight during the descent to a given runway. The method models normal approaches to a given runway (as determined by the airline's standard operating procedures) and detects and ranks deviations from that model. The approach expands on a recommendation by the UK Air Accident Investigation Branch to the UK Civil Aviation Authority. The first phase quantifies abnormalities at certain heights in a flight. The second phase ranks all flights to identify the most abnormal, each phase using a one-class classifier. For both the first and second phases, i.e., the support vector machine (SVM), the mixture of Gaussians and the K-means one-class classifiers are compared. The method is tested using a data set containing manually labeled abnormal flights. The results show that the SVM provides the best detection rates and that the approach identifies unseen abnormalities with a high rate of accuracy. The feature selection tool F-score is used to identify differences between the abnormal and normal data sets. It identifies the heights where the discrimination between the two sets is largest and the aircraft parameters most responsible for these variations. The method presented adds much value to the existing event-based approach.

[1]  Yilu Zhang,et al.  A Pattern-Recognition Approach for Driving Skill Characterization , 2010, IEEE Transactions on Intelligent Transportation Systems.

[2]  Eduardo J Spinosa,et al.  Support vector machines for novel class detection in Bioinformatics. , 2005, Genetics and molecular research : GMR.

[3]  Brian Litt,et al.  One-Class Novelty Detection for Seizure Analysis from Intracranial EEG , 2006, J. Mach. Learn. Res..

[4]  Ashok N. Srivastava,et al.  Anomaly Detection and Diagnosis Algorithms for Discrete Symbol Sequences with Applications to Airline Safety , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[6]  Sameer Singh,et al.  Novelty detection: a review - part 2: : neural network based approaches , 2003, Signal Process..

[7]  Honghai Liu,et al.  Analysing Flight Data Using Clustering Methods , 2008, KES.

[8]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[9]  Sameer Singh,et al.  Novelty detection: a review - part 1: statistical approaches , 2003, Signal Process..

[10]  Eric Feron,et al.  Trajectory Clustering and an Application to Airspace Monitoring , 2010, IEEE Transactions on Intelligent Transportation Systems.

[11]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Honghai Liu,et al.  Qualitative classification of descent phases in commercial flight data , 2009, Int. J. Comput. Intell. Stud..

[13]  Ashok N. Srivastava,et al.  Multiple kernel learning for heterogeneous anomaly detection: algorithm and aviation safety case study , 2010, KDD.

[14]  Yang Zhang,et al.  Support Vector Machine in Novelty Detection for Multi-channel Combustion Data , 2006, ISNN.

[15]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[17]  Yihong Gong,et al.  Driving Safety Monitoring Using Semisupervised Learning on Time Series Data , 2010, IEEE Transactions on Intelligent Transportation Systems.

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Simon J. Godsill,et al.  Detection of abrupt spectral changes using support vector machines an application to audio signal segmentation , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[20]  Laureano F. Escudero,et al.  Collision Avoidance in Air Traffic Management: A Mixed-Integer Linear Optimization Approach , 2011, IEEE Transactions on Intelligent Transportation Systems.

[21]  Sayan Mukherjee,et al.  Feature Selection for SVMs , 2000, NIPS.

[22]  Stephen G. Ritchie,et al.  Real-time hazardous traffic condition warning system: framework and evaluation , 2005, IEEE Transactions on Intelligent Transportation Systems.

[23]  David A. Clifton,et al.  A Framework for Novelty Detection in Jet Engine Vibration Data , 2007 .

[24]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[25]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[26]  Ron Kohavi,et al.  Feature Selection for Knowledge Discovery and Data Mining , 1998 .

[27]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[28]  Narendra S. Chaudhari,et al.  Bidirectional segmented-memory recurrent neural network for protein secondary structure prediction , 2006, Soft Comput..

[29]  B.G. Amidan,et al.  Atypical event and typical pattern detection within complex systems , 2005, 2005 IEEE Aerospace Conference.

[30]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[31]  G.W.H. van Es Advanced Flight Data Analysis , 2002 .