Explaining Aviation Safety Incidents Using Deep Learned Precursors

Although aviation accidents are rare, safety incidents occur more frequently and require careful analysis for providing actionable recommendations to improve safety. Automatically analyzing safety incidents using flight data is challenging because of the absence of labels on timestep-wise events in a flight, complexity of multi-dimensional data, and lack of scalable tools to perform analysis over large number of events. In this work, we propose a precursor mining algorithm that identifies correlated patterns in multidimensional time series to explain an adverse event. Precursors are valuable to systems health and safety monitoring in explaining and forecasting anomalies. Current precursor mining methods suffer from poor scalability to high dimensional time series data and in capturing long-term memory. We propose an approach by combining multiple-instance learning (MIL) and deep recurrent neural networks (DRNN) to take advantage of MIL's ability to model weakly-supervised data and DRNN's ability to model long term memory processes, to scale well to high dimensional data and to large volumes of data using GPU parallelism. We apply the proposed method to find precursors and offer explanations to high speed exceedance safety incidents using commercial flight data.

[1]  Ashok N. Srivastava,et al.  Multiple kernel learning for heterogeneous anomaly detection: algorithm and aviation safety case study , 2010, KDD.

[2]  Weng-Keen Wong,et al.  Efficient Multi-Instance Learning for Activity Recognition from Time Series Data Using an Auto-Regressive Hidden Markov Model , 2016, ICML.

[3]  Tony X. Han,et al.  Multiple Instance Learning Convolutional Neural Networks for object recognition , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[4]  Kanishka Bhaduri,et al.  Algorithms for speeding up distance-based outlier detection , 2011, KDD.

[5]  Inseok Hwang,et al.  Flight deck human-automation issue detection via intent inference , 2014 .

[6]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[7]  Stephen D. Bay,et al.  Mining distance-based outliers in near linear time with randomization and a simple pruning rule , 2003, KDD '03.

[8]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[9]  Nikunj C. Oza,et al.  Finding Precursors to Anomalous Drop in Airspeed During a Flight's Takeoff , 2017, KDD.

[10]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[11]  Christopher V. Kopek,et al.  Anomaly Detection Using Nonnegative Matrix Factorization , 2008 .

[12]  M. Shahriar Hossain,et al.  Storytelling in entity networks to support intelligence analysts , 2012, KDD.

[13]  Jan Ramon,et al.  Multi instance neural networks , 2000, ICML 2000.

[14]  Dan Zhang,et al.  Multiple Instance Learning on Structured Data , 2011, NIPS.

[15]  Jiajun Wu,et al.  Deep multiple instance learning for image classification and auto-annotation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Nadine B. Sarter,et al.  Error Types and Related Error Detection Mechanisms in the Aviation Domain: An Analysis of Aviation Safety Reporting System Incident Reports , 2000 .

[18]  James R. Foulds,et al.  A review of multi-instance learning assumptions , 2010, The Knowledge Engineering Review.

[19]  Heng Ji,et al.  EventCube: multi-dimensional search and mining of structured and text data , 2013, KDD.

[20]  David L. Iverson Inductive System Health Monitoring , 2004, IC-AI.

[21]  Naren Ramakrishnan,et al.  Modeling Precursors for Event Forecasting via Nested Multi-Instance Learning , 2016, KDD.

[22]  Nikunj C. Oza,et al.  Discovery of Precursors to Adverse Events using Time Series Data , 2016, SDM.

[23]  Rodney Martin,et al.  ACCEPT: Introduction of the Adverse Condition and Critical Event Prediction Toolbox , 2015 .

[24]  David J. Brown,et al.  A Two-Phase Method of Detecting Abnormalities in Aircraft Flight Data and Ranking Their Impact on Individual Flights , 2012, IEEE Transactions on Intelligent Transportation Systems.

[25]  Vijay Manikandan Janakiraman,et al.  Anomaly detection in aviation data using extreme learning machines , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[26]  Nazli Ikizler-Cinbis,et al.  Using deep multiple instance learning for action recognition in still images , 2017, 2017 25th Signal Processing and Communications Applications Conference (SIU).

[27]  Artur S. d'Avila Garcez,et al.  Multi-instance learning using recurrent neural networks , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[28]  Nicolas Maille On the use of data-mining algorithms to improve FOQA tools for airlines , 2013, 2013 IEEE Aerospace Conference.