PatchX: Explaining Deep Models by Intelligible Pattern Patches for Time-series Classification

Classification of time-series data is pivotal for a wide range of applications and comes with many challenges. Although the amount of publicly available datasets increases rapidly, deep neural models are only partially exploited in contrast to the traditional methods. These methods get preferred in safety-critical, financial, or medical fields because of their interpretable results. However, their performance and scalability are limited, and finding suitable explanations for time-series classification tasks is challenging due to the intrinsic nature of concealed concepts in the time-series data. Visual analysis of complete time-series comes with an extensive cognitive overload, as it is difficult to perceive and leads to confusion. Therefore, we believe that patch-wise processing of the data results in a more interpretable representation. To bridge this gap, and to reduce the cognitive overload for interpretation of time series data, we propose a novel hybrid approach that utilizes deep neural networks and traditional machine learning algorithms for an interpretable and scale-able time-series classification approach. Both quantitively and qualitatively PatchX shows superiority to its counterparts with an edge of interoperability.

[1]  Johannes Schneider,et al.  Explaining Neural Networks by Decoding Layer Activations , 2020, IDA.

[2]  Shoaib Ahmed Siddiqui,et al.  TSInsight: A local-global attribution framework for interpretability in time-series data , 2020, ArXiv.

[3]  Eric D. Ragan,et al.  A Multidisciplinary Survey and Framework for Design and Evaluation of Explainable AI Systems , 2018, ACM Trans. Interact. Intell. Syst..

[4]  Shoaib Ahmed Siddiqui,et al.  Interpreting Deep Models through the Lens of Data , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[5]  Andreas Dengel,et al.  P2ExNet: Patch-based Prototype Explanation Network , 2020, ICONIP.

[6]  Catherine Achard,et al.  Explaining Regression Based Neural Network Model , 2020, ArXiv.

[7]  Feature Extraction and Image Processing for Computer Vision , 2020 .

[8]  Len Feremans,et al.  Pattern-Based Anomaly Detection in Mixed-Type Time Series , 2019, ECML/PKDD.

[9]  Daniel A. Keim,et al.  Towards A Rigorous Evaluation Of XAI Methods On Time Series , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[10]  David Paydarfar,et al.  Explaining Deep Classification of Time-Series Data with Learned Prototypes , 2019, KHD@IJCAI.

[11]  Eamonn J. Keogh,et al.  The UCR time series archive , 2018, IEEE/CAA Journal of Automatica Sinica.

[12]  Andreas Dengel,et al.  TSViz: Demystification of Deep Learning Models for Time-Series Analysis , 2018, IEEE Access.

[13]  Eric D. Ragan,et al.  A Survey of Evaluation Methods and Measures for Interpretable Machine Learning , 2018, ArXiv.

[14]  Dong Wang,et al.  Learning to Navigate for Fine-grained Classification , 2018, ECCV.

[15]  Andreas W. Kempa-Liehr,et al.  Time Series FeatuRe Extraction on basis of Scalable Hypothesis tests (tsfresh - A Python package) , 2018, Neurocomputing.

[16]  Tommi S. Jaakkola,et al.  Towards Robust Interpretability with Self-Explaining Neural Networks , 2018, NeurIPS.

[17]  Eamonn J. Keogh,et al.  Speeding up similarity search under dynamic time warping by pruning unpromising alignments , 2018, Data Mining and Knowledge Discovery.

[18]  Quanshi Zhang,et al.  Visual interpretability for deep learning: a survey , 2018, Frontiers of Information Technology & Electronic Engineering.

[19]  Jeffrey Dean,et al.  Scalable and accurate deep learning with electronic health records , 2018, npj Digital Medicine.

[20]  Andrea Vedaldi,et al.  Net2Vec: Quantifying and Explaining How Concepts are Encoded by Filters in Deep Neural Networks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Martin Wattenberg,et al.  Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV) , 2017, ICML.

[22]  Quanshi Zhang,et al.  Interpretable Convolutional Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Matteo Terzi,et al.  Time-Series Classification Methods: Review and Applications to Power Systems Data , 2018 .

[24]  Jessica Lin,et al.  Linear Time Complexity Time Series Classification with Bag-of-Pattern-Features , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[25]  Hayit Greenspan,et al.  Modeling the Intra-class Variability for Liver Lesion Detection Using a Multi-class Patch-Based CNN , 2017, Patch-MI@MICCAI.

[26]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[27]  John F. Canny,et al.  Interpretable Learning for Self-Driving Cars by Visualizing Causal Attention , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[28]  John Cristian Borges Gamboa,et al.  Deep Learning for Time-Series Analysis , 2017, ArXiv.

[29]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Eamonn J. Keogh,et al.  The great time series classification bake off: a review and experimental evaluation of recent algorithmic advances , 2016, Data Mining and Knowledge Discovery.

[31]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[32]  Joel H. Saltz,et al.  Patch-Based Convolutional Neural Network for Whole Slide Tissue Image Classification , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Amy Loutfi,et al.  A review of unsupervised feature learning and deep learning for time-series modeling , 2014, Pattern Recognit. Lett..

[34]  Mohamed F. Ghalwash,et al.  Extraction of Interpretable Multivariate Patterns for Early Diagnostics , 2013, 2013 IEEE 13th International Conference on Data Mining.

[35]  Philip S. Yu,et al.  Extracting Interpretable Features for Early Classification on Time Series , 2011, SDM.

[36]  Jason Weston,et al.  Natural Language Processing (Almost) from Scratch , 2011, J. Mach. Learn. Res..

[37]  Eamonn J. Keogh,et al.  Time series shapelets: a novel technique that allows accurate, interpretable and fast classification , 2010, Data Mining and Knowledge Discovery.

[38]  Nuno Constantino Castro,et al.  Time Series Data Mining , 2009, Encyclopedia of Database Systems.

[39]  Xindong Wu,et al.  10 Challenging Problems in Data Mining Research , 2006, Int. J. Inf. Technol. Decis. Mak..

[40]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[41]  Mehdi Dastani,et al.  The Role of Visual Perception in Data Visualization , 2002, J. Vis. Lang. Comput..

[42]  Pierre Geurts,et al.  Pattern Extraction for Time Series Classification , 2001, PKDD.