Exploring Granger causality in dynamical systems modeling and performance monitoring

Data-driven approaches are becoming increasingly crucial for modeling and performance monitoring of complex dynamical systems. Such necessity stems from complex interactions among sub-systems and high dimensionality that render majority of first-principle based methods insufficient. This paper explores the capability of a recently proposed probabilistic graphical modeling technique called spatiotemporal pattern network (STPN) in capturing Granger causality among observations in a dynamical system. In this context, we introduce the notion of Granger-STPN (G-STPN) that leverages the concept of transfer entropy computed in a symbolic domain that can capture Granger causality. However, G-STPN can become significantly more computationally expensive compared to STPN while considering larger memory for a dynamical system. We numerically compare the two frameworks for a real-life anomaly detection problem involving an industrial robot platform.

[1]  Joseph F. Engelberger.  Robotics in practice :: management and applications of industrial robots , 1980 .

[2]  J. Ameen,et al.  Higherrarchical Data Mining for Unusual Sub-sequence Identifications in Time Series Processes , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[3]  Giovanni De Magistris,et al.  Spatio-Temporal Anomaly Detection for Industrial Robots through Prediction in Unsupervised Feature Space , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  K. Hlavácková-Schindler,et al.  Causality detection based on information-theoretic approaches in time series analysis , 2007 .

[5]  Asok Ray,et al.  Symbolic time series analysis via wavelet-based partitioning , 2006, Signal Process..

[6]  King-Sun Fu,et al.  A Nonparametric Partitioning Procedure for Pattern Classification , 1969, IEEE Transactions on Computers.

[7]  A. Seth,et al.  Granger causality and transfer entropy are equivalent for Gaussian variables. , 2009, Physical review letters.

[8]  Chao Liu,et al.  An Unsupervised Spatiotemporal Graphical Modeling Approach to Anomaly Detection in Distributed CPS , 2016, 2016 ACM/IEEE 7th International Conference on Cyber-Physical Systems (ICCPS).

[9]  Xinghuo Yu,et al.  An unsupervised anomaly-based detection approach for integrity attacks on SCADA systems , 2014, Comput. Secur..

[10]  Aram Galstyan,et al.  Information transfer in social media , 2011, WWW.

[11]  Jamal Ameen,et al.  UNUSUAL SUB-SEQUENCE IDENTIFICATIONS IN TIME SERIES WITH PERIODICITY , 2007 .

[12]  Hongmin Wu,et al.  Robot introspection with Bayesian nonparametric vector autoregressive hidden Markov models , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[13]  Mario Ragwitz,et al.  Markov models from data by simple nonlinear time series predictors in delay embedding spaces. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[14]  Paul Levi,et al.  A Novel Framework for Anomaly Detection of Robot Behaviors , 2015, J. Intell. Robotic Syst..

[15]  K. Schindlerova,et al.  Equivalence of Granger Causalityand Transfer Entropy: A Generalization. , 2011 .

[16]  T. Bossomaier,et al.  Transfer entropy as a log-likelihood ratio. , 2012, Physical review letters.

[17]  C. Granger.  Causality, cointegration, and control , 1988 .

[18]  Chao Liu,et al.  Energy prediction using spatiotemporal pattern networks , 2017 .

[19]  Soumik Sarkar,et al.  Understanding Wind Turbine Interactions Using Spatiotemporal Pattern Network , 2015 .

[20]  S. Bressler,et al.  Beta oscillations in a large-scale sensorimotor cortical network: directional influences revealed by Granger causality. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Kushal Mukherjee,et al.  Symbolic Dynamic Analysis of Transient Time Series for Fault Detection in Gas Turbine Engines , 2013 .

[22]  Carlos Balaguer,et al.  Cryptobotics: Why Robots Need Cyber Safety , 2015, Front. Robot. AI.

[23]  Si-Zhao Joe Qin,et al.  Survey on data-driven industrial process monitoring and diagnosis , 2012, Annu. Rev. Control..

[24]  Peng Liu,et al.  Exploiting Physical Dynamics to Detect Actuator and Sensor Attacks in Mobile Robots , 2017, ArXiv.

[25]  R Hegger,et al.  Improved false nearest neighbor method to detect determinism in time series data. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  F. Takens.  Detecting strange attractors in turbulence , 1981 .

[27]  Khashayar Khorasani,et al.  Computationally intelligent strategies for robust fault detection, isolation, and identification of mobile robots , 2016, Neurocomputing.

[28]  Jamal Ameen,et al.  Mining Time Series for Identifying Unusual Sub-sequences with Applications , 2006, First International Conference on Innovative Computing, Information and Control - Volume I (ICICIC'06).

[29]  Geoffrey E. Hinton.  A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[30]  Alin Albu-Schäffer,et al.  The KUKA-DLR Lightweight Robot arm - a new reference platform for robotics research and manufacturing , 2010, ISR/ROBOTIK.

[31]  M. Darianian,et al.  Smart Home Mobile RFID-Based Internet-of-Things Systems and Services , 2008, 2008 International Conference on Advanced Computer Theory and Engineering.

[32]  Oliver Niggemann,et al.  A stochastic method for the detection of anomalous energy consumption in hybrid industrial systems , 2013, 2013 11th IEEE International Conference on Industrial Informatics (INDIN).

[33]  Asok Ray,et al.  Sensor Fusion for Fault Detection and Classification in Distributed Physical Processes , 2014, Front. Robot. AI.

[34]  A. Wald.  Tests of statistical hypotheses concerning several parameters when the number of observations is large , 1943 .

[35]  Jerome H. Friedman,et al.  A Recursive Partitioning Decision Rule for Nonparametric Classification , 1977, IEEE Transactions on Computers.

[36]  Justin Bayer,et al.  Variational Inference for On-line Anomaly Detection in High-Dimensional Time Series , 2016, ArXiv.

[37]  Hongmin Wu,et al.  Anytime, Anywhere Anomaly Recovery through an Online Robot Introspection Framework , 2017, ArXiv.

[38]  Tom Chau,et al.  Marginal Maximum Entropy Partitioning Yields Asymptotically Consistent Probability Density Functions , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Chao Liu,et al.  Multivariate exploration of non-intrusive load monitoring via spatiotemporal pattern network , 2018 .

[40]  Argimiro Arratia,et al.  Towards a sharp estimation of transfer entropy for identifying causality in financial time series , 2016, MIDAS@PKDD/ECML.

[41]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[42]  Chao Liu,et al.  Data-driven root-cause analysis for distributed system anomalies , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[43]  P. Billingsley,et al.  Ergodic theory and information , 1966 .

[44]  Erwin Prassler,et al.  KUKA youBot - a mobile manipulator for research and education , 2011, 2011 IEEE International Conference on Robotics and Automation.

[45]  Chao Liu,et al.  An unsupervised anomaly detection approach using energy-based spatiotemporal graphical modeling , 2017 .

[46]  Ping Zhang,et al.  A comparison study of basic data-driven fault diagnosis and process monitoring methods on the benchmark Tennessee Eastman process , 2012 .

[47]  E. Guizzo,et al.  The rise of the robot worker , 2012, IEEE Spectrum.

[48]  Andrea Maria Zanchettin,et al.  An Experimental Security Analysis of an Industrial Robot Controller , 2017, 2017 IEEE Symposium on Security and Privacy (SP).

[49]  T. Severini.  Likelihood Methods in Statistics , 2001 .

[50]  Steven L. Bressler,et al.  Wiener–Granger Causality: A well established methodology , 2011, NeuroImage.

[51]  T. Dimpfl,et al.  Using Transfer Entropy to Measure Information Flows Between Financial Markets , 2013 .

[52]  Matthäus Staniek,et al.  Symbolic transfer entropy. , 2008, Physical review letters.

[53]  Oliver Niggemann,et al.  Detecting anomalous energy consumptions in distributed manufacturing systems , 2012, IEEE 10th International Conference on Industrial Informatics.

[54]  Gordon Pipa,et al.  Transfer entropy—a model-free measure of effective connectivity for the neurosciences , 2010, Journal of Computational Neuroscience.

[55]  R. Olshen,et al.  Asymptotically Efficient Solutions to the Classification Problem , 1978 .

[56]  Matthew B Kennel,et al.  Estimating good discrete partitions from observed data: symbolic false nearest neighbors. , 2003, Physical review letters.

[57]  Charles C. Kemp,et al.  Multimodal execution monitoring for anomaly detection during robot manipulation , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[58]  Lino Marques,et al.  Robots for Environmental Monitoring: Significant Advancements and Applications , 2012, IEEE Robotics & Automation Magazine.