Multi-INT Complex Event Processing using Approximate, Incremental Graph Pattern Search

Abstract : Complex Event Processing, or CEP, is an event processing technique that analyzes multiple events with the goal of identifying meaningful complex events within an event cloud. CEP employs techniques such as detection of complex patterns of many events, event correlation and abstraction, computable event hierarchies, and event relationships such as causality, membership, timing, and event sequences. In this paper we present a detailed analysis of the characteristics of Multi-INT data streams from an Expeditionary and Irregular Warfare (EIW) environment. After evaluating these characteristics we propose a solution using approximate, incremental graph pattern search algorithms. Finally, we present a prototype implementation of these algorithms and a preliminary evaluation of their use and performance.

[1]  Sharma Chakravarthy,et al.  Composite Events for Active Databases: Semantics, Contexts and Detection , 1994, VLDB.

[2]  Thomas W. Reps,et al.  An Incremental Algorithm for a Generalization of the Shortest-Path Problem , 1996, J. Algorithms.

[3]  David C. Luckham,et al.  Partial orderings of event sets and their application to prototyping concurrent, timed systems , 1993, J. Syst. Softw..

[4]  Jianzhong Li,et al.  Graph pattern matching , 2010, Proc. VLDB Endow..

[5]  Li Chen,et al.  Stack-based Algorithms for Pattern Matching on DAGs , 2005, VLDB.

[6]  山口 一男.  Event-History Analysis:Its Contribution to Modeling and Causal Inference , 1987 .

[7]  Dmitri V. Kalashnikov,et al.  Modeling and querying uncertain spatial information for situational awareness applications , 2006, GIS '06.

[8]  Nenad Medvidovic,et al.  Helios : Impact Analysis for Event-Based Systems , 2009 .

[9]  Christopher Krügel,et al.  Decentralized Event Correlation for Intrusion Detection , 2001, ICISC.

[10]  Neil Immerman,et al.  On Supporting Kleene Closure over Event Streams , 2008, 2008 IEEE 24th International Conference on Data Engineering.

[11]  Lei Zou,et al.  DistanceJoin: Pattern Match Query In a Large Graph Database , 2009, Proc. VLDB Endow..

[12]  Beth Plale,et al.  Tracking Stream Provenance in Complex Event Processing Systems for Workflow-Driven Computing , 2007 .

[13]  H. Blossfeld.  Techniques of event history modeling , 1989 .

[14]  Marion G. Ceruti,et al.  Supporting C2 Research and Evaluation: An Infrastructure and its Potential Impact , 2011 .

[15]  Drew Conway,et al.  Modeling Network Evolution Using Graph Motifs , 2011, ArXiv.

[16]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[17]  Brian D. M. Tom.  Techniques of Event History Modeling: New Approaches to Causal Analysis , 2003 .

[18]  Lundy Lewis,et al.  Event Correlation in Integrated Management: Lessons Learned and Outlook , 2007, Journal of Network and Systems Management.

[19]  Carter T. Butts,et al.  4. A Relational Event Framework for Social Action , 2008 .

[20]  Nalini Venkatasubramanian,et al.  Project rescue: challenges in responding to the unexpected , 2003, IS&T/SPIE Electronic Imaging.

[21]  Christos Faloutsos,et al.  Fast best-effort pattern matching in large attributed graphs , 2007, KDD '07.

[22]  Avigdor Gal,et al.  Complex event processing over uncertain data , 2008, DEBS.

[23]  Rainer Unland,et al.  On the semantics of complex events in active database management systems , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).

[24]  T. Snijders.  Models for longitudinal network datain , 2005 .

[25]  Paulo Marques,et al.  A framework for performance evaluation of complex event processing systems , 2008, DEBS.

[26]  Ramesh Nallapati,et al.  Event threading within news topics , 2004, CIKM '04.

[27]  Ulrik Brandes,et al.  Networks Evolving Step by Step: Statistical Analysis of Dyadic Event Data , 2009, 2009 International Conference on Advances in Social Network Analysis and Mining.

[28]  Yanlei Diao,et al.  High-performance complex event processing over streams , 2006, SIGMOD Conference.

[29]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[30]  V. S. Subrahmanian,et al.  Probabilistic Subgraph Matching on Huge Social Networks , 2011, 2011 International Conference on Advances in Social Networks Analysis and Mining.

[31]  Christian Wolff,et al.  Identification of suspicious, unknown event patterns in an event cloud , 2007, DEBS '07.

[32]  David C. Luckham,et al.  Complex Event Processing in Distributed Systems , 1998 .

[33]  Johannes Gehrke,et al.  Cayuga: a high-performance event processing engine , 2007, SIGMOD '07.