Towards discovery of event correlation rules

For large installations, event management is critical to ensuring service quality by responding rapidly to exceptional situations. The key to this is having experts encode their knowledge (e.g., in rules, state machines, codebooks) about the relationship between event patterns and actions to take. Unfortunately, doing so is time-consuming and knowledge-intensive. We propose reducing this burden by using offline decision support consisting of visualizing and mining event histories to discover patterns in event data. Our experience with a wide variety of production data has identified several patterns of interest such as, event bursts and partial periodicities. Herein, we use production data to illustrate how to visualize and mine event patterns, and we describe a tool we have developed to aid in pattern discovery.

[1]  David A. Rabenhorst.  Interactive exploration of multidimensional data , 1994, Electronic Imaging.

[2]  Joseph L. Hellerstein,et al.  Scalable Visualization of Event Data , 2000, DSOM.

[3]  T. J. Watson,et al.  Ordering Categorical Data to Improve VisualizationSheng , 1999 .

[4]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[5]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[6]  D. Ohsie,et al.  High speed and robust event correlation , 1996, IEEE Commun. Mag..

[7]  Jaideep Srivastava,et al.  Web mining: information and pattern discovery on the World Wide Web , 1997, Proceedings Ninth IEEE International Conference on Tools with Artificial Intelligence.

[8]  S. Weiss,et al.  Predicting defects in disk drive manufacturing: A case study in high-dimensional classification , 1993, Proceedings of 9th IEEE Conference on Artificial Intelligence for Applications.

[9]  Joseph L. Hellerstein,et al.  YES/MVS and the Automation of Operations for Large Computer Complexes , 1986, IBM Syst. J..

[10]  Joseph L. Hellerstein,et al.  EventBrowser: A Flexible Tool for Scalable Analysis of Event Data , 1999, DSOM.

[11]  Ramakrishnan Srikant,et al.  Fast algorithms for mining association rules , 1998, VLDB 1998.

[12]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[13]  Chidanand Apté,et al.  Predicting Equity Returns from Securities Data with Minimal Rule Generation , 1994, KDD Workshop.