Discovering action idioms bridging the gap between system-level events and human-level actions

As computing devices become more pervasive in our daily lives, effective communication between the user and the system becomes increasingly important. The ability to describe actions at a human level of abstraction is key. However, the level at which computer system events is most easily captured is often well below the level at which humans conceptualize actions. We present a sequential pattern mining approach to discovering human-level actions-action idioms - from instrumentation logs of lower-level events. To support validation by a human expert, idiom discovery is designed to maximize recall, with filtering heuristics applied to help eliminate false positives. Empirical evaluation on data from a fielded application shows the promise of the approach for the automatic discovery of action idioms.

[1]  Deborah L. McGuinness,et al.  An Intelligent Personal Assistant for Task and Time Management , 2007, AI Mag..

[2]  Karen L. Myers,et al.  Learning by Demonstration to Support Military Planning and Decision Making , 2009, IAAI.

[3]  Thomas G. Dietterich,et al.  The TaskTracer system , 2005, AAAI 2005.

[4]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[5]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[6]  Thomas G. Dietterich,et al.  Discovering frequent work procedures from resource connections , 2009, IUI.

[7]  Brad A. Myers,et al.  Six Learning Barriers in End-User Programming Systems , 2004, 2004 IEEE Symposium on Visual Languages - Human Centric Computing.

[8]  Jiawei Han,et al.  Frequent pattern mining: current status and future directions , 2007, Data Mining and Knowledge Discovery.

[9]  Philippe A. Palanque,et al.  Fusion engines for multimodal input: a survey , 2009, ICMI-MLMI '09.

[10]  Christopher D. Hundhausen,et al.  What you see is what you code: a radically dynamic algorithm visualization development model for novice learners , 2005, 2005 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC'05).

[11]  Jian Pei,et al.  Mining sequential patterns with constraints in large databases , 2002, CIKM '02.

[12]  Boudewijn F. van Dongen,et al.  Workflow mining: A survey of issues and approaches , 2003, Data Knowl. Eng..

[13]  Charles Elkan,et al.  Fitting a Mixture Model By Expectation Maximization To Discover Motifs In Biopolymer , 1994, ISMB.

[14]  Dimitrios I. Fotiadis,et al.  Greedy mixture learning for multiple motif discovery in biological sequences , 2003, Bioinform..

[15]  Henry A. Kautz,et al.  Inferring High-Level Behavior from Low-Level Sensors , 2003, UbiComp.

[16]  Alfred V. Aho,et al.  Efficient string matching , 1975, Commun. ACM.