Improving Activity Recognitionby Segmental Pattern Mining

Activity recognition is a key task for the development of advanced and effective ubiquitous applications in fields like ambient assisted living. A major problem in designing effective recognition algorithms is the difficulty of incorporating long-range dependencies between distant time instants without incurring substantial increase in computational complexity of inference. In this paper we present a novel approach for introducing long-range interactions based on sequential pattern mining. The algorithm searches for patterns characterizing time segments during which the same activity is performed. A probabilistic model is learned to represent the distribution of pattern matches along sequences, trying to maximize the coverage of an activity segment by a pattern match. The model is integrated in a segmental labeling algorithm and applied to novel sequences, tagged according to matches of the extracted patterns. The rationale of the approach is that restricting dependencies to span the same activity segment (i.e., sharing the same label), allows keeping inference tractable. An experimental evaluation shows that enriching sensor-based representations with the mined patterns allows improving results over sequential and segmental labeling algorithms in most of the cases. An analysis of the discovered patterns highlights non-trivial interactions spanning over a significant time horizon.

[1]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[2]  Lawrence B. Holder,et al.  Discovering Activities to Recognize and Track in a Smart Environment , 2011, IEEE Transactions on Knowledge and Data Engineering.

[3]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[4]  Emmanuel,et al.  Activity recognition in the home setting using simple and ubiquitous sensors , 2003 .

[5]  S. Katz,et al.  Progress in development of the index of ADL. , 1970, The Gerontologist.

[6]  Archan Misra,et al.  SAMMPLE: Detecting Semantic Indoor Activities in Practical Settings Using Locomotive Signatures , 2012, 2012 16th International Symposium on Wearable Computers.

[7]  Nizar R. Mabroukeh,et al.  A taxonomy of sequential pattern mining algorithms , 2010, CSUR.

[8]  Hayato Yamana,et al.  Generalized Sequential Pattern Mining with Item Intervals , 2006, J. Comput..

[9]  Jian Lu,et al.  Mining Emerging Patterns for recognizing activities of multiple users in pervasive computing , 2009, 2009 6th Annual International Mobile and Ubiquitous Systems: Networking & Services, MobiQuitous.

[10]  Xindong Wu,et al.  Mining Complex Patterns across Sequences with Gap Requirements , 2007, IJCAI.

[11]  B. Reisberg,et al.  The Alzheimer's Disease Activities of Daily Living International Scale (ADL-IS) , 2001, International Psychogeriatrics.

[12]  Sebastian Nowozin,et al.  Discriminative Subsequence Mining for Action Classification , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[13]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[14]  Jianyong Wang,et al.  Mining sequential patterns by pattern-growth: the PrefixSpan approach , 2004, IEEE Transactions on Knowledge and Data Engineering.

[15]  Manuela M. Veloso,et al.  Conditional random fields for activity recognition , 2007, AAMAS '07.

[16]  Andrea Passerini,et al.  Improving Activity Recognition by Segmental Pattern Mining , 2012, IEEE Transactions on Knowledge and Data Engineering.

[17]  Ramakant Nevatia,et al.  Hierarchical Multi-channel Hidden Semi Markov Models , 2007, IJCAI.

[18]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[19]  William W. Cohen,et al.  Semi-Markov Conditional Random Fields for Information Extraction , 2004, NIPS.

[20]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[21]  Ming Li,et al.  Efficient Mining of Gap-Constrained Subsequences and Its Various Applications , 2012, TKDD.

[22]  Qiang Yang,et al.  CIGAR: Concurrent and Interleaving Goal and Activity Recognition , 2008 .

[23]  Svetha Venkatesh,et al.  Efficient duration and hierarchical modeling for human activity recognition , 2009, Artif. Intell..

[24]  Youtian Du,et al.  Activity recognition through multi-scale motion detail analysis , 2008, Neurocomputing.

[25]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[26]  Ayhan Demiriz,et al.  Linear Programming Boosting via Column Generation , 2002, Machine Learning.

[27]  Albert Ali Salah,et al.  T-Patterns Revisited: Mining for Temporal Patterns in Sensor Data , 2010, Sensors.

[28]  Young-Koo Lee,et al.  Using Sensor Sequences for Activity Recognition by Mining and Multi-Class Adaboost , 2010, IC-AI.

[29]  Yoram Singer,et al.  The Hierarchical Hidden Markov Model: Analysis and Applications , 1998, Machine Learning.

[30]  Gwenn Englebienne,et al.  UvA-DARE ( Digital Academic Repository ) Activity recognition using semi-Markov models on real world smart home datasets , 2010 .