Recognizing Complex Activities by a Probabilistic Interval-Based Model

A key challenge in complex activity recognition is the fact that a complex activity can often be performed in several different ways, with each consisting of its own configuration of atomic actions and their temporal dependencies. This leads us to define an atomic activity-based probabilistic framework that employs Allen's interval relations to represent local temporal dependencies. The framework introduces a latent variable from the Chinese Restaurant Process to explicitly characterize these unique internal configurations of a particular complex activity as a variable number of tables. It can be analytically shown that the resulting interval network satisfies the transitivity property, and as a result, all local temporal dependencies can be retained and are globally consistent. Empirical evaluations on benchmark datasets suggest our approach significantly outperforms the state-of-the-art methods.

[1]  Jane Yung-jen Hsu,et al.  Chatting Activity Recognition in Social Occasions Using Factorial Conditional Random Fields with Iterative Classification , 2008, AAAI.

[2]  Chris D. Nugent,et al.  Analyzing Activity Recognition Uncertainties in Smart Home Environments , 2015, ACM Trans. Intell. Syst. Technol..

[3]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[4]  Arkady B. Zaslavsky,et al.  Complex activity recognition using context-driven activity theory and activity signatures , 2013, ACM Trans. Comput. Hum. Interact..

[5]  Weng-Keen Wong,et al.  Physical Activity Recognition from Accelerometer Data Using a Multi-Scale Ensemble Method , 2013, IAAI.

[6]  Juan Carlos Niebles,et al.  Discriminative Hierarchical Modeling of Spatio-temporally Composable Human Activities , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Jake K. Aggarwal,et al.  Semantic Representation and Recognition of Continued and Recursive Human Activities , 2009, International Journal of Computer Vision.

[8]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[9]  J. Pitman Combinatorial Stochastic Processes , 2006 .

[10]  Henry A. Kautz,et al.  Fine-grained activity recognition by aggregating abstract object usage , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[11]  Claudio S. Pinhanez,et al.  Representation and recognition of action in interactive spaces , 1999 .

[12]  Raymond J. Mooney,et al.  Using closed captions as supervision for video activity recognition , 2010, AAAI 2010.

[13]  Tao Xiang,et al.  Identifying Rare and Subtle Behaviors: A Weakly Supervised Joint Topic Model , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Eric Horvitz,et al.  A Comparison of HMMs and Dynamic Bayesian Networks for Recognizing Office Activities , 2005, User Modeling.

[15]  David S. Rosenblum,et al.  From action to activity: Sensor-based activity recognition , 2016, Neurocomputing.

[16]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[17]  ZaslavskyArkady,et al.  Complex activity recognition using context-driven activity theory and activity signatures , 2013 .

[18]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[19]  Shie Mannor,et al.  Activity and Gait Recognition with Time-Delay Embeddings , 2010, AAAI.

[20]  T. Minka Estimating a Dirichlet distribution , 2012 .

[21]  Larry S. Davis,et al.  Multi-agent event recognition in structured scenarios , 2011, CVPR 2011.

[22]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[23]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[24]  Qiang Ji,et al.  Modeling Temporal Interactions with Interval Temporal Bayesian Networks for Complex Activity Recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Svetha Venkatesh,et al.  The Hidden Permutation Model and Location-Based Activity Recognition , 2008, AAAI.

[26]  Tanzeem Choudhury,et al.  Towards Population Scale Activity Recognition: A Framework for Handling Data Diversity , 2012, AAAI.

[27]  Alan Fern,et al.  Probabilistic event logic for interval-based event recognition , 2011, CVPR 2011.

[28]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[29]  Pearl Pu,et al.  Decomposing Activities of Daily Living to Discover Routine Clusters , 2014, AAAI.

[30]  Qiang Yang,et al.  CIGAR: Concurrent and Interleaving Goal and Activity Recognition , 2008 .

[31]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[32]  Nassir Navab,et al.  On-line Recognition of Surgical Activity for Monitoring in the Operating Room , 2008, AAAI.

[33]  A. Raftery,et al.  How Many Iterations in the Gibbs Sampler , 1991 .