Fine-grained activity recognition by aggregating abstract object usage

In this paper we present results related to achieving finegrained activity recognition for context-aware computing applications. We examine the advantages and challenges of reasoning with globally unique object instances detected by an RFID glove. We present a sequence of increasingly powerful probabilistic graphical models for activity recognition. We show the advantages of adding additional complexity and conclude with a model that can reason tractably about aggregated object instances and gracefully generalizes from object instances to their classes by using abstraction smoothing. We apply these models to data collected from a morning household routine.

[1]  Bernt Schiele,et al.  A model for human interruptability: experimental evaluation and automatic estimation from wearable sensors , 2004, Eighth International Symposium on Wearable Computers.

[2]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[3]  Alex Pentland,et al.  Action Reaction Learning: Automatic Visual Analysis and Synthesis of Interactive Behaviour , 1999, ICVS.

[4]  Yan Huang,et al.  Propagation networks for recognition of partially ordered sequential action , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[5]  R. Wilensky.  Planning and Understanding: A Computational Approach to Human Reasoning , 1983 .

[6]  Henry A. Kautz,et al.  Generalized Plan Recognition , 1986, AAAI.

[7]  Alex Mihailidis,et al.  The use of computer vision in an intelligent environment to support aging-in-place, safety, and independence in the home , 2004, IEEE Transactions on Information Technology in Biomedicine.

[8]  David E. Culler,et al.  Mica: A Wireless Platform for Deeply Embedded Networks , 2002, IEEE Micro.

[9]  Alex Pentland,et al.  Sensing and modeling human networks using the sociometer , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[10]  Roy Want,et al.  RFID. A key to automating everything. , 2004, Scientific American.

[11]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[12]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[13]  Pedro M. Domingos,et al.  Relational Markov models and their application to adaptive web navigation , 2002, KDD.

[14]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[15]  Kristof Van Laerhoven,et al.  Spine versus porcupine: a study in distributed wearable activity recognition , 2004, Eighth International Symposium on Wearable Computers.

[16]  Paul Lukowicz,et al.  Implementation and evaluation of a low-power sound-based user activity recognition system , 2004, Eighth International Symposium on Wearable Computers.

[17]  Mor Harchol-Balter,et al.  A Closed-Form Solution for Mapping General Distributions to Minimal PH Distributions , 2003, Computer Performance Evaluation / TOOLS.

[18]  Martha E. Pollack,et al.  Execution monitoring with quantitative temporal Bayesian networks , 2002 .

[19]  Paul Lukowicz,et al.  SoundButton: design of a low power wearable audio classification system , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[20]  Charles C. Kemp,et al.  Shoes as a platform for vision , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..