Remember and transfer what you have learned - recognizing composite activities based on activity spotting

Activity recognition approaches have shown to enable good performance for a wide variety of applications. Most approaches rely on machine learning techniques requiring significant amounts of training data for each application. Consequently they have to be retrained for each new application limiting the real-world applicability of today's activity recognition methods. This paper explores the possibility to transfer learned knowledge from one application to others thereby significantly reducing the required training data for new applications. To achieve this transferability the paper proposes a new layered activity recognition approach that lends itself to transfer knowledge across applications. Besides allowing to transfer knowledge across applications this layered approach also shows improved recognition performance both of composite activities as well as of activity events.

[1]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, CVPR.

[2]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[3]  Bernt Schiele,et al.  Discovery of activity patterns using topic models , 2008 .

[4]  Nuria Oliver,et al.  HealthGear: a real-time wearable system for monitoring and analyzing physiological signals , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[5]  Paul Lukowicz,et al.  Recognizing Workshop Activity Using Body Worn Microphones and Accelerometers , 2004, Pervasive.

[6]  Dieter Fox,et al.  Location-Based Activity Recognition , 2005, KI.

[7]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[8]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[9]  H H Bülthoff,et al.  How are three-dimensional objects represented in the brain? , 1994, Cerebral cortex.

[10]  J. Gruendel,et al.  Generalized event representations: basic building blocks of cognitive development , 1981 .

[11]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Bernt Schiele,et al.  Multi Activity Recognition Based on Bodymodel-Derived Primitives , 2009, LoCA.

[13]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[14]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[15]  Gregory D. Abowd,et al.  Recognizing mimicked autistic self-stimulatory behaviors using HMMs , 2005, Ninth IEEE International Symposium on Wearable Computers (ISWC'05).

[16]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Qiang Yang,et al.  Real world activity recognition with multiple goals , 2008, UbiComp.

[18]  Bernt Schiele,et al.  Daily Routine Recognition through Activity Spotting , 2009, LoCA.

[19]  John B. Black,et al.  Scripts in memory for text , 1979, Cognitive Psychology.

[20]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[21]  David W. McDonald,et al.  Flowers or a robot army?: encouraging awareness & activity with personal, mobile displays , 2008, UbiComp.

[22]  A F Bobick,et al.  Movement, activity and action: the role of knowledge in the perception of motion. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[23]  Qiang Yang,et al.  Cross-domain activity recognition , 2009, UbiComp.

[24]  Gerhard Tröster,et al.  Recognition of User Activity Sequences Using Distributed Event Detection , 2007, EuroSSC.

[25]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[26]  Gerhard Tröster,et al.  SwimMaster: a wearable assistant for swimmer , 2009, UbiComp.

[27]  Gaetano Borriello,et al.  A Practical Approach to Recognizing Physical Activities , 2006, Pervasive.

[28]  Eric Horvitz,et al.  Layered representations for human activity recognition , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[29]  Antonio Torralba,et al.  Using the Forest to See the Trees: A Graphical Model Relating Features, Objects, and Scenes , 2003, NIPS.

[30]  M. Tarr Rotating objects to recognize them: A case study on the role of viewpoint dependency in the recognition of three-dimensional objects , 1995, Psychonomic bulletin & review.