Two-step learning about normal and exceptional human behaviors incorporating patterns and knowledge

Human activity recognition, especially exceptional activity recognition has been regarded as an important aspect in intelligent service robotics. Several challenges in activity recognition — unexpected and untypical exceptional behaviors, a small but growing number of training examples — make it hard to solve this problem. Despite the variety of human behaviors, there are some normal patterns, especially scenario — oriented human activities. This paper presents an incremental learning method for exceptional behavior patterns based on prerequisites. The proposed method models the normal activities as prerequisites from several demonstrations following a given scenario, and learns autonomously and incrementally new exceptional activities, which may not follow the scenario. Case studies show that the proposed method can gradually improve the recognition rate, and incrementally learn new exceptional human activities.

[1]  M. A. Bush,et al.  Training and search algorithms for an interactive wordspotting system , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[2]  Munsang Kim,et al.  Engkey: Tele-education Robot , 2011, ICSR.

[3]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  VilaLluís,et al.  A survey on temporal reasoning in artificial intelligence , 1994 .

[5]  Stefan Schaal,et al.  http://www.jstor.org/about/terms.html. JSTOR's Terms and Conditions of Use provides, in part, that unless you have obtained , 2007 .

[6]  Moritz Tenorth,et al.  Learning probability distributions over partially-ordered human everyday activities , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  Aggelos K. Katsaggelos,et al.  Abnormal Event Detection from Surveillance Video by Dynamic Hierarchical Clustering , 2007, 2007 IEEE International Conference on Image Processing.

[8]  Richard Rose,et al.  Discriminant wordspotting techniques for rejecting non-vocabulary utterances in unconstrained speech , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Sanda M. Harabagiu,et al.  Temporal Context Representation and Reasoning , 2005, IJCAI.

[10]  Takeo Kanade,et al.  Region segmentation: Signal vs semantics , 1980 .

[11]  Dana Kulic,et al.  Incremental Learning of Full Body Motion Primitives , 2010, From Motor Learning to Interaction Learning in Robots.

[12]  Gi Hyun Lim,et al.  3D object perception and perceptual learning in the RACE project , 2016, Robotics Auton. Syst..

[13]  Hans W. Guesgen,et al.  Spatial and Temporal Reasoning , 2003, AI Commun..

[14]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[15]  Gi Hyun Lim,et al.  Hierarchical Nearest Neighbor Graphs for Building Perceptual Hierarchies , 2015, ICONIP.

[16]  Il Hong Suh,et al.  Service-oriented context reasoning incorporating patterns and knowledge for understanding human-augmented situations , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[17]  Hans-Hellmut Nagel,et al.  Behavioral Knowledge Representation for the Understanding and Creation of Video Sequences , 2003, KI.

[18]  Olivier Sigaud,et al.  From Motor Learning to Interaction Learning in Robots , 2010, From Motor Learning to Interaction Learning in Robots.

[19]  Pietro Perona,et al.  Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Christopher Riesbeck,et al.  Failure-Driven Reminding for Incremental Learning , 1981, IJCAI.

[22]  Il Hong Suh,et al.  Ontology Representation and Instantiation for Semantic Map Building by a Mobile Robot , 2012, IAS.

[23]  Michel Beaudouin-Lafon,et al.  Charade: remote control of objects using free-hand gestures , 1993, CACM.

[24]  R. Oka,et al.  Spotting Recognition of Human Gestures from Motion Images , 1994 .

[25]  Bernd Neumann,et al.  On scene interpretation with description logics , 2006, Image Vis. Comput..

[26]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning: An Overview , 2001, Fundam. Informaticae.

[27]  Il Hong Suh,et al.  Ontology-Based Unified Robot Knowledge for Service Robots in Indoor Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[28]  Biing-Hwang Juang,et al.  Hidden Markov Models for Speech Recognition , 1991 .

[29]  Il Hong Suh,et al.  Recognition and incremental learning of scenario-oriented human behavior patterns by two threshold models , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).