Semi-automatic Recognition of Human Activities under Variable Lighting

A novel method is proposed for activity recognition on different lighting conditions. It takes the advantage of Harris and Harris Laplace operators of capturing information in spite of extreme changing lighting conditions. They locate corners along the human body with the assistance of a human operator. Corners are followed through the images to generate a set of trajectories that represent the behavior of the human body. The method shows its effectiveness recognizing behaviors by a comparison procedure based on dynamic time warping. We present examples of recognized activities under changing lighting.

[1]  Luc Van Gool,et al.  Exploiting simple hierarchies for unsupervised human behavior analysis , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[3]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[4]  Yang Wang,et al.  Human Action Recognition by Semilatent Topic Models , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Itaru Nagayama,et al.  A Method for Automatic Detection of Crimes for Public Security by Using Motion Analysis , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[6]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[7]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[8]  Mubarak Shah,et al.  Human Action Recognition in Videos Using Kinematic Features and Multiple Instance Learning , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Cordelia Schmid,et al.  An Affine Invariant Interest Point Detector , 2002, ECCV.

[10]  Suresh Venkatasubramanian,et al.  Curve Matching, Time Warping, and Light Fields: New Algorithms for Computing Similarity between Curves , 2007, Journal of Mathematical Imaging and Vision.

[11]  Xi Chen,et al.  Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Pau Baiget,et al.  Natural Language Descriptions of Human Behavior from Video Sequences , 2007, KI.

[13]  Peter H. N. de With,et al.  Flexible Human Behavior Analysis Framework for Video Surveillance Applications , 2010, Int. J. Digit. Multim. Broadcast..

[14]  Pau Baiget.  Modeling Human Behavior for Image Sequence Understanding and Generation , 2009 .

[15]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.