Human activity recognition using shape moments and normalized fourier descriptors

This paper presents a video based system for recognizing different continuous human activities in real time using a single stationary camera. The proposed system has a motion descriptor that contains shape moments as well as normalized Fourier descriptors. The main idea of this system is to detect moving objects in each frame and associate the detections to the same object over time. We employ an efficient thresholding technique to segment the objects of interest. The second stage of the proposed system is to extract the object features. The first feature part is constructed by extracting the object contour and estimate its normalized Fourier descriptors. The other part is extracted by the shape moments. We combined the shape moments to produce an invariant feature that is invariant to rotation, translation and scaling. We adopt the multi-class support vector machines (SVM) and Naive Bayes classifiers. The multi-class SVM shows better performance than the other method with a recognition rate up to 94.46%. We evaluated activity recognition on 325 videos of thirteen distinct Human activities (e.g., Walking, Running, Jumping, Hand-waving, Bending and some suspicious activities like Kicking, Punching, Fall floor and shooting gun, etc.) recorded for 260 different persons. Experimental results on three data set Weizman, KTH and HMDB validate the proposed system reliability and efficiency.

[1]  Ronen Basri,et al.  Actions as space-time shapes , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[2]  Barbara Caputo,et al.  Recognizing human actions: a local SVM approach , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[3]  Jianpei Zhang,et al.  An Improved Hierarchical Multi-class Support Vector Machine with Binary Tree Architecture , 2008, 2008 International Conference on Internet Computing in Science and Engineering.

[4]  Ronen Basri,et al.  Actions as Space-Time Shapes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[6]  Laurent Mascarilla,et al.  Action recognition in videos using frequency analysis of critical point trajectories , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[7]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.