3-Dimensional Motion Recognition by 4-Dimensional Higher-order Local Auto-correlation

In this paper, we propose a 4-Dimensional Higher-order Local Auto-Correlation (4D HLAC). The method aims to extract the features of a 3D time series, which is regarded as a 4D static pattern. This is an orthodox extension of the original HLAC, which represents correlations among local values in 2D images and can effectively summarize motion in 3D space. To recognize motion in the real world, a recognition system should exploit motion information from the real-world structure. The 4D HLAC feature vector is expected to capture representations for general 3D motion recognition, because the original HLAC performed very well in image recognition tasks. Based on experimental results showing high recognition performance and low computational cost, we conclude that our method has a strong advantage for 3D time series recognition, even in practical situations.

[1]  Pascal Fua,et al.  Making Action Recognition Robust to Occlusions and Viewpoint Changes , 2010, ECCV.

[2]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Rama Chellappa,et al.  Statistical analysis on Stiefel and Grassmann manifolds with applications in computer vision , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Pinar Duygulu Sahin,et al.  A new pose-based representation for recognizing actions from multiple cameras , 2011, Comput. Vis. Image Underst..

[5]  V. Ramasubramanian,et al.  Towards fast, view-invariant human action recognition , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Thomas B. Moeslund,et al.  A Local 3-D Motion Descriptor for Multi-View Human Action Recognition from 4-D Spatio-Temporal Interest Points , 2012, IEEE Journal of Selected Topics in Signal Processing.

[7]  Francisco Javier Ferrández Pastor,et al.  A Vision-Based System for Intelligent Monitoring: Human Behaviour Analysis and Privacy by Context , 2014, Sensors.

[8]  Miguel A. Patricio,et al.  Human action recognition with sparse classification and multiple‐view learning , 2014, Expert Syst. J. Knowl. Eng..

[9]  N. Otsu,et al.  Action and simultaneous multiple-person identification using cubic higher-order local auto-correlation , 2004, ICPR 2004.

[10]  Takio Kurita,et al.  A New Scheme for Practical Flexible and Intelligent Vision Systems , 1988, MVA.

[11]  Yasuo Kuniyoshi,et al.  Partial matching of real textured 3D objects using color cubic higher-order local auto-correlation features , 2010, The Visual Computer.

[12]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[13]  Dong Xu,et al.  Action recognition using context and appearance distribution features , 2011, CVPR 2011.