Implementation of Human Action Recognition System Using Multiple Kinect Sensors

Human action recognition is an important research topic that has many potential applications such as video surveillance, human-computer interaction and virtual reality combat training. However, many researches of human action recognition have been performed in single camera system, and has low performance due to vulnerability to partial occlusion. In this paper, we propose a human action recognition system using multiple Kinect sensors to overcome the limitation of conventional single camera based human action recognition system. To test feasibility of the proposed system, we use the snapshot and temporal features which are extracted from three-dimensional (3D) skeleton data sequences, and apply the support vector machine (SVM) for classification of human action. The experiment results demonstrate the feasibility of the proposed system.

[1]  Bingbing Ni,et al.  RGBD-HuDaAct: A color-depth video database for human daily activity recognition , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[2]  Yu-Ting Su,et al.  Single/multi-view human action recognition via regularized multi-task learning , 2015, Neurocomputing.

[3]  Qi Tian,et al.  Human Daily Action Analysis with Multi-view and Color-Depth Data , 2012, ECCV Workshops.

[4]  Junghwan Kim,et al.  Implementation of an Omnidirectional Human Motion Capture System Using Multiple Kinect Sensors , 2015, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[5]  Marcus A. Magnor,et al.  Markerless Motion Capture using multiple Color-Depth Sensors , 2011, VMV.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Emanuela Haller,et al.  Human Activity Recognition Based on Multiple Kinects , 2013, EvAAL.

[8]  Lan Li,et al.  Human Action Recognition Using Maximum Temporal Inter-Class Dissimilarity , 2014 .

[9]  Toby Howard,et al.  Real-Time Markerless Human Body Tracking with 3-D Voxel Reconstruction , 2004, BMVC.

[10]  Stefan Wermter,et al.  Human Action Recognition with Hierarchical Growing Neural Gas Learning , 2014, ICANN.

[11]  Petros Daras,et al.  Real-Time Skeleton-Tracking-Based Human Action Recognition Using Kinect Data , 2014, MMM.

[12]  Michele Tansella,et al.  Brain Morphometry by Probabilistic Latent Semantic Analysis , 2010, MICCAI.

[13]  Ramakant Nevatia,et al.  Single View Human Action Recognition using Key Pose Matching and Viterbi Path Searching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.