Hand gesture recognition using saliency and histogram intersection kernel based sparse representation

Nowadays, sparse representation classification (SRC) has been widely applied in various computer vision areas such as face recognition. However, few researchers have applied SRC in static hand gesture recognition. In our paper, we propose to employ saliency based feature and sparse representation for hand gesture recognition and make in-depth researches in sparsity term parameter and sparse coefficient computation. In addition, literatures show that SRC can not deal with non-linear features well and may produce bad recognition results, so we propose to employ histogram intersection kernel function to map the original features into kernel feature space and use sparse representation classification in the kernel feature space. Furthermore, we compare SR with Support Vector Machine (SVM), Artificial Neural Networks (ANN), Bayesian Network (BN) and Decision Tree (DT). At last, experimental results show that the recognition rate obtained using l1ls_featuresign algorithm has a higher recognition rate than that of l1_ls algorithm and Sparse Representation outperforms all other classifiers compared. In addition, the performance comparison on different kernel functions and different features is also conducted. The average recognition rate of saliency based feature on histogram intersection kernel is 98.91 %, indicating the effectiveness of the proposed saliency based feature and the histogram intersection kernel.

[1]  Zhi Quan Feng,et al.  A Gesture Recognition Algorithm Using Hausdorff-Like Distance Template Matching Based on the Main Direction of Gesture , 2015 .

[2]  Baoxin Li,et al.  Discriminative K-SVD for dictionary learning in face recognition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[5]  Rajat Raina,et al.  Efficient sparse coding algorithms , 2006, NIPS.

[6]  Yale Song,et al.  Tracking body and hands for gesture recognition: NATOPS aircraft handling signals database , 2011, Face and Gesture 2011.

[7]  Yi Li,et al.  Learning shift-invariant sparse representation of actions , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Panagiotis Tsakalides,et al.  Sparse representations for hand gesture recognition , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Agnès Just,et al.  Hand Posture Classification and Recognition using the Modified Census Transform , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[10]  Xilin Chen,et al.  Hand Posture Recognition from Disparity Cost Map , 2012, ACCV.

[11]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[12]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[13]  Heung-Il Suk,et al.  Hand gesture recognition based on dynamic Bayesian network framework , 2010, Pattern Recognit..

[14]  Liang-Tien Chia,et al.  Sparse Representation With Kernels , 2013, IEEE Transactions on Image Processing.

[15]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[16]  Lijun Yin,et al.  Multi-scale Topological Features for Hand Posture Representation and Analysis , 2013, 2013 IEEE International Conference on Computer Vision.

[17]  Du Tran,et al.  Human Activity Recognition with Metric Learning , 2008, ECCV.

[18]  Nicolas D. Georganas,et al.  Real-Time Hand Gesture Detection and Recognition Using Bag-of-Features and Support Vector Machine Techniques , 2011, IEEE Transactions on Instrumentation and Measurement.

[19]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[20]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[21]  黄伟,et al.  Multi-scale Global Regional Contrast based Salient Region Detection , 2014 .

[22]  Zhiyuan Li,et al.  Sparse Representation for Kinect Based Hand Gesture Recognition System , 2013 .

[23]  Ting Wang,et al.  Kernel Sparse Representation-Based Classifier , 2012, IEEE Transactions on Signal Processing.

[24]  Benjamin Klein,et al.  Discriminative Ferns Ensemble for Hand Pose Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Lale Akarun,et al.  Hand Pose Estimation and Hand Shape Classification Using Multi-layered Randomized Decision Forests , 2012, ECCV.

[26]  Kai Liu,et al.  Kernel-based sparse representation for gesture recognition , 2013, Pattern Recognit..