Classification of Skeletal Wireframe Representation of Hand Gesture Using Complex-Valued Neural Network

Complex-valued neural networks (CVNNs), that allow processing complex-valued data directly, have been applied to a number of practical applications, especially in signal and image processing. In this paper, we apply CVNN as a classification algorithm for the skeletal wireframe data that are generated from hand gestures. A CVNN having one hidden layer that maps complex-valued input to real-valued output was used, a training algorithm based on Levenberg Marquardt algorithm (CLMA) was derived, and a task to recognize 26 different gestures that represent English alphabet was given. The initial image processing part consists of three modules: real-time hand tracking, hand-skeletal construction, and hand gesture recognition. We have achieved; (1) efficient and accurate gesture extraction and representation in complex domain, (2) training of the CVNN utilising CLMA, and (3) providing a proof of the superiority of the aforementioned methods by utilising complex-valued learning vector quantization. A comparison with real-valued neural network shows that a CVNN with CLMA provides higher recognition performance, accompanied by significantly faster training. Moreover, a comparison of six different activation functions was performed and their utility is argued.

[1]  Harry L. Van Trees,et al.  Optimum Array Processing: Part IV of Detection, Estimation, and Modulation Theory , 2002 .

[2]  H. V. Trees.  Detection, Estimation, And Modulation Theory , 2001 .

[3]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[4]  Cris Koutsougeras,et al.  Complex domain backpropagation , 1992 .

[5]  Teuvo Kohonen,et al.  Learning vector quantization , 1998 .

[6]  Kazuyuki Murase,et al.  Single-layered complex-valued neural network for real-valued classification problems , 2009, Neurocomputing.

[7]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[8]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[9]  Tülay Adali,et al.  Approximation by Fully Complex Multilayer Perceptrons , 2003, Neural Computation.

[10]  Ronald H. Perrott,et al.  An improved parallel thinning algorithm , 1987, CACM.

[11]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[12]  Wen-Hsiang Tsai,et al.  A Single-Layer Neural Network for Parallel Thinning , 1992, Int. J. Neural Syst..

[13]  Akira Hirose.  Fractal variation of attractors in complex-valued neural networks , 2006, Neural Processing Letters.

[14]  Darko Kirovski,et al.  Real-time classification of dance gestures from skeleton animation , 2011, SCA '11.

[15]  Akira Hirose,et al.  Complex-Valued Neural Networks (Studies in Computational Intelligence) , 2006 .

[16]  Gordon L. Stuber,et al.  Principles of mobile communication (2nd ed.) , 2001 .

[17]  Araceli Sanchis,et al.  A Skeletonizing Reconfigurable Self-Organizing Model: Validation Through Text Recognition , 2011, Neural Processing Letters.

[18]  Lei Huang,et al.  An improved parallel thinning algorithm , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[19]  Harry L. Van Trees,et al.  Optimum Array Processing , 2002 .

[20]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[21]  Kazuyuki Murase,et al.  Real-Time Hand Gesture Recognition Using Complex-Valued Neural Network (CVNN) , 2011, ICONIP.

[22]  Nicolas Le Bihan,et al.  Polarized Signal Classification by Complex and quaternionic Multi-Layer Perceptrons , 2008, Int. J. Neural Syst..

[23]  Carl W. Helstrom,et al.  Elements of signal detection and estimation , 1994 .

[24]  V D Calhoun,et al.  Independent component analysis of fMRI data in the complex domain , 2002, Magnetic resonance in medicine.

[25]  Kazuyuki Murase,et al.  Wirtinger Calculus Based Gradient Descent and Levenberg-Marquardt Learning Algorithms in Complex-Valued Neural Networks , 2011, ICONIP.