Hand Gesture Recognition Based on Cascading of Multiple Features

Hand recognition using gestures is gaining high attention in the era of human computer interaction. Gestures, an aphonic body language play prominent role to convey various messages in daily communication. Hand gesture recognition is proposed based on serial cascading of multiple features, motion, location, and shape components extracted from both segmented semantic data and entire gesture sequence. Enhanced principal component analysis (PCA) extracts the motion component by analyzing space interdependency among the neighboring motion energy histogram bins. The gesture location component is extracted through particle-based weighted dynamic time wrapping (PWDTW) while spatio-temporal interest points (STIP) of possible gestures is employed for shape component extraction. The proposed system performance is evaluated with several matchers, namely, Euclidean distance, Hamming distance, Extended jaccard coefficient (EJC), least cost methods of minimum cost matcher (MCM) and optimal cost region matcher (OCRM). A low computational recognition time is observed from the experiment results when multiple gesture features are fused sequentially in contrast with single feature of hand gesture.

[1]  S. Viswanadha Raju,et al.  Multimodal Biometrics -- Sources, Architecture and Fusion Techniques: An Overview , 2012, 2012 International Symposium on Biometrics and Security Technologies.

[2]  Tanima Dutta,et al.  A Continuous Hand Gestures Recognition Technique for Human-Machine Interaction Using Accelerometer and Gyroscope Sensors , 2016, IEEE Sensors Journal.

[3]  Lu Yang,et al.  Survey on 3D Hand Gesture Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Wang Ran,et al.  Real-time visual static hand gesture recognition system and its FPGA-based hardware implementation , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[5]  Qingxiang Wu,et al.  Gesture Recognition Based on Fusion Features from Multiple Spiking Neural Networks , 2015, 2015 Fifth International Conference on Communication Systems and Network Technologies.

[6]  Yikai Wang,et al.  Real-time visual static hand gesture recognition system and its FPGA-based hardware implementation , 2014 .

[7]  B. B. V. L. Deepak,et al.  Obtaining hand gesture parameters using image processing , 2015, 2015 International Conference on Smart Technologies and Management for Computing, Communication, Controls, Energy and Materials (ICSTM).

[8]  Yang Gao,et al.  Multi-layered gesture recognition with Kinect , 2015, J. Mach. Learn. Res..

[9]  Saiful Amri Mazlan,et al.  Human gesture recognition using a low cost stereo vision in rehab activities , 2015, 2015 IEEE International Symposium on Robotics and Intelligent Sensors (IRIS).

[10]  S. Viswanadha Raju,et al.  Desisting the Fraud in India's Voting Process through Multi Modalbiometrics , 2016, 2016 IEEE 6th International Conference on Advanced Computing (IACC).

[11]  Dadet Pramadihanto,et al.  Smart presentation system using hand gestures and Indonesian speech command , 2015, 2015 International Electronics Symposium (IES).

[12]  Hiroyuki Ukida,et al.  Mobile robot operation by gesture recognition using continuous human motion , 2015, 2015 54th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).