An efficient method for human hand gesture detection and recognition using deep learning convolutional neural networks

The physical movement of the human hand produces gestures, and hand gesture recognition leads to the advancement in automated vehicle movement system. In this paper, the human hand gestures are detected and recognized using convolutional neural networks (CNN) classification approach. This process flow consists of hand region of interest segmentation using mask image, fingers segmentation, normalization of segmented finger image and finger recognition using CNN classifier. The hand region of the image is segmented from the whole image using mask images. The adaptive histogram equalization method is used as enhancement method for improving the contrast of each pixel in an image. In this paper, connected component analysis algorithm is used in order to segment the finger tips from hand image. The segmented finger regions from hand image are given to the CNN classification algorithm which classifies the image into various classes. The proposed hand gesture detection and recognition methodology using CNN classification approach with enhancement technique stated in this paper achieves high performance with state-of-the-art methods.

[1]  Tanatcha Chaikhumpha,et al.  Real — time two hand gesture recognition with condensation and hidden Markov models , 2018, 2018 International Workshop on Advanced Image Technology (IWAIT).

[2]  Hyuk-Jae Lee,et al.  Rotation-invariant hand posture classification with a convexity defect histogram , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[3]  Zhenbang Gong,et al.  Low Cost Hand Gesture Learning and Recognition System Based on Hidden Markov Model , 2009, 2009 Second International Symposium on Information Science and Engineering.

[4]  Ayoub Al-Hamadi,et al.  A Robust Method for Hand Gesture Segmentation and Recognition Using Forward Spotting Scheme in Conditional Random Fields , 2010, 2010 20th International Conference on Pattern Recognition.

[5]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[6]  Bülent Sankur,et al.  Shape-based hand recognition , 2006, IEEE Transactions on Image Processing.

[7]  A. Mitome,et al.  A recognition method of restricted hand shapes in still image and moving image as a man-machine interface , 2008, 2008 Conference on Human System Interactions.

[8]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[9]  Bin Chen,et al.  Effective Inertial Hand Gesture Recognition Using Particle Filtering Based Trajectory Matching , 2018, J. Electr. Comput. Eng..

[10]  Saransh Sharma,et al.  A Static Hand Gesture and Face Recognition System for Blind People , 2019, 2019 6th International Conference on Signal Processing and Integrated Networks (SPIN).

[11]  Md. Hafizur Rahman,et al.  Hand Gesture Recognition using Multiclass Support Vector Machine , 2013 .

[12]  Yuan Yao,et al.  Contour Model-Based Hand-Gesture Recognition Using the Kinect Sensor , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Sangyoun Lee,et al.  3D hand tracking using Kalman filter in depth space , 2012, EURASIP J. Adv. Signal Process..

[14]  Muhammad Abuzar Fahiem,et al.  Recognition and Translation of Hand Gestures to Urdu Alphabets Using a Geometrical Classification , 2009, 2009 Second International Conference in Visualisation.

[15]  Khurram Khurshid,et al.  Classification of Hand Gestures Using Gabor Filter with Bayesian and Naïve Bayes Classifier , 2016 .

[16]  Jhilik Bhattacharya,et al.  Real-Time Hand Gesture Detection and Recognition for Human Computer Interaction , 2016 .

[17]  Rio D’Souza,et al.  Hand Gesture Recognition using Webcam , 2017 .

[18]  Ramon Mas,et al.  Hand Tracking and Gesture Recognition for Human-Computer Interaction , 2005 .

[19]  Cheolkon Jung,et al.  SPFEMD: Super-pixel Based Finger Earth Mover’s Distance for Hand Gesture Recognition , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  S. Mitra,et al.  Gesture Recognition: A Survey , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[21]  Nasser Kehtarnavaz,et al.  Fusion of Inertial and Depth Sensor Data for Robust Hand Gesture Recognition , 2014, IEEE Sensors Journal.