A Novel Hand Gesture Recognition Method Based on Illumination Compensation and Grayscale Adjustment

Gesture recognition is a challenging research problem in human–machine systems. Uneven illumination and background noise significantly contribute to this challenge by affecting the accuracy of hand gesture recognition algorithms. To address this challenge, this paper proposes a novel gesture recognition method based on illumination compensation and grayscale adjustment, which can significantly improve gesture recognition in uneven and backlighting conditions. The novelty of the method is in the new illumination compensation algorithm based on luminance adjustment and Gamma correction, which can reduce the luminance value in the overlit image region and enhance the area with low illumination intensity. The grayscale adjustment is used to detect the skin color and hand area accurately. The binary image of the hand gesture is extracted through iterative threshold segmentation, image dilation, and erosion process. Five gesture features including area, roundness, finger peak number, hole number, and average angle are used to recognize the input gesture. The experimental results show that the proposed method can reduce the influence of uneven illumination and effectively recognize the hand gestures. This method can be used in applications involving human–machine interactions conducted in poor lighting conditions.

[1]  Nasser Kehtarnavaz,et al.  Real-time robust vision-based hand gesture recognition using stereo images , 2013, Journal of Real-Time Image Processing.

[2]  Yi Yao,et al.  A Framework for Real-Time Hand Gesture Recognition in Uncontrolled Environments with Partition Matrix Model Based on Hidden Conditional Random Fields , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Lihui Wang,et al.  Gesture recognition for human-robot collaboration: A review , 2017, International Journal of Industrial Ergonomics.

[4]  John C. Russ,et al.  The Image Processing Handbook , 2016, Microscopy and Microanalysis.

[5]  Bongsoon Kang,et al.  A Space-Variant Luminance Map based Color Image Enhancement , 2010, IEEE Transactions on Consumer Electronics.

[6]  Chong Wang,et al.  Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera , 2015, IEEE Transactions on Multimedia.

[7]  Lu Lv,et al.  Hand Gesture Segmentation Method Based on YCbCr Color Space and K-Means Clustering , 2015 .

[8]  Xiaofen Xing,et al.  Hand gesture segmentation based on improved kalman filter and TSL skin color model , 2011, 2011 International Conference on Multimedia Technology.

[9]  Ana-Maria Cretu,et al.  Static and Dynamic Hand Gesture Recognition in Depth Data Using Dynamic Time Warping , 2016, IEEE Transactions on Instrumentation and Measurement.

[10]  Gilson A. Giraldi,et al.  Hand gesture recognition from depth and infrared Kinect data for CAVE applications interaction , 2017, Multimedia Tools and Applications.

[11]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.