Novel segmentation algorithm for hand gesture recognition

Sign language is the most important methodology using which hearing and speech impaired people can interact with the rest of the world. Conversation with hearing impaired individuals gets complicated if the listener is ignorant of sign language. Hence it becomes important to construct a bridge between these two banks. Many sign language and hand gesture recognition algorithms have been developed in the recent years, to assist people who do not have knowledge of sign language to converse with the speech impaired but very few with good results exist. One of the major concerns with respect to hand gesture recognition is segregation or segmentation of the hand and identifying the gesture. This paper explores the various possible ways of segmentation using different color spaces and models and presents the best algorithm with highest accuracy to perform the same. Various experiments were conducted for over 500 different gestures and an accuracy of around 97.4% was achieved with the segmentation algorithm selected. The algorithms were implemented in MATLAB programming language on MATLAB 7.14.0.739 build R2012a.

[1]  C. Saravanan,et al.  Color Image to Grayscale Image Conversion , 2010, 2010 Second International Conference on Computer Engineering and Applications.

[2]  Rini Akmeliawati,et al.  Modeling of Human Upper Body for Sign Language Recognition , 2011, The 5th International Conference on Automation, Robotics and Applications.

[3]  Bencie Woll,et al.  Sign Language: The Study of Deaf People and their Language , 1985 .

[4]  David Alan Stewart,et al.  American Sign Language the easy way , 2003 .

[5]  Marc Marschark,et al.  The Oxford Handbook of Deaf Studies, Language, and Education, Volume 1, Second Edition , 2011 .

[6]  Patrick Shen-Pei Wang,et al.  A new method of color image segmentation based on intensity and hue clustering , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[8]  Sudhir Rao Rupanagudi,et al.  Novel Algorithm for Image Processing Based Hand Gesture Recognition and Its Application in Security , 2013 .

[9]  Rohit Kumar Gupta,et al.  Information Measure Ratio Based Real Time Approach for Hand Region Segmentation with a Focus on Gesture Recognition , 2011, 2011 Second International Conference on Intelligent Systems, Modelling and Simulation.

[10]  Julian F. Y. Cheung,et al.  Directional line detectors in correlated noisy environments , 2000, IEEE Trans. Image Process..

[11]  Nor Hazlyna Harun,et al.  Comparison of acute leukemia Image segmentation using HSI and RGB color space , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[12]  Moh'd Belal Al-Zoubi.  A new algorithm for automatic extraction of GIS layers , 2010, 2010 7th International Multi- Conference on Systems, Signals and Devices.

[13]  Allan Hanbury,et al.  Constructing cylindrical coordinate colour spaces , 2008, Pattern Recognit. Lett..

[14]  Xiaofen Xing,et al.  Hand gesture segmentation based on improved kalman filter and TSL skin color model , 2011, 2011 International Conference on Multimedia Technology.

[15]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[16]  Eric Dubois.  The Structure and Properties of Color Spaces and the Representation of Color Images , 2009, The Structure and Properties of Color Spaces and the Representation of Color Images.

[17]  Larry Leifer,et al.  TeleSign: a sign language telecommunication system , 1992, Proceedings of the Johns Hopkins National Search for Computing Applications to Assist Persons with Disabilities.

[18]  Ying Sun,et al.  A hierarchical approach to color image segmentation using homogeneity , 2000, IEEE Trans. Image Process..

[19]  Anastasis A. Sofokleous,et al.  Review: H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia , 2005, Comput. J..

[20]  David Zhang,et al.  A new equation of saturation in RGB-to-HSI conversion for more rapidity of computing , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.