INDIAN SIGN LANGUAGE RECOGNITION USING NEURAL NETWORKS AND KNN CLASSIFIERS

Sign language recognition is helpful in communication between signing people and non-signing people. Various research projects are in progress on different sign language recognition systems worldwide. The research is limited to a particular country as there are country wide variations available. The idea of this project is to design a system that can interpret the Indian sign language in the domain of numerals accurately so that the less fortunate people will be able to communicate with the outside world without need of an interpreter in public places like railway stations, banks, etc. The research presented here describes a system for automatic recognition of Indian sign language of numeric signs which are in the form of isolated images, in which only a regular camera was used to acquire the signs. To use the project in real environment, first we created a numeric sign database containing 5000 signs, 500 images per numeral sign. Direct pixel value and hierarchical centroid techniques are used to extract desired features from sign images. After extracting features from images, neural network and kNN classification techniques were used to classify the signs. The result of these experiments is achieved up to 97.10% accuracy.

[1]  Yoshiaki Shirai,et al.  Extraction of Hand Features for Recognition of Sign Language Words , 2002 .

[2]  Rajiv V. Dharaskar,et al.  “Hasta Mudra”: An interpretation of Indian sign hand gestures , 2011, 2011 3rd International Conference on Electronics Computer Technology.

[3]  A. S. Ghotkar,et al.  Hand gesture recognition for Indian Sign Language , 2012, 2012 International Conference on Computer Communication and Informatics.

[4]  Stavros J. Perantonis,et al.  Handwritten character recognition through two-stage foreground sub-sampling , 2010, Pattern Recognit..

[5]  S. Majumder,et al.  Shape, texture and local movement hand gesture features for Indian Sign Language recognition , 2011, 3rd International Conference on Trendz in Information Sciences & Computing (TISC2011).

[6]  Ashok Kumar Sahoo,et al.  SIGN LANGUAGE RECOGNITION: STATE OF THE ART , 2014 .

[7]  Ulrike Zeshan,et al.  Implementation of Indian Sign Language in educational settings , 2005 .

[8]  Manas Kamal Bhuyan,et al.  Hand pose identification from monocular image for sign language recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[9]  Nikesh Bajaj,et al.  Indian sign language recognition , 2012, 2012 1st International Conference on Emerging Technology Trends in Electronics, Communication & Networking.

[10]  P. Subha Rajam,et al.  Recognition of Tamil Sign Language Alphabet using Image Processing to aid Deaf-Dumb People , 2012 .

[11]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.