An Image Texture based approach in understanding and classifying Baby Sign Language

A sign language is a mode of communication in which the intent of the message or the message itself is conveyed through body postures or the movement of the parts of the body like head, eyebrows and cheeks etc. Every expression is distinct and has distinguishable parts of language, its grammatical content fully displayed through gestures. There are more than three hundred sign languages used in the world. The baby sign language is a method of communication between the mothers and their toddlers by means of gestures, clearly expressing their emotions and desires. In the present research work study of the existing literature has been carried out and then prepared a data set of still jpeg images for 60 odd baby signs, performed GLCM(Gray Level Co-Occurrence Matrix) based feature extraction, then performed classification of gestures using KNN and Random Forest based machine learning algorithms. A classification accuracy of 73% has been achieved on the dataset prepared.

[1]  C. Farkas,et al.  Infant sign language program effects on synchronic mother-infant interactions. , 2009, Infant behavior & development.

[2]  P. Subha Rajam,et al.  Recognition of Tamil Sign Language Alphabet using Image Processing to aid Deaf-Dumb People , 2012 .

[3]  Alauddin Bhuiyan,et al.  Bengali Sign Language Recognition using dynamic skin calibration and geometric hashing , 2017, 2017 6th International Conference on Informatics, Electronics and Vision & 2017 7th International Symposium in Computational Medical and Health Technology (ICIEV-ISCMHT).

[4]  A. E. E. El Alfi,et al.  Intelligent Arabic Sign Language to Arabic text Translation for Easy Deaf Communication , 2018 .

[5]  The effects of baby sign training on child development , 2014 .

[6]  Pusadee Seresangtakul,et al.  Thai finger-spelling sign language recognition using global and local features with SVM , 2017, 2017 9th International Conference on Knowledge and Smart Technology (KST).

[7]  C.R. Hema,et al.  Extraction of head and hand gesture features for recognition of sign language , 2008, 2008 International Conference on Electronic Design.

[8]  Kumud Tripathi,et al.  Continuous Indian Sign Language Gesture Recognition and Sentence Formation , 2015 .

[9]  Infants' use of baby sign to extract unfamiliar words from the speech stream , 2015 .

[10]  Fu-Hao Yeh,et al.  Kinect-based Taiwanese sign-language recognition system , 2014, Multimedia Tools and Applications.

[11]  Khaled Assaleh,et al.  Vision-based system for continuous Arabic Sign Language recognition in user dependent mode , 2008, 2008 5th International Symposium on Mechatronics and Its Applications.