Sign language translator for mobile platforms

The communication barrier of deaf and dumb community with the society still remains a matter of concern due to lack of perfect sign language translators. Usage of mobile phones for communication remains a dream for deaf and dumb community. We propose an android application that converts sign language to natural language and enable deaf and dumb community to talk over mobile phones. Developing Sign Recognition methods for mobile applications has challenges like need for light weight method with less CPU and memory utilization. The application captures image using device camera process it and determines the corresponding gesture. An initial phase of comparison using histogram matching is done to identify those gestures that are close to test sample and further only those samples are subjected to Oriented Fast and Rotated BRIEF(Binary Robust Independent Element Features) based comparison hence reducing the CPU time. The user of the application can also add new gestures into the dataset. The application allows easy communication of deaf and dumb with society. Though there are many computer based applications for sign language recognition, development in android platform is adequately less.

[1]  R. Harikrishnan,et al.  A vision based dynamic gesture recognition of Indian Sign Language on Kinect based depth images , 2013, 2013 International Conference on Emerging Trends in Communication, Control, Signal Processing and Computing Applications (C2SPCA).

[2]  M. Geetha,et al.  Gesture Recognition for American Sign Language with Polygon Approximation , 2011, 2011 IEEE International Conference on Technology for Education.

[3]  Rajesh Kannan Megalingam,et al.  IR Sensor-Based Gesture Control Wheelchair for Stroke and SCI Patients , 2016, IEEE Sensors Journal.

[4]  M.K. Bhuyan,et al.  Finite state representation of hand gesture using key video object plane , 2004, 2004 IEEE Region 10 Conference TENCON 2004..

[5]  Alex Pentland,et al.  Real-time American Sign Language recognition from video using hidden Markov models , 1995 .

[6]  Saudi Arabia,et al.  Real-Time Arabic Sign Language (ArSL) Recognition , 2012 .

[7]  Manesh Kokare,et al.  Hand Gesture Recognition by Thinning Method , 2009, 2009 International Conference on Digital Image Processing.