Sign Language Identification Using Image Processing Techniques

In everyday life, computers handle a large amount of data from different sources and formats such as sensors, databases, social networks, texts, etc. In addition to this process, people need to use different communication devices that enrich and facilitate human-computer interaction (HCI). As a result, there is a need to develop computational techniques that allow the search for patterns or characteristic data in images, audio waves, or electrical pulses, among others, to carry out tasks that only humans can do better so far. In this way, to improve both the User Experience (UE) and the ease of interaction with computers, various approaches to natural interaction have been proposed, including digital image processing and acquisition from various data sources such as a sensor like Kinect. In this study, the processing of images obtained from a digital camera is approached to characterize them by using basic computer vision techniques. The paper presents the development of a prototype for supporting people who speak sign language to know if the sign they are doing is correct.

[1]  Zaid Omar,et al.  A mobile application of American sign language translation via image processing algorithms , 2016, 2016 IEEE Region 10 Symposium (TENSYMP).

[2]  Aranya Walairacht,et al.  Hand gesture recognition for Lao alphabet sign language using HOG and correlation , 2017, 2017 14th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[3]  Zaid Omar,et al.  A review of hand gesture and sign language recognition techniques , 2017, International Journal of Machine Learning and Cybernetics.

[4]  Rahul Gupta,et al.  Comparative Analysis of Various Classifiers for Gesture Recognition , 2020 .

[5]  Mazen M. Selim,et al.  Advances, Challenges and Opportunities in Continuous Sign Language Recognition , 2019 .

[6]  Munib Qutaishat,et al.  American sign language (ASL) recognition based on Hough transform and neural networks , 2007, Expert Syst. Appl..

[7]  Raju Bhukya,et al.  Local optimal oriented pattern for person independent facial expression recognition , 2020, International Conference on Machine Vision.

[8]  Qinghua Gao,et al.  A novel, co-located EMG-FMG-sensing wearable armband for hand gesture recognition , 2020 .

[9]  G. Balakrishnan,et al.  Real time Indian Sign Language Recognition System to aid deaf-dumb people , 2011, 2011 IEEE 13th International Conference on Communication Technology.

[10]  Amelec Viloria,et al.  Improvements for Determining the Number of Clusters in k-Means for Innovation Databases in SMEs , 2019, ANT/EDI40.

[11]  Ravinder Ahuja,et al.  Convolutional Neural Network Based American Sign Language Static Hand Gesture Recognition , 2019, Int. J. Ambient Comput. Intell..

[12]  J. Naren,et al.  Indian Sign Language Spelling Finger Recognition System , 2020 .

[13]  Omar M. Al-Jarrah,et al.  Recognition of gestures in Arabic sign language using neuro-fuzzy systems , 2001, Artif. Intell..

[14]  S. T. Hassan,et al.  Intelligent Sign Language Recognition Using Image Processing Techniques: A Case of Hausa Sign Language , 2018 .

[15]  Amelec Viloria,et al.  Integration of Data Mining Techniques to PostgreSQL Database Manager System , 2019, Procedia Computer Science.

[16]  Maya Ingle,et al.  Vision-based approach for American Sign Language recognition using Edge Orientation Histogram , 2016, 2016 International Conference on Image, Vision and Computing (ICIVC).

[17]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Ayan Banerjee,et al.  Learn2Sign: Explainable AI for Sign Language Learning , 2019, IUI Workshops.

[19]  Jeegar Trivedi,et al.  Hand Gesture Recognition for Indian Sign Language using Skin Color Detection and Correlation-Coefficient algorithm with Neuro-Fuzzy Approach , 2019, 2019 International Conference on Advances in Computing, Communication and Control (ICAC3).

[20]  Kin Fun Li,et al.  A Web-Based Sign Language Translator Using 3D Video Processing , 2011, 2011 14th International Conference on Network-Based Information Systems.

[21]  Ming C. Leu,et al.  American Sign Language word recognition with a sensory glove using artificial neural networks , 2011, Eng. Appl. Artif. Intell..

[22]  Thad Starner,et al.  American sign language recognition with the kinect , 2011, ICMI '11.

[23]  Ashwini M. Deshpande,et al.  Video-Based Marathi Sign Language Recognition and Text Conversion Using Convolutional Neural Network , 2020 .

[24]  M. Tariq Banday,et al.  Empirical Performance Analysis of Wavelet Transform Coding-Based Image Compression Techniques , 2020 .

[25]  Omar Bonerge Pineda,et al.  Method for the Recovery of Images in Databases of Rice Grains from Visual Content , 2020, ANT/EDI40.

[26]  Aarti G. Ambekar,et al.  Sign language recognition using image based hand gesture recognition techniques , 2016, 2016 Online International Conference on Green Engineering and Technologies (IC-GET).

[27]  Taeg Keun Whangbo,et al.  A combined method of skin-and depth-based hand gesture recognition , 2020, Int. Arab J. Inf. Technol..

[28]  Hermann Ney,et al.  Spoken language processing techniques for sign language recognition and translation , 2008, Technology and Disability.

[29]  Jun Jo,et al.  A high precision crack classification system using multi-layered image processing and deep belief learning , 2020, Structure and Infrastructure Engineering.