Bangla numerical sign language recognition using convolutional neural networks (CNNs)

The amount of deaf and mute individuals on the earth is rising at an alarmingrate. Bangladesh has about 2.6 million people who are unable to interact with the community using language. Hearing-impaired citizens in Bangladesh use Bangladeshi sign language (BSL) as a means of communication. In this article,we propose a new method for Bengali sign language recognition based on deep convolutional neural networks. Our framework employs convolutional neural networks (CNN) to learn from the images in our dataset and interpret hand signs from input images. Checking their collections of ten indications (we usedten sets of images with 31 distinct signs) for a total of 310 images. The proposed system takes snap shots from a video by using a webcam with applying a computer vision-based approach. After that, it compares those photos to a previously trained dataset generated with CNN and displays the Bengali numbers (০-৯). After estimating the model on our dataset, weobtained an overall accuracy of 99.8%. We want to streng then things as far aswe can to make silent contact with the majority of society as simple asprobable.

[1]  P. V. V. Kishore,et al.  Deep convolutional neural networks for sign language recognition , 2018, 2018 Conference on Signal Processing And Communication Engineering Systems (SPACES).

[2]  Asif Karim,et al.  Efficient Prediction of Cardiovascular Disease Using Machine Learning Algorithms With Relief and LASSO Feature Selection Techniques , 2021, IEEE Access.

[3]  Muttaki Hasan,et al.  A machine learning based approach for the detection and recognition of Bangla sign language , 2016, 2016 International Conference on Medical Engineering, Health Informatics and Technology (MediTec).

[4]  Ali Shatnawi,et al.  Recognition of gestures in arabic sign language using neural networks , 2006, Artificial Intelligence and Soft Computing.

[5]  Neelesh SARAWATE,et al.  A real-time American Sign Language word recognition system based on neural networks and a probabilistic model , 2015 .

[6]  Md. Zahid Hasan,et al.  Personalization of Job Circular Announcement to Applicants Using Decision Tree Classification Algorithm , 2020, 2020 IEEE International Conference for Innovation in Technology (INOCON).

[7]  M. A. H. Akhand,et al.  Bangladeshi Sign Language Recognition using fingertip position , 2016, 2016 International Conference on Medical Engineering, Health Informatics and Technology (MediTec).

[8]  Md. Abdur Rahim,et al.  Visual Recognition of Bengali Sign Language using Artificial Neural Network , 2014 .

[9]  Shayhan Ameen Chowdhury,et al.  Hand sign language recognition for Bangla alphabet using Support Vector Machine , 2016, 2016 International Conference on Innovations in Science, Engineering and Technology (ICISET).

[10]  Angur M. Jarman,et al.  An Automated Bengali Sign Language Recognition System Based on Fingertip Finder Algorithm , 2015 .

[11]  Golam Kayas,et al.  AUTOMATIC RECOGNITION OF BANGLA SIGN LANGUAGE USING ARTIFICIAL NEURAL NETWORKS (ANNS) FOR DEAF AND DUMB TO BRIDGE THE COMMUNICATION GAP , 2016 .

[12]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Md. Al Mehedi Hasan,et al.  Classification of Sign Language Characters by Applying a Deep Convolutional Neural Network , 2020, 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT).

[14]  P. Ganesan,et al.  International Conference on Recent Trends in Computing 2015 ( ICRTC-2015 ) Comparative Study of Skin Color Detection and Segmentation in HSV and YCbCr Color Space , 2015 .

[15]  Md. Jahangir Hossein,et al.  Recognition of Bengali Sign Language using Novel Deep Convolutional Neural Network , 2020, 2020 2nd International Conference on Sustainable Technologies for Industry 4.0 (STI).

[16]  Mahmood Jasim,et al.  Real-time computer vision-based Bengali Sign Language recognition , 2014, 2014 17th International Conference on Computer and Information Technology (ICCIT).

[17]  F. M. Javed Mehedi Shamrat,et al.  Optimization of Prediction Method of Chronic Kidney Disease Using Machine Learning Algorithm , 2020, 2020 15th International Joint Symposium on Artificial Intelligence and Natural Language Processing (iSAI-NLP).

[18]  F. M. Javed Mehedi Shamrat,et al.  Implementation of Machine Learning Algorithms to Detect the Prognosis Rate of Kidney Disease , 2020, 2020 IEEE International Conference for Innovation in Technology (INOCON).

[19]  M. F. Tolba,et al.  Arabic sign language recognition with 3D convolutional neural networks , 2017, 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS).

[20]  Mohammad Nurul Huda,et al.  Automated Bangla sign language translation system: Prospects, limitations and applications , 2016, 2016 5th International Conference on Informatics, Electronics and Vision (ICIEV).

[21]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[22]  Jia Uddin,et al.  Bengali Sign language to text conversion using artificial neural network and support vector machine , 2017, 2017 3rd International Conference on Electrical Information and Communication Technology (EICT).

[23]  S. Padmavathi,et al.  Indian Sign Language Character Recognition using Neural Networks , 2013 .

[24]  Kazi Md. Rokibul Alam,et al.  Bangladeshi Sign Language Recognition employing Neural Network Ensemble , 2012 .

[25]  Benjamin Schrauwen,et al.  Sign Language Recognition Using Convolutional Neural Networks , 2014, ECCV Workshops.

[26]  Brandon Garcia,et al.  Real-time American Sign Language Recognition with Convolutional Neural Networks , 2022 .

[27]  R. Sreemathy,et al.  Vision based hand gesture recognition using eccentric approach for human computer interaction , 2014, 2014 International Conference on Advances in Computing, Communications and Informatics (ICACCI).