Novel methodology for Kannada Braille to speech translation using image processing on FPGA

With the introduction and popularization of text to speech convertors, a huge drop in literacy rates is being seen amongst the visually impaired. Also, since Braille is not well known to the masses, communication by the visually impaired with the outside world becomes an arduous task. A lot of research is being carried out in conversion of English text to Braille but not many concentrate on the alternative i.e. conversion of Braille to regional languages. In order to address this issue, in this paper we introduce a novel methodology to convert Braille characters representing the Kannada Language (a popular language of southern part of India), captured by a camera, into Kannada text or speech. An automated thresholding algorithm for segmentation of the Braille dots along with a novel algorithm for identification of the characters has been explained. All algorithms were designed and developed for a Xilinx Spartan 3E FPGA and were executed in real time. An accuracy of over 94% was achieved in Braille segmentation and detection. The algorithm for identification of the Kannada Braille character was found to be four times faster than many existing methodologies, on the FPGA.

[1]  A. N. Singh Enabling the differently able , 2001 .

[2]  Omar Farooq,et al.  Imprinted Braille-character pattern recognition using image processing techniques , 2011, 2011 International Conference on Image Information Processing.

[3]  AbdulMalik S. Al-Salman,et al.  An Efficient Braille Cells Recognition , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).

[4]  Alistair D. N. Edwards,et al.  Assistive Technologies , 2008, Web Accessibility.

[5]  Gerard Lachiver,et al.  An Optoelectronic Device to Read and Spell Braille-Braillect , 1984, IEEE Transactions on Biomedical Engineering.

[6]  Feng Zhao,et al.  Displaying Braille for Mobile Use with the Micro-vibration of SMA Wires , 2012, 2012 5th International Conference on Human System Interactions.

[7]  P.L. Weiss,et al.  Low-cost haptic-aural virtual environments for way-finding by children with congenital blindness: feasibility study , 2006, 2006 International Workshop on Virtual Rehabilitation.

[8]  Mick Herron Blind visionary - [engineering heritage] , 2009 .

[9]  Saad D. Al-Shamma,et al.  Arabic Braille Recognition and transcription into text and voice , 2010, 2010 5th Cairo International Biomedical Engineering Conference.

[10]  C. Saravanan,et al.  Color Image to Grayscale Image Conversion , 2010, 2010 Second International Conference on Computer Engineering and Applications.

[11]  Jie Li,et al.  Optical Braille recognition with Haar wavelet features and Support-Vector Machine , 2010, 2010 International Conference on Computer, Mechatronics, Control and Electronic Engineering.

[12]  S. R. Rupanagudi,et al.  “i” — A novel algorithm for optical character recognition (OCR) , 2013, 2013 International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s).

[13]  Jie Li,et al.  The Research on Paper-Mediated Braille Automatic Recognition Method , 2010, 2010 Fifth International Conference on Frontier of Computer Science and Technology.

[14]  Meng Zhang,et al.  Hadoop Based Data Processing Method and Its Application on Braille Identification , 2012, 2012 Fifth International Conference on Intelligent Networks and Intelligent Systems.

[15]  M. Allen,et al.  A Refreshable Braille Cell Based on Pneumatic Microbubble Actuators , 2012, Journal of Microelectromechanical Systems.

[16]  Shanjun Zhang,et al.  A Braille Recognition System by the Mobile Phone with Embedded Camera , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).

[17]  Zohreh Azimifar,et al.  Probabilistic estimation of Braille document parameters , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  Yajun Ha,et al.  High Speed Video Processing Using Fine-Grained Processing on FPGA Platform , 2013, 2013 IEEE 21st Annual International Symposium on Field-Programmable Custom Computing Machines.

[19]  A. El-Zaart,et al.  A novel approach for Braille images segmentation , 2012, 2012 International Conference on Multimedia Computing and Systems.

[20]  R. S. Subbu,et al.  Enabling visually impaired to read messages from modern gadgets , 2012, 2012 Sixth International Conference on Sensing Technology (ICST).

[21]  K. Ito,et al.  Development of Pen-based Note-Taking System for Blind People , 2007, Second International Conference on Innovative Computing, Informatio and Control (ICICIC 2007).