Experimenting with Automatic Text-to-Diagram Conversion: A Novel Teaching Aid for the Blind People

Diagram describing texts are integral part of science and engineering subjects including geometry, physics, engineering drawing, etc. In order to understand such text, one, at first, tries to draw or perceive the underlying diagram. For perception of the blind students such diagrams need to be drawn in some non-visual accessible form like tactile graphics. Technologies for producing tactile graphics are available but they are too expensive to be afforded by the blind students or schools in developing countries like India. As a result, science education for a large population of blind students is severely compromised. This paper proposes a novel solution to this problem. A method for digital to Braille mapping of geometry diagrams on the low-cost traditional Braille text printer is reported here. Later on, this is integrated with a previously developed text-to-diagram conversion system. Using the integrated system, a blind student can input a geometry word problem and perceive the underlying diagram on a Braille printout. The major part of the study involves rigorous evaluation of the system at a Blind school. The enthusiasm and the ability shown by the subjects in using the system strongly attest its viability as an effective teaching/learning tool for the blind students.

[1]  David F. Rogers,et al.  Procedural Elements for Computer Graphics , 1984 .

[2]  Kentaro Toyama,et al.  Experiences with lower-cost access to tactile graphics in India , 2010, ACM DEV '10.

[3]  Anirban Mukherjee,et al.  A review of methods for automatic understanding of natural language mathematical problems , 2008, Artificial Intelligence Review.

[4]  S. Ono,et al.  Practical use of interactive tactile graphic display system at a school for the blind (2) , 2006 .

[5]  Robert J. Webster,et al.  Toward haptic/aural touchscreen display of graphical mathematics for the education of blind students , 2011, 2011 IEEE World Haptics Conference.

[6]  Simon Harper,et al.  Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility , 2006, ASSETS 2008.

[7]  Martin Kurze,et al.  TDraw: a computer-based tactile drawing tool for blind people , 1996, Assets '96.

[8]  Richard E. Ladner,et al.  Automated tactile graphics translation: in the field , 2007, Assets '07.

[9]  Kenneth E. Barner,et al.  Automatic production of tactile graphics from scalable vector graphics , 2005, Assets '05.

[10]  N Sugie,et al.  Tactile-audio diagram for blind persons. , 1996, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  David Mioduser,et al.  Haptic-feedback support for cognitive mapping of unknown spaces by people who are blind , 2008, Int. J. Hum. Comput. Stud..

[12]  Mita Nasipuri,et al.  On construction of a geometryNet , 2007, Artificial Intelligence and Applications.

[13]  Anupam Basu,et al.  Sparsha: a comprehensive indian language toolset for the blind , 2005, Assets '05.

[14]  Peter Albert Math Class: An Application for Dynamic Tactile Graphics , 2006, ICCHP.

[15]  Tien-Yu Huang,et al.  Web-based Learning in a Geometry Course , 2006, J. Educ. Technol. Soc..

[16]  Thimoty Barbieri,et al.  Learning Math for Visually Impaired Users , 2008, ICCHP.

[17]  Shiu-Li Huang,et al.  A User-Centric Adaptive Learning System for E-Learning 2.0 , 2012, J. Educ. Technol. Soc..

[18]  Anirban Mukherjee,et al.  TEXT-TO-DIAGRAM CONVERSION: A METHOD FOR FORMAL REPRESENTATION OF NATURAL LANGUAGE GEOMETRY PROBLEMS , 2013 .

[19]  James A. Landay,et al.  The integrated communication 2 draw , 2003 .

[20]  T P Way,et al.  Automatic visual to tactile translation--Part II: Evaluation of the TACTile Image Creation System. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[21]  Mario Batusic,et al.  Preparing Tactile Graphics for Traditional Braille Printers with BrlGraphEditor , 2002, ICCHP.

[22]  Cédric Gouy-Pailler,et al.  A Haptic Based Interface to Ease Visually Impaired Pupils' Inclusion in Geometry Lessons , 2007, HCI.

[23]  S K Guha,et al.  Computer as a group teaching aid for persons who are blind. , 1992, Journal of rehabilitation research and development.