Automated tactile graphics translation: in the field

We address the practical problem of automating the process of translating figures from mathematics, science, and engineering textbooks to a tactile form suitable for blind students. The Tactile Graphics Assistant (TGA) and accompanying workflow is described. Components of the TGA that identify text and replace it with Braille use machine learning, computational geometry, and optimization algorithms. We followed through with the ideas in our 2005 paper by creating a more detailed workflow, translating actual images, and analyzing the translation time. Our experience in translating more than 2,300 figures from 4 textbooks demonstrates that figures can be translated in ten minutes or less of human time on average. We describe our experience with training tactile graphics specialists to use the new TGA technology.

[1]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[2]  Daniel Marks,et al.  Glencoe advanced mathematical concepts : precalculus with applications , 2001 .

[3]  Cornelius Hagen,et al.  Automated interpretation and accessible presentation of technical diagrams for blind people , 2004, New Rev. Hypermedia Multim..

[4]  Matthew Renzelmann Segmentation and Grouping for Tactile Graphics , 2005 .

[5]  W. Paul,et al.  Computer Architecture , 2000, Springer Berlin Heidelberg.

[6]  Bernard Kolman,et al.  Discrete Mathematical Structures , 1984 .

[7]  David A. Patterson,et al.  Computer Architecture: A Quantitative Approach , 1969 .

[8]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[9]  George T. Ioannidis,et al.  The Bigger Picture: Automated Production Tools for Tactile Graphics , 2004, ICCHP.

[10]  Gordon Advanced Mathematical Concepts , 1996 .

[11]  Kenneth E. Barner,et al.  Automatic production of tactile graphics from scalable vector graphics , 2005, Assets '05.

[12]  T P Way,et al.  Automatic visual to tactile translation--Part II: Evaluation of the TACTile Image Creation System. , 1997, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  Pamela Morris,et al.  Statistics, a first course , 1981 .

[14]  I. Jolliffe Principal Component Analysis , 2002 .

[15]  American Foundation for the Blind , 1967 .

[16]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[17]  Richard E. Ladner,et al.  Automating tactile graphics translation , 2005, Assets '05.

[18]  Masakazu Suzuki,et al.  INFTY: an integrated OCR system for mathematical documents , 2003, DocEng '03.

[19]  David A. Patterson,et al.  Computer Architecture - A Quantitative Approach, 5th Edition , 1996 .