Multimedia platform for mathematics’ interactive learning accessible to blind people

Nowadays, the math learning is an important step in developing professional carriers in technical and economic sciences. Increasing the number of e-learning tools used in universities courses can reduce the potential barrier of access to mathematical knowledge, but most of them are not accessible for impaired students. Moreover, classical printed math books include little explicit instructional information about structural information interpretations. Taking into account these barriers the article presents the developed method used for creating interactive steps of decomposed math’s exercise solution and alternative description of math formulas accessible for the blind. The elements of proposed methodology: generation of state machine, design and presentation of transition conditions, generating the presentation layer and a typical usage by a blind user are presented. A set of rules for describing mathematical formulas were proposed after consultation with mathematicians and teachers of blind people. The application was developed as web application. The graphical interface of presented application was designed using PHP and JavaScript technologies. The collection of prepared exercises include about 240 prepared exercises from different areas of mathematics and 60 selected exercises including alternative description layer. About 1000 students and about 40 impaired students, from 6 faculties of the university use this platform during math courses for both self and class learning. The defined rules were used to read aloud mathematical formulas to the visually impaired people with a different level of mathematical knowledge. The results confirmed good understanding of mathematical formulas by using prepared alternative description.

[1]  Davide P. Cervone,et al.  Math Jax: a platform for mathematics on the web , 2012 .

[2]  Neil Soiffer A Study of Speech Versus Braille and Large Print of Mathematical Expressions , 2016, ICCHP.

[3]  Cristian Bernareggi,et al.  Non-sequential Mathematical Notations in the LAMBDA System , 2010, ICCHP.

[4]  Dominik Spinczyk,et al.  Multimedia Browser for Internet Online Daisy Books , 2006, ICCHP.

[5]  Masakazu Suzuki,et al.  Accessible Authoring Tool for DAISY Ranging from Mathematics to Others , 2012, ICCHP.

[6]  John A. Gardner,et al.  The LEAN Math Accessible MathML Editor , 2014, ICCHP.

[7]  Neil Soiffer,et al.  A Flexible Design for Accessible Spoken Math , 2009, HCI.

[8]  Volker Sorge Supporting Visual Impaired Learners in Editing Mathematics , 2016, ASSETS.

[9]  George Kerscher DAISY Consortium: information technology for the world’s blind and print‐disabled population – past, present, and into the future , 2000 .

[10]  Giuseppe Nicotra,et al.  Innovative Methods for Accessing Mathematics by Visually Impaired Users , 2010, ICCHP.

[11]  Leslie Lamport,et al.  Latex : A Document Preparation System , 1985 .

[12]  Matt Huenerfauth,et al.  Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility , 2012, ASSETS.

[13]  Dominik Spinczyk,et al.  Multimedia System for Accessible Distant Education , 2008, Information Technologies in Biomedicine.

[14]  Michal Mackowski,et al.  Intelligent Tutoring Math Platform Accessible for Visually Impaired People , 2014, ICCHP.

[15]  Piotr Brzoza,et al.  ForMath - Intelligent Tutoring System in Mathematics , 2012, CSEDU.

[16]  Timothy J. Lowe,et al.  Access to Mathematics in Web Resources for People with a Visual Impairment , 2008, ICCHP.

[17]  Volker Sorge,et al.  Towards making mathematics a first class citizen in general screen readers , 2014, W4A.

[18]  Arthur C. Graesser,et al.  The impact of a technology-based mathematics after-school program using ALEKS on student's knowledge and behaviors , 2013, Comput. Educ..

[19]  Christa Jackson,et al.  Developing Representational Ability in Mathematics for Students With Learning Disabilities , 2012 .

[20]  Other Contributors Are Indicated Where They Contribute The Unicode Consortium , 2017 .

[21]  R. Fateman How can we speak math , 1998 .

[22]  Kai Wang,et al.  On Ambiguity Issues of Converting LaTeX Mathematical Formula to Content MathML , 2015, CollaborateCom.

[23]  Georgios Kouroupetroglou,et al.  An Evaluation Methodology of Math-to-Speech in Non-English DAISY Digital Talking Books , 2016, ICCHP.

[24]  Lin Huang,et al.  The Research of PHP Development Framework Based on MVC Pattern , 2009, 2009 Fourth International Conference on Computer Sciences and Convergence Information Technology.

[25]  Erica Melis,et al.  Interactivity of Exercises in ActiveMath , 2005, ICCE.

[26]  Andrzej Salamonczyk,et al.  Translation of MathML formulas to Polish text, example applications in teaching the blind , 2015, 2015 IEEE 2nd International Conference on Cybernetics (CYBCONF).