TalkMaths Better ! Evaluating and Improving an Intelligent Interface for Creating and Editing Mathematical Text

We outline a system, called TalkMaths, which has been under development for some time, to allow users to create, access and edit Mathematical text documents using speech. This interface system could prove to be of particular advantage to people with a range of disabilities, amongst others. We describe initial results of a study to evaluate how easy this system is to use, and recent developments aimed at improving it and making it more “user friendly” and intelligent.

[1]  Diamantino Freitas,et al.  Enhancing the Accessibility of Mathematics for Blind People: The AudioMath Project , 2004, ICCHP.

[2]  Pavel Gaura.  REMathEx - Reader and Editor of the Mathematical Expressions for Blind Students , 2002, ICCHP.

[3]  Clare-Marie Karat,et al.  A longitudinal evaluation of hands-free speech-based navigation during dictation , 2006, Int. J. Hum. Comput. Stud..

[4]  Eckhard Pflügel,et al.  Using Automatic Speech Recognition to Dictate Mathematical Expressions: The Development of the “TalkMaths” Application at Kingston University. , 2009 .

[5]  Douglas J. Gillan,et al.  Cognitive Analysis of Equation Reading: Application to the Development of the Math Genie , 2004, ICCHP.

[6]  Alistair D. N. Edwards,et al.  Lambda:: a multimodal approach to making mathematics accessible to blind students , 2006, Assets '06.

[7]  Cristian Bernareggi,et al.  Writing Mathematics by Speech: A Case Study for Visually Impaired , 2008, ICCHP.

[8]  Richard Fateman,et al.  Math Speak & Write , a Computer Program to Read and Hear Mathematical Input , 2004 .

[9]  Susumu Harada,et al.  Striking a c[h]ord: vocal interaction in assistive technologies, games, and more , 2007, CHI Extended Abstracts.

[10]  C. Elliott.  COMPUTER BASED MATHEMATICS USING CONTINUOUS SPEECH RECOGNITION , 2005 .

[11]  Tomás Hanakovic,et al.  Speech Recognition Helps Visually Impaired People Writing Mathematical Formulas , 2006, ICCHP.

[12]  Eckhard Pflügel,et al.  "Let them TalkMaths!" - Developing an Intelligent System to Assist Disabled People to Learn and Use Mathematics on Computers through a Speech Interface: the TalkMaths and VoiceCalc Systems , 2009, Intelligent Environments.

[13]  Benoît Encelle,et al.  LAMBDA: A European System to Access Mathematics with Braille and Audio Synthesis , 2006, ICCHP.