Talkmaths: a speech user interface for dictating mathematical expressions into electronic documents

We describe the development of a speech-driven user interface system, TalkMaths, which enables the dictation of mathematical expressions into electronic documents without the user needing extensive knowledge of any specialized markup language. This system should be of value to many students and teachers, particularly those with disabilities for whom typing mathematical text is currently very difficult.

[1]  Guido van Rossum,et al.  Python Programming Language , 2007, USENIX Annual Technical Conference.

[2]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[3]  Leslie Lamport,et al.  Latex : A Document Preparation System , 1985 .

[4]  Tomás Hanakovic,et al.  Speech Recognition Helps Visually Impaired People Writing Mathematical Formulas , 2006, ICCHP.

[5]  Benoît Encelle,et al.  LAMBDA: A European System to Access Mathematics with Braille and Audio Synthesis , 2006, ICCHP.

[6]  R. Fateman.  How can we speak math , 1998 .

[7]  R. Rosenfeld,et al.  Two decades of statistical language modeling: where do we go from here? , 2000, Proceedings of the IEEE.

[8]  Cristian Bernareggi,et al.  Writing Mathematics by Speech: A Case Study for Visually Impaired , 2008, ICCHP.

[9]  Masahiro Araki,et al.  Spoken, Multilingual and Multimodal Dialogue Systems: Development and Assessment , 2005 .

[10]  T. V. Raman,et al.  Audio System for Technical Readings , 1998, Lecture Notes in Computer Science.

[11]  Lawrence A. Chang.  Handbook for Spoken Mathematics: (Larry's Speakeasy). , 1983 .

[12]  D. Fitzpatrick.  Mathematics: How and What to Speak , 2006, ICCHP.

[13]  C. Elliott.  COMPUTER BASED MATHEMATICS USING CONTINUOUS SPEECH RECOGNITION , 2005 .

[14]  Richard Fateman,et al.  Math Speak & Write , a Computer Program to Read and Hear Mathematical Input , 2004 .

[15]  Eckhard Pflügel,et al.  KU-TALK: a speech user interface for an intelligent working, learning and teaching environment , 2008 .

[16]  Susumu Harada,et al.  Striking a c[h]ord: vocal interaction in assistive technologies, games, and more , 2007, CHI Extended Abstracts.

[17]  James Denholm-Price,et al.  The 'KU-Talk' Project at Kingston University - a Speech-Driven User-Computer Interface for Use in a University Environment , 2008 .

[18]  Alistair D. N. Edwards,et al.  Lambda:: a multimodal approach to making mathematics accessible to blind students , 2006, Assets '06.