Evaluating Speech Synthesis on Mathematical Sentences

English. In this paper we present the main features of a rule-based architecture to transform a LATEX encoded mathematical expression into its equivalent mathematical sentence form, i.e. a natural language sentence expressing the semantics of the mathematical expression. Moreover, we describe the main results of a first human based evaluation of the system for Italian language focusing on speech synthesis engines. Italiano. In questo lavoro presentiamo le caratteristiche principali di un’architettura software a regole per trasformare un’espressione matematica, codificata in LATEX, nella sua equivalente frase matematica, cioè una frase del linguaggio naturale che esprima la stessa semantica dell’espressione originale. Inoltre, descriviamo i primi risultati di una valutazione del sistema fatta da esseri umani per la lingua italiana riguardante principalmente i motori di sintesi del parlato.

[1]  Benoît Encelle,et al.  LAMBDA: A European System to Access Mathematics with Braille and Audio Synthesis , 2006, ICCHP.

[2]  Lawrence A. Chang Handbook for Spoken Mathematics: (Larry's Speakeasy). , 1983 .

[3]  Cristina Bosco,et al.  Auxiliary Selection in Italian Intransitive Verbs: A Computational Investigation based on Annotated Corpora , 2018, CLiC-it.

[4]  Emiel Krahmer,et al.  Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluation , 2017, J. Artif. Intell. Res..

[5]  Alessandro Mazzei,et al.  Building a Computational Lexicon by using SQL , 2016, CLiC-it/EVALITA.

[6]  Leo Ferres,et al.  Improving accessibility to mathematical formulas: the Wikipedia math accessor , 2011, W4A.

[7]  Harold L. Somers,et al.  An introduction to machine translation , 1992 .

[8]  Cristina Bosco,et al.  Dealing with Italian Adjectives in Noun Phrase: a Study Oriented to Natural Language Generation , 2017, CLiC-it.

[9]  Albert Gatt,et al.  SimpleNLG: A Realisation Engine for Practical Applications , 2009, ENLG.

[10]  Davide P. Cervone,et al.  Math Jax: a platform for mathematics on the web , 2012 .

[11]  Robert Dale,et al.  Building Natural Language Generation Systems (Studies in Natural Language Processing) , 2006 .

[12]  Cristina Bosco,et al.  SimpleNLG-IT: adapting SimpleNLG to Italian , 2016, INLG.

[13]  Basura Fernando,et al.  SPICE: Semantic Propositional Image Caption Evaluation , 2016, ECCV.

[14]  Neil Soiffer A Study of Speech Versus Braille and Large Print of Mathematical Expressions , 2016, ICCHP.

[15]  Volker Sorge,et al.  Towards making mathematics a first class citizen in general screen readers , 2014, W4A.

[16]  Dragan Ahmetovic,et al.  Axessibility: a LaTeX Package for Mathematical Formulae Accessibility in PDF Documents , 2018, ASSETS.