Complexity of Mathematical Expressions in Adaptive Multimodal Multimedia System Ensuring Access to Mathematics for Visually Impaired Users

Our adaptive multimodal system aims at correctly presenting a mathematical expression to visually impaired users. Given an interaction context (i.e. combination of user, environment and system resources) as well as the complexity of the expression itself and the user’s preferences, the suitability scores of different presentation format are calculated. Unlike the current state-of-the art solutions, our approach takes into account the user’s situation and not imposes a solution that is not suitable to his context and capacity. In this wok, we present our methodology for calculating the mathematical expression complexity and the results of our experiment. Finally, this paper discusses the concepts and principles applied on our system as well as their validation through cases studies. This work is our original contribution to an ongoing research to make informatics more accessible to handicapped users. Keywords— Adaptive system, intelligent multi-agent system, mathematics for visually-impaired users.

[1]  Y. Shoham.  Introduction to Multi-Agent Systems , 2002 .

[2]  Agostino Poggi,et al.  Multiagent Systems , 2006, Intelligenza Artificiale.

[3]  Amar Ramdane-Cherif,et al.  Task Migration in a Pervasive Multimodal Multimedia Computing System for Visually-Impaired Users , 2007, GPC.

[4]  Yacine Bellik,et al.  A framework for the intelligent multimodal presentation of information , 2006, Signal Process..

[5]  Klaus Miesenberger,et al.  Mathematical Working Environment for the Blind Motivation and Basic Ideas , 2004, ICCHP.

[6]  Amar Ramdane-Cherif,et al.  A Paradigm of a Pervasive Multimodal Multimedia Computing System for the Visually-Impaired Users , 2006, GPC.

[7]  A. Edwards,et al.  A multimodal interface for blind mathematics students , 2007 .

[8]  Ronald L. Rivest,et al.  Introduction to Algorithms, Second Edition , 2001 .

[9]  Y. Bellik.  Interfaces multimodales : concepts, modeles et architectures , 1995 .

[10]  Hervé Bourlard,et al.  On the Use of Information Retrieval Measures for Speech Recognition Evaluation , 2004 .

[11]  T. V. Raman,et al.  Audio System for Technical Readings , 1998, Lecture Notes in Computer Science.

[12]  Chris Weaver,et al.  Reading and writing mathematics: the MAVIS project , 1998, Assets '98.

[13]  Amar Ramdane-Cherif,et al.  An Adaptive Multimodal Multimedia Computing System for Presentation of Mathematical Expressions to Visually-Impaired Users , 2009, J. Multim..

[14]  Diamantino Freitas,et al.  Enhancing the Accessibility of Mathematics for Blind People: The AudioMath Project , 2004, ICCHP.

[15]  Michael Wooldridge,et al.  Agent technology: foundations, applications, and markets , 1998 .

[16]  Y. Bellik,et al.  Information Access in a Multimodal Multimedia Computing System for Mobile Visually-Impaired Users , 2006, 2006 IEEE International Symposium on Industrial Electronics.