When You Can't Read It, Listen to It! An Audio-Visual Interface for Book Reading

This paper presents a prototype of a mobile Digital Talking Book player, which, by combining visual and non-visual means of interaction, strives to achieve universal accessibility. Details on the non-visual aspects of the interaction, both input and output, are provided. To assess the validity of the proposed solutions, an experiment evaluates the non-visual operation of the prototype. Results show users can complete the same tasks with visual and non-visual interaction. However, some limitations are identified, and the observations prompt a discussion on how the use of multimodal interfaces can improve their accessibility and usability.

[1]  T. Landauer,et al.  Handbook of Human-Computer Interaction , 1997 .

[2]  S. Resnikoff,et al.  Global data on visual impairment in the year 2002. , 2004, Bulletin of the World Health Organization.

[3]  Luís Carriço,et al.  Playback of Rich Digital Books on Mobile Devices , 2007, HCI.

[4]  Emilia Branny,et al.  Automatic summary evaluation based on text grammars , 2007, J. Digit. Inf..

[5]  Luís Carriço,et al.  Evaluating Usability Improvements by Combining Visual and Audio Modalities in the Interface , 2007, HCI.

[6]  Julio Abascal,et al.  Universal accessibility as a multimodal design issue , 2007, CACM.

[7]  A. Conchon,et al.  Applications and services , 2001 .

[8]  Constantine Stephanidis,et al.  Unified user interface design: designing universally accessible interactions , 2004, Interact. Comput..

[9]  William W. Gaver,et al.  Chapter 42 – Auditory Interfaces , 1997 .

[10]  Luís Carriço,et al.  Conveying Browsing Context Through Audio on Digital Talking Books , 2007, HCI.

[11]  Trevor Darrell,et al.  MULTIMODAL INTERFACES THAT Flex, Adapt, and Persist , 2004 .

[12]  Luís Carriço,et al.  Developing an Adaptive Digital Talking Book Player with FAME , 2007, J. Digit. Inf..

[13]  Julie A. Jacko,et al.  Interaction design and usability , 2007 .

[14]  Stephen Brewster,et al.  Providing a Structured Method for Integrating Non-Speech Audio into Human-Computer Interfaces , 1994 .

[15]  Julie A. Jacko.  Interaction platforms and techniques , 2007 .