Multimodal adaptation through simulation for digital TV interface

Recent research on interactive electronic systems like computer, digital TV, smartphones can improve the quality of life of many disabled and elderly people by helping them to engage more fully to the world. However, existing design practices often isolate elderly or disabled users by considering them as users with special needs and do not consider their problems during the design phase. Later they try to solve the problem by providing a few accessibility features, which surely reduces the scalability of the systems. In this paper, we present a system that can help in designing interfaces for people with a wide range of abilities by simulating their interaction patterns. We have described the detail of our simulator in the context of other similar work and also discussed applications of the simulator for developing accessible and adaptable digital TV interfaces.

[1]  Audrey Serna,et al.  Modeling the progression of Alzheimer’s disease for cognitive assistance in smart homes , 2007, User Modeling and User-Adapted Interaction.

[2]  Patrick Langdon,et al.  A new input system for disabled users involving eye gaze tracker and scanning interface , 2011 .

[3]  Shumin Zhai,et al.  Manual and gaze input cascaded (MAGIC) pointing , 1999, CHI '99.

[4]  William W. McMillan,et al.  Computing for users with special needs and models of computer-human interaction , 1992, CHI.

[5]  Constantine Stephanidis,et al.  Adaptable and Adaptive User Interfaces for Disabled Users in the AVANTI Project , 1998, IS&N.

[6]  David Benyon,et al.  Applying user modeling to human-computer interaction design , 1993, Artificial Intelligence Review.

[7]  Stephen J. Payne,et al.  Task-Action Grammars: A Model of the Mental Representation of Task Languages , 1986, Hum. Comput. Interact..

[8]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[9]  Krzysztof Z. Gajos,et al.  Automatically generating user interfaces adapted to users' motor and vision capabilities , 2007, UIST.

[10]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[11]  Jennifer Mankoff,et al.  Evaluating accessibility by simulating the experiences of users with vision or motor impairments , 2005, IBM Syst. J..

[12]  Peter Robinson,et al.  Investigating the applicability of user models for motion-impaired users , 2000, Assets '00.

[13]  Stephen J. Payne,et al.  Task-Action Grammars: A Model of the Mental Representation of Task Languages , 1987, SGCH.

[14]  Peter Robinson,et al.  A new screen scanning system based on clustering screen objects , 2008 .