Model based approach for context aware and adaptive user interface generation

User interface design and development for ubiquitous software applications is challenged by the presence of varying contexts. Context comprises of user’s computing platform, the environment in which the user is interacting with the application and user characteristics which comprise of user’s behavior during interaction and user preferences for interface display and interaction. We present a framework for adaptive user interface generation where adaptation occurs when context changes. This framework introduces three new concepts. First, formalization for representing context is introduced. Our design of context specification is unique since it reflects the association of context with level and nature of user interface adaptation. Secondly, user interface generation life cycle is studied and we define a context model on top of task model to introduce the contextual conditions into user interface generation process. Using the context model, user interface designer can specify contextual requirements and its effect on the user interface. Third, context aware adaptation of user interfaces is achieved by mapping context specifications to various levels of user interface generation life cycle. We designed a specification language called rule specification using which the user interface designer can specify the mapping. With the new design of context representation, context model, and rule specification, we demonstrate how changes in contexts adapts task model which in turn adapts the user interface. Reena G. Hanumansetty Acknowledgements and Dedications iii ACKNOWLEDGEMENTS I would like to express my gratitude to my thesis advisor, Dr. Denis Gracanin, for his valuable guidance, encouragement, and for taking time off his busy schedule to provide invaluable input towards completing my Master’s thesis. I would also like to thank him for the laboratory resources. I am grateful to Dr. Mohamed Eltoweissy who has also guided me and helped me improve my researching skills. I would also like to thank Dr. Shawn Bohner for his valuable input and guidance while working towards my thesis. I extend my gratitude to all the researchers involved in CTT, and USIXML mailing lists who shared their views and provided their insight into my views. I would like to acknowledge and thank Ph.D. students Xiaoyu Zhang, and Boby George for their input while working towards my thesis. I appreciate all support provided by faculty, staff and my colleagues in the Department of Computer Science, Virginia Tech in National Capital Region. I would also like to thank my parents and my brother’s family for all their support, encouragement, care, and good wishes to help me complete my thesis. Thank you God for everything. Thank you all for making me a better person.

[1]  Jan Van den Bergh,et al.  Contextual ConcurTaskTrees: integrating dynamic contexts in task based design , 2004, IEEE Annual Conference on Pervasive Computing and Communications Workshops, 2004. Proceedings of the Second.

[2]  Guanling Chen,et al.  A Survey of Context-Aware Mobile Computing Research , 2000 .

[3]  Jakob E. Bardram,et al.  An Initial Comparison between Aura and Activity-Based Computing , 2003 .

[4]  Jean Vanderdonckt,et al.  Developing User Interfaces with XML: Advances on User Interface Description Language , 2004 .

[5]  J. Bardram.  Hospitals of the Future – Ubiquitous Computing support for Medical Work in Hospitals , 2003 .

[6]  John C. Grundy,et al.  An environment for developing adaptive, multi-device user interfaces , 2003, AUIC.

[7]  Pedro A. Szekely.  Retrospective and Challenges for Model-Based Interface Development , 1996, DSV-IS.

[8]  Tom Gross,et al.  Awareness in Context-Aware Information Systems , 2001, MuC.

[9]  Jonathan P. Bowen,et al.  Programming Research Group USER INTERFACE LANGUAGES : A SURVEY OF EXISTING METHODS , 1989 .

[10]  Kimmo E. E. Raatikainen,et al.  Application requirements for middleware for mobile and pervasive systems , 2002, MOCO.

[11]  Jin Jing,et al.  Workflow and application adaptations in mobile environments , 1999, Proceedings WMCSA'99. Second IEEE Workshop on Mobile Computing Systems and Applications.

[12]  Lisa M. Boyle,et al.  HIPAA : a guide to health care privacy and security law , 2003 .

[13]  Jean Vanderdonckt,et al.  Task Modelling in Multiple Contexts of Use , 2002, DSV-IS.

[14]  Jean Vanderdonckt,et al.  Task Modelling for Context-Sensitive User Interfaces , 2001, DSV-IS.

[15]  Maria Ebling,et al.  The design and applications of a context service , 2002, MOCO.

[16]  Jakob E. Bardram.  The Java Context Awareness Framework (JCAF) - A Service Infrastructure and Programming Framework for Context-Aware Applications , 2005, Pervasive.

[17]  Jakob E. Bardram.  Middleware for Pervasive Healthcare , 2001 .

[18]  Keith Cheverst,et al.  The role of adaptive hypermedia in a context-aware tourist GUIDE , 2002, CACM.

[19]  Massimo Ancona,et al.  Mobile computing in a hospital: the WARD-IN-HAND project , 2000, SAC '00.

[20]  Marisa E. Campbell,et al.  Conference preview: HCI 2000: usability or else! , 2000, INTR.

[21]  Fabio Paternò,et al.  The TERESA XML Language for the Description of Interactive Systems at Multiple Abstraction Levels , 2004 .

[22]  Peter Brusilovsky,et al.  From adaptive hypermedia to the adaptive web , 2002, CACM.

[23]  Jason Pascoe,et al.  Adding generic contextual capabilities to wearable computers , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[24]  Dan R. Olsen,et al.  Cross-modal interaction using XWeb , 2000, UIST '00.

[25]  Jacob Eisenstein,et al.  XIML: a common representation for interaction data , 2002, IUI '02.

[26]  Jakob E. Bardram,et al.  Activity-Based Support for Mobility and Collaboration in Ubiquitous Computing , 2004, UMICS.

[27]  Norman W. Paton,et al.  UMLi: The Unified Modeling Language for Interactive Applications , 2000, UML.

[28]  F. Paternò.  Model-based design of interactive applications , 2000, INTL.

[29]  George Coulouris,et al.  Context-aware multimedia computing in the intelligent hospital , 2000, ACM SIGOPS European Workshop.

[30]  Kris Luyten,et al.  A run-time system for context-aware multi-device user interfaces , 2003 .

[31]  Peter Brown.  Context-awareness: some compelling applications , 2000 .

[32]  Kim Halskov,et al.  Virtual video prototyping of pervasive healthcare systems , 2002, DIS '02.

[33]  Manuel A. Pérez-Quiñones,et al.  Using task models to generate multi-platform user interfaces while ensuring usability , 2002, CHI Extended Abstracts.

[34]  Philippe A. Palanque,et al.  A Tool Suite for Integrating Task and System Models through Scenarios , 2001, DSV-IS.

[35]  Joëlle Coutaz,et al.  Plasticity of User Interfaces: Framework and Research Agenda , 1999, INTERACT.

[36]  Birgit Bomsdorf,et al.  From task to dialogue: task-based user interface design , 1998, CHI Conference Summary.

[37]  Stephen A. Brewster,et al.  A Toolkit of Mechanism and Context Independent Widgets , 2000, DSV-IS.

[38]  Fabio Paternò,et al.  CTTE: Support for Developing and Analyzing Task Models for Interactive System Design , 2002, IEEE Trans. Software Eng..

[39]  Marcela D. Rodríguez,et al.  Autonomous Agents to Support Interoperability and Physical Integration in Pervasive Environments , 2003, AWIC.

[40]  Gregory D. Abowd,et al.  The Conference Assistant: combining context-awareness with wearable computing , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[41]  Jakob E. Bardram,et al.  Supporting Human Activities - Exploring Activity-Centered Computing , 2002, UbiComp.

[42]  Brad A. Myers,et al.  Past, Present and Future of User Interface Software Tools , 2000, TCHI.

[43]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[44]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[45]  David Garlan,et al.  Aura: an Architectural Framework for User Mobility in Ubiquitous Computing Environments , 2002, WICSA.

[46]  R. DeVaul.  The Ektara Architecture : The Right Framework for Context-Aware Wearable and Ubiquitous Computing Applications , 2000 .

[47]  Kris Luyten,et al.  Runtime transformations for modal independent user interface migration , 2003, Interact. Comput..

[48]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[49]  Jakob E. Bardram,et al.  Context-Aware User Authentication - Supporting Proximity-Based Login in Pervasive Computing , 2003, UbiComp.

[50]  David R. Morse,et al.  Issues in Developing Context-Aware Computing , 1999, HUC.

[51]  Jean Vanderdonckt,et al.  A Review of XML-compliant User Interface Description Languages , 2003, DSV-IS.

[52]  Roland A. Merrick.  Device Independent User Interfaces in XML , 2001 .

[53]  Benjamin Michotte,et al.  USIXML: A User Interface Description Language for Context-Sensitive User Interfaces , 2004 .

[54]  David Maulsby,et al.  MOBI-D: a model-based development environment for user-centered design , 1997, CHI Extended Abstracts.

[55]  Marcela D. Rodríguez,et al.  Context-Aware Mobile Communication in Hospitals , 2003, Computer.

[56]  Jean Vanderdonckt,et al.  Applying model-based techniques to the development of UIs for mobile computers , 2001, IUI '01.

[57]  Wolfgang Müller,et al.  Interactive multimodal user interfaces for mobile devices , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[58]  David Garlan,et al.  Project Aura: Toward Distraction-Free Pervasive Computing , 2002, IEEE Pervasive Comput..

[59]  Kris Luyten,et al.  Generating Context-Sensitive Multiple Device Interfaces from Design , 2004, CADUI.

[60]  Joëlle Coutaz,et al.  A Unifying Reference Framework for the Development of Plastic User Interfaces , 2001, EHCI.

[61]  Marc Abrams,et al.  UIML: An Appliance-Independent XML User Interface Language , 1999, Comput. Networks.

[62]  Philip J. Barnard,et al.  THE HANDBOOK OF TASK ANALYSIS FOR HUMAN-COMPUTER INTERACTION , 2003 .

[63]  Mary Tate,et al.  Human Computer Interaction: Issues and Challenges , 2002 .

[64]  Ahmed Seffah,et al.  Multiple user interfaces : cross-platform applications and context-aware interfaces , 2005 .

[65]  Peter J. Brown,et al.  Context-aware applications: from the laboratory to the marketplace , 1997, IEEE Wirel. Commun..

[66]  Mahadev Satyanarayanan.  Accessing information on demand at any location. Mobile information access , 1996, IEEE Wirel. Commun..

[67]  Jakob E. Bardram,et al.  Middleware for Pervasive Healthcare-A White Pa-per , 2001 .

[68]  Peter Steenkiste,et al.  Providing contextual information to pervasive computing applications , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[69]  Nuno Jardim Nunes,et al.  Object modeling for user-centered development and user interface design: the wisdom approach , 2001 .

[70]  Pattie Maes,et al.  Just-in-time information retrieval agents , 2000, IBM Syst. J..

[71]  Peter Steenkiste,et al.  An Integrated Contextual Information Service for Pervasive Computing Applications , 2003 .

[72]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.