Fully-automatic generation of user interfaces for multiple devices from a high-level model based on communicative acts

The problems involved in the development of user interfaces become even more severe through the ubiquitous use of a variety of devices such as PCs, mobile phones and PDAs. Each of these devices has its own specifics that require a special user interface. Therefore, we developed and implemented an approach to generate user interfaces for multiple devices fully automatically from a high-level model. In contrast to previous approaches focusing on abstracting the user interface per se, we make use of speech act theory from the philosophy of language for the specification of desired intentions in interactions. Our new approach of using communicative acts in high-level models of user interfaces allows their creation with less technical knowledge, since such models are easier to provide than user-interface code in a usual programming language. From one such high-level model, multiple user interfaces for diverse devices are rendered fully automatically using a number of heuristics. A generated user interface for a PDA is already in real-world use and its usability was informally evaluated as good

[1]  Jeffrey Nichols,et al.  Generating remote control interfaces for complex appliances , 2002, UIST '02.

[2]  Angel R. Puerta,et al.  A Model-Based Interface Development Environment , 1997, IEEE Softw..

[3]  Fabio Paternò,et al.  Automatically adapting web sites for mobile access through logical descriptions and dynamic analysis of interaction resources , 2008, AVI '08.

[4]  Oscar Pastor,et al.  Using Profiles to Support Model Transformations in the Model-Driven Development of User Interfaces , 2008, CADUI.

[5]  Hermann Kaindl,et al.  Using communicative acts in high-level specifications of user interfaces for their automated synthesis , 2005, ASE '05.

[6]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.

[7]  Martin K. Purvis,et al.  Communicative acts and interaction protocols in a distributed information system , 2003, AAMAS '03.

[8]  Jean Vanderdonckt,et al.  Graceful degradation of user interfaces as a design method for multiplatform systems , 2004, IUI '04.

[9]  Steven Orla Kimbrough,et al.  On automated message processing in electronic commerce and work support systems: speech act theory and expressive felicity , 1997, TOIS.

[10]  Philippe Palanque,et al.  Using Declarative Descriptions to Model User Interfaces with MASTERMIND , 1998 .

[11]  R. Want,et al.  System challenges for ubiquitous & pervasive computing , 2005, Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005..

[12]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[13]  Stina Nylander,et al.  The ubiquitous interactor: universal access to mobile services. , 2003 .

[14]  Jean Vanderdonckt,et al.  A Unifying Reference Framework for multi-target user interfaces , 2003, Interact. Comput..

[15]  Jacob Eisenstein,et al.  XIML: a common representation for interaction data , 2002, IUI '02.

[16]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.

[17]  Alistair G. Sutcliffe,et al.  Designing presentation in multimedia interfaces , 1994, CHI '94.

[18]  Stefano Ceri,et al.  Model-driven development of context-aware Web applications , 2007, TOIT.

[19]  Craig Larman,et al.  Applying UML and patterns , 1997 .

[20]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[21]  John M. Carroll,et al.  Scenario-based design: envisioning work and technology in system development: john wiley & sons , 1995 .

[22]  Mark T. Maybury,et al.  Planning Multimedia Explanations Using Communicative Acts , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[23]  Jeffrey Nichols,et al.  Improving automatic interface generation with smart templates , 2004, IUI '04.

[24]  Jean Vanderdonckt,et al.  Applying model-based techniques to the development of UIs for mobile computers , 2001, IUI '01.

[25]  Phan Minh Dung,et al.  Stepwise development of security protocols: a speech act-oriented approach , 2004, FMSE '04.

[26]  Fabio Paternò,et al.  Design and development of multidevice user interfaces through multiple logical descriptions , 2004, IEEE Transactions on Software Engineering.

[27]  Holger Brocks,et al.  Agent-Based User Interface Customization in a System-Mediated Collaboration Environment , 2003 .

[28]  Hermann Kaindl,et al.  From Usage Scenarios to User Interface Elements in a Few Steps , 2002, CADUI.

[29]  Timothy W. Finin,et al.  KQML as an agent communication language , 1994, CIKM '94.