Fully-automatic generation of user interfaces for multiple devices from a high-level model based on communicative acts

The problems involved in the development of user interfaces become even more severe through the ubiquitous use of a variety of devices such as PCs, mobile phones and PDAs. Each of these devices has its own specifics that require a special user interface. Therefore, we developed and implemented an approach to generate user interfaces for multiple devices fully automatically from a high-level model. In contrast to previous approaches focusing on abstracting the user interface per se, we make use of speech act theory from the philosophy of language for the specification of desired intentions in interactions. Our new approach of using communicative acts in high-level models of user interfaces allows their creation with less technical knowledge, since such models are easier to provide than user-interface code in a usual programming language. From one such high-level model, multiple user interfaces for diverse devices are rendered fully automatically using a number of heuristics. A generated user interface for a PDA is already in real-world use and its usability was informally evaluated as good

[1]  Steven Orla Kimbrough,et al.  On automated message processing in electronic commerce and work support systems: speech act theory and expressive felicity , 1997, TOIS.

[2]  Hermann Kaindl,et al.  A discourse model for interaction design based on theories of human communication , 2006, CHI EA '06.

[3]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[4]  Timothy W. Finin,et al.  KQML as an agent communication language , 1994, CIKM '94.

[5]  Fabio Paternò,et al.  Design and development of multidevice user interfaces through multiple logical descriptions , 2004, IEEE Transactions on Software Engineering.

[6]  Hermann Kaindl,et al.  Fully-automatic generation of user interfaces for multiple devices from a high-level model based on communicative acts , 2007, HICSS.

[7]  Jeffrey Nichols,et al.  Improving automatic interface generation with smart templates , 2004, IUI '04.

[8]  L. Stein,et al.  OWL Web Ontology Language - Reference , 2004 .

[9]  Holger Brocks,et al.  Agent-Based User Interface Customization in a System-Mediated Collaboration Environment , 2003 .

[10]  Nicolas Lhuillier,et al.  FOUNDATION FOR INTELLIGENT PHYSICAL AGENTS , 2003 .

[11]  Oscar Pastor,et al.  Using Profiles to Support Model Transformations in the Model-Driven Development of User Interfaces , 2008, CADUI.

[12]  Hermann Kaindl,et al.  Generating an Abstract User Interface from a Discourse Model Inspired by Human Communication , 2008, Proceedings of the 41st Annual Hawaii International Conference on System Sciences (HICSS 2008).

[13]  Spencer Rugaber,et al.  Using Declarative Descriptions to Model User Interfaces with MASTERMIND , 1997 .

[14]  Hermann Kaindl,et al.  Transforming Discourse Models to Structural User Interface Models , 2008, MoDELS.

[15]  Philippe Palanque,et al.  Using Declarative Descriptions to Model User Interfaces with MASTERMIND , 1998 .

[16]  Jean Vanderdonckt,et al.  Applying model-based techniques to the development of UIs for mobile computers , 2001, IUI '01.

[17]  Mark T. Maybury,et al.  Planning Multimedia Explanations Using Communicative Acts , 1991, AAAI Workshop on Intelligent Multimedia Interfaces.

[18]  Phan Minh Dung,et al.  Stepwise development of security protocols: a speech act-oriented approach , 2004, FMSE '04.

[19]  Hermann Kaindl,et al.  Modeling of interaction design by end users through discourse modeling , 2008, IUI '08.

[20]  Martin K. Purvis,et al.  Communicative acts and interaction protocols in a distributed information system , 2003, AAMAS '03.

[21]  Larry L. Constantine,et al.  Software for Use - A Practical Guide to the Models and Methods of Usage-Centered Design , 1999 .

[22]  Fabio Paternò,et al.  Automatically adapting web sites for mobile access through logical descriptions and dynamic analysis of interaction resources , 2008, AVI '08.

[23]  William C. Mann,et al.  Rhetorical Structure Theory: Toward a functional theory of text organization , 1988 .

[24]  John M. Carroll,et al.  Scenario-based design: envisioning work and technology in system development: john wiley & sons , 1995 .

[25]  Jeffrey Nichols,et al.  Generating remote control interfaces for complex appliances , 2002, UIST '02.

[26]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.

[27]  Henk Sol,et al.  Proceedings of the 54th Hawaii International Conference on System Sciences , 1997, HICSS 2015.

[28]  Hermann Kaindl,et al.  Automatic Generation of the Behavior of a User Interface from a High-Level Discourse Model , 2009, 2009 42nd Hawaii International Conference on System Sciences.

[29]  Craig Larman,et al.  Applying UML and patterns , 1997 .

[30]  Angel R. Puerta,et al.  A Model-Based Interface Development Environment , 1997, IEEE Softw..

[31]  Stefano Ceri,et al.  Model-driven development of context-aware Web applications , 2007, TOIT.

[32]  By MarcAbrams,et al.  UIML : An XML Language for Building Device-Independent User Interfaces , 1999 .

[33]  Stina Nylander,et al.  The ubiquitous interactor: universal access to mobile services. , 2003 .

[34]  Hermann Kaindl,et al.  Using communicative acts in high-level specifications of user interfaces for their automated synthesis , 2005, ASE '05.

[35]  Hermann Kaindl,et al.  Fully automatic user interface generation from discourse models , 2009, IUI.

[36]  R. Want,et al.  System challenges for ubiquitous & pervasive computing , 2005, Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005..

[37]  Jean Vanderdonckt,et al.  A Unifying Reference Framework for multi-target user interfaces , 2003, Interact. Comput..

[38]  Jacob Eisenstein,et al.  XIML: a common representation for interaction data , 2002, IUI '02.

[39]  Hermann Kaindl,et al.  UI Prototyping for Multiple Devices Through Specifying Interaction Design , 2007, INTERACT.

[40]  Jean Vanderdonckt,et al.  Graceful degradation of user interfaces as a design method for multiplatform systems , 2004, IUI '04.

[41]  Krzysztof Z. Gajos,et al.  SUPPLE: automatically generating user interfaces , 2004, IUI '04.