User interface plasticity: model driven engineering to the limit!

Ten years ago, I introduced the notion of user interface plasticity to denote the capacity of user interfaces to adapt, or to be adapted, to the context of use while preserving usability. The Model Driven Engineering (MDE) approach, which was used for user interface generation since the early eighties in HCI, has recently been revived to address this complex problem. Although MDE has resulted in interesting and convincing results for conventional WIMP user interfaces, it has not fully demonstrated its theoretical promises yet. In this paper, we discuss how to push MDE to the limit in order to reconcile high-level modeling techniques with low-level programming in order to go beyond WIMP user interfaces.

[1]  Joëlle Coutaz,et al.  Plasticity of User Interfaces: Framework and Research Agenda , 1999, INTERACT.

[2]  Peter Tandler.  Software Infrastructure for Ubiquitous Computing Environments: Supporting Synchronous Collaboration with Heterogeneous Devices , 2001, UbiComp.

[3]  Fabio Casati,et al.  A framework for rapid integration of presentation components , 2007, WWW '07.

[4]  Peyman Oreizy,et al.  An architecture-based approach to self-adaptive software , 1999, IEEE Intell. Syst..

[5]  Pedro A. Szekely,et al.  Design alternatives for user interface management sytems based on experience with COUSIN , 1985, CHI '85.

[6]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[7]  Brad A. Myers,et al.  How designers design and program interactive behaviors , 2008, 2008 IEEE Symposium on Visual Languages and Human-Centric Computing.

[8]  Brad A. Myers,et al.  Creating user interfaces using programming by example, visual programming, and constraints , 1990, TOPL.

[9]  Tom Mens,et al.  04101 Discussion - A Taxonomy of Model Transformations , 2004, Language Engineering for Model-Driven Software Development.

[10]  Joëlle Coutaz,et al.  CAMELEON-RT: A Software Architecture Reference Model for Distributed, Migratable, and Plastic User Interfaces , 2004, EUSAI.

[11]  Mark W. Newman,et al.  Designing for serendipity: supporting end-user configuration of ubiquitous computing environments , 2002, DIS '02.

[12]  Karin Coninx,et al.  COMET(s), A Software Architecture Style and an Interactors Toolkit for Plastic User Interfaces , 2008, DSV-IS.

[13]  David Garlan,et al.  The Aura software architecture : an infrastructure for ubiquitous computing , 2003 .

[14]  Klaus Meißner,et al.  Dynamic Composition of Service-Oriented Web User Interfaces , 2009, 2009 Fourth International Conference on Internet and Web Applications and Services.

[15]  Brad A. Myers,et al.  Huddle: Automatically Generating Interfaces for Systems of Multiple Connected Appliances , 2006 .

[16]  Alain Abran,et al.  Interactive Systems Engineering: A Pattern-Orientedand Model-Driven Architecture , 2009, Software Engineering Research and Practice.

[17]  Brad A. Myers,et al.  Past, Present and Future of User Interface Software Tools , 2000, TCHI.

[18]  Jean Vanderdonckt,et al.  SketchiXML: towards a multi-agent design tool for sketching user interfaces based on USIXML , 2004, TAMODIA '04.

[19]  Jean Vanderdonckt,et al.  Plasticity of User Interfaces: A Revised Reference Framework , 2002, TAMODIA.

[20]  Jeffrey Nichols,et al.  Huddle: automatically generating interfaces for systems of multiple connected appliances , 2006, UIST.

[21]  T. Mens,et al.  A Taxonomy of Model Transformations , 2004 .

[22]  Fabio Paternò,et al.  Migratory MultiModal interfaces in MultiDevice environments , 2005, ICMI '05.

[23]  Jean-Sébastien Sottet,et al.  Towards Model-driven Engineering of Plastic User Interfaces , 2005, MDDAUI.

[24]  Jean Bézivin,et al.  First experiments with the ATL model transformation language: Transforming XSLT into XQuery , 2003 .

[25]  Lionel Balme,et al.  Interfaces homme-machine plastiques : une approche par composants dynamiques , 2008 .

[26]  Jean Vanderdonckt,et al.  Recovering Alternative Presentation Models of a Web Page with VAQUITA , 2002, CADUI.

[27]  Patrick Baudisch,et al.  Introduction to this Special Issue on Ubiquitous Multi-Display Environments , 2009, Hum. Comput. Interact..

[28]  Krzysztof Z. Gajos,et al.  Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces , 2008, CHI.

[29]  Arnaud Lewandowski,et al.  Defining Task Oriented Components , 2007, TAMODIA.

[30]  Oliver Brdiczka,et al.  Context‐aware environments: from specification to implementation , 2007, Expert Syst. J. Knowl. Eng..

[31]  Jean-Sébastien Sottet,et al.  A Model-Driven Engineering Approach for the Usability of Plastic User Interfaces , 2008, EHCI/DS-VIS.

[32]  Joëlle Coutaz,et al.  Meta-User Interfaces for Ambient Spaces , 2006, TAMODIA.

[33]  Jean-Yves Tigli,et al.  Models at Runtime: Service for Device Composition and Adaptation , 2009 .

[34]  Maria Luisa Villani,et al.  Dynamic composition of web applications in human-centered processes , 2009, 2009 ICSE Workshop on Principles of Engineering Service Oriented Systems.

[35]  David Canfield Smith,et al.  Pygmalion: an executable electronic blackboard , 1993 .

[36]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[37]  Richard A. Bolt,et al.  “Put-that-there”: Voice and gesture at the graphics interface , 1980, SIGGRAPH '80.

[38]  Murray Crease,et al.  Caring, Sharing Widgets: A Toolkit of Sensitive Widgets , 2000, BCS HCI.

[39]  Pat Hanrahan,et al.  ICrafter: A Service Framework for Ubiquitous Computing Environments , 2001, UbiComp.

[40]  Jan Van den Bergh,et al.  Dygimes: Dynamically Generating Interfaces for Mobile Computing Devices and Embedded Systems , 2003, Mobile HCI.