Logical User Interface Modeling for Multimedia Embedded Systems

Multimedia embedded systems such as smart phones, tablets, and smart TVs are ever proliferating. One of the major hurdles for reusing applications for multiple multimedia embedded systems is user interfaces (UIs) cannot be the same for the target embedded systems. While there have been many research activities regarding model-based UI development environments, they are focused on web of desk-top based systems and not suitable for embedded systems. This paper proposes logical user interface modeling for multimedia embedded systems (LUMME). LUMME incorporates the notions of reference containers and multimedia instance presentations. While conventional approaches model only visible UI components, LUMME incorporate events as a first-class modeling entity, which is essential to model UIs for embedded systems. Moreover, LUMME does not employ the task model, which is widely employed in conventional approaches, but incorporates events as navigators. We have fully implemented a modeling tool for LUMME as Eclipse rich-client platform (RCP) using Eclipse Graphical Modeling Framework (GMF). We have also performed a case study with a gallery application in Android targeted for multiple embedded systems with various resolutions from HVGA to XGA. The case study clearly shows how LUMME makes the modeling of UIs for multimedia embedded systems concise and allows reusing UIs for multiple multimedia embedded systems.

[1]  Paulo Pinheiro da Silva,et al.  User interface declarative models and development environments: a survey , 2000 .

[2]  Marco Winckler,et al.  Human-Computer Interaction - INTERACT 2009, 12th IFIP TC 13 International Conference, Uppsala, Sweden, August 24-28, 2009, Proceedings, Part I , 2009, INTERACT.

[3]  Wan Jiancheng,et al.  User Interface Design Model , 2007, Eighth ACIS International Conference on Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing (SNPD 2007).

[4]  Jørgen Staunstrup.  Design Specification and Verification , 1997 .

[5]  Jan O. Borchers.  A pattern approach to interaction design , 2001, DIS '00.

[6]  Jean Vanderdonckt,et al.  A Unifying Reference Framework for multi-target user interfaces , 2003, Interact. Comput..

[7]  Jean Vanderdonckt,et al.  Model-Driven Engineering of Multi-target Plastic User Interfaces , 2008, Fourth International Conference on Autonomic and Autonomous Systems (ICAS'08).

[8]  Xue Jun Li,et al.  Design and implementation of user interface for mobile devices , 2004, IEEE Transactions on Consumer Electronics.

[9]  Ivar Jacobson,et al.  Unified Modeling Language , 2020, Definitions.

[10]  Edwin D. Reilly,et al.  Interactive system , 2003 .

[11]  Oscar Pastor,et al.  Transformation templates: adding flexibility to model-driven engineering of user interfaces , 2010, SAC '10.

[12]  Sophie Dupuy-Chessa,et al.  A Survey of Model Driven Engineering Tools for User Interface Design , 2007, TAMODIA.

[13]  Joëlle Coutaz,et al.  User interface plasticity: model driven engineering to the limit! , 2010, EICS '10.

[14]  Fabio Paternò,et al.  Model-Based Design of Multi-device Interactive Applications Based on Web Services , 2009, INTERACT.

[15]  Saehwa Kim.  Pattern and Event Based Logical UI Modeling for Multi-Device Embedded Applications , 2011, ICHIT.

[16]  Jean Vanderdonckt,et al.  Model-Driven Engineering of User Interfaces: Promises, Successes, Failures, and Challenges , 2008 .

[17]  Dominik Ślęzak,et al.  Convergence and Hybrid Information Technology - 5th International Conference, ICHIT 2011, Daejeon, Korea, September 22-24, 2011. Proceedings , 2011, ICHIT.

[18]  Fabio Paternò,et al.  Design and development of multidevice user interfaces through multiple logical descriptions , 2004, IEEE Transactions on Software Engineering.