Enabling Multimodal Interaction in XPL the eXtensible Presentation Language

This paper introduces the multimodal extension of the eXtensible Presentation architecture and Language (XPL), a framework aimed at streamlining multi-channel interface design process and enabling full component reuse. XPL incorporates a presentation language based on design pattern paradigm, which supplies a clear distinction between the presentation layer and the corresponding programming logic, promoting contents aggregation and a variety of event handlers described without relying on a (procedural) scripting language. In this paper, the design pattern concept is extended to voice-based interaction, and two verbal design pattern (VeDP) are introduced along to their visual counterparts. This multimodal extension enables user interface designers to develop application interfaces for multiple access channels within a single development framework. To illustrate the benefits of using XPL in a large software design project, a case study, showing the development of user interfaces for a web-based application, is fully detailed.

[1]  Steven K. Feiner,et al.  Visual task characterization for automated visual discourse synthesis , 1998, CHI.

[2]  Jani Mäntyjärvi,et al.  Managing Context Information in Mobile Devices , 2003, IEEE Pervasive Comput..

[3]  Jenifer Tidwell.  INTERACTION DESIGN PATTERNS: P29 , 1998 .

[4]  Lorraine Johnston,et al.  Pattern languages for usability: an investigation of alternative approaches , 1998, Proceedings. 3rd Asia Pacific Computer Human Interaction (Cat. No.98EX110).

[5]  Max Jacobson,et al.  A Pattern Language: Towns, Buildings, Construction , 1981 .

[6]  Carl Bedingfield.  A pattern language for web usability , 2003, UBIQ.

[7]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[8]  Gerrit C. van der Veer,et al.  Patterns as Tools for User Interface Design , 2000, TFWWG.

[9]  Gregg C. Vanderheiden,et al.  Web content accessibility guidelines 1.0 , 2001, INTR.

[10]  Gregg C. Vanderheiden,et al.  Web Content Accessibility Guidelines 1.0 W3C DRAFT Proposed Recommendation , 1999 .

[11]  Antonio Gentile,et al.  XPL, a Presentation Language based on User Interface Design Pattern , 2007, 6th IEEE/ACIS International Conference on Computer and Information Science (ICIS 2007).

[12]  Liam J. Bannon,et al.  A pilgrim's progress: From cognitive science to cooperative design , 1990, AI & SOCIETY.

[13]  Fabio Paternò,et al.  Tool support for designing nomadic applications , 2003, IUI '03.

[14]  Jan O. Borchers.  A pattern approach to interaction design , 2001, DIS '00.

[15]  Marc Abrams,et al.  UIML: An Appliance-Independent XML User Interface Language , 1999, Comput. Networks.

[16]  Sally Fincher,et al.  Analysis of design: an exploration of patterns and pattern languages for pedagogy , 1999 .

[17]  James A. Landay,et al.  The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience , 2002 .

[18]  Jason Cranford Teague,et al.  DHTML and CSS for the World Wide Web : Visual QuickStart Guide , 2001 .

[19]  Kevin E. Mullet.  Structuring Pattern Languages to Facilitate Design , 2002 .