Modeling Augmented Reality User Interfaces with SSIML/AR

Augmented Reality (AR) technologies open up new possibilities especially for task-focused domains such as assembly and maintenance. However, it can be noticed that there is still a lack of concepts and tools for a structured AR development process and an application specification above the code level. To address this problem we introduce SSIML/AR, a visual modeling language for the abstract specification of AR applications in general and AR user interfaces in particular. With SSIML/AR, three different aspects of AR user interfaces can be described: The user interface structure, the presentation of relevant information depending on the user’s current task and the integration of the user interface with other system components. Code skeletons can be generated automatically from SSIML/AR models. This enables the seamless transition from the design level to the implementation level. In addition, we sketch how SSIML/AR models can be integrated in an overall AR development process.

[1]  Emmanuel Dubois,et al.  ASUR++: Supporting the design of mobile mixed systems , 2003, Interact. Comput..

[2]  Werner Hartmann,et al.  Authoring of a mixed reality assembly instructor for hierarchical structures , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[3]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[4]  Christian Geiger,et al.  A framework for the structured design of VR/AR content , 2000, VRST '00.

[5]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[6]  Zhu Miao A Survey on Augmented Reality , 2004 .

[7]  Ralf Dörner,et al.  Authoring mixed reality - a component and framework-based approach , 2002, IWEC.

[8]  Anneke Kleppe,et al.  MDA explained - the Model Driven Architecture: practice and promise , 2003, Addison Wesley object technology series.

[9]  Emmanuel Dubois,et al.  Notational Support for the Design of Augmented Reality Systems , 2002, DSV-IS.

[10]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[11]  Arnd Vitzthum SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces , 2006, 3D User Interfaces (3DUI'06).

[12]  Andreas Pleuß,et al.  SSIML: designing structure and application integration of 3D scenes , 2005, Web3D '05.

[13]  Daniela Gorski Trevisan,et al.  Focus-based design of mixed reality systems , 2004, TAMODIA '04.

[14]  Florian Ledermann,et al.  An Authoring Framework for Augmented Reality Presentations , 2004 .

[15]  Bernd Brügge,et al.  Results of a study on software architectures for augmented reality systems , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..