Mobile Interaction in Real Augmented Environments: Principles, Platforms, Development Processes and Applications

In this chapter we describe a real augmented environment and its associated mobile interactions based on wearable computers with appropriate interaction devices that can be either classical computer interaction devices or real objects augmented with computer interfaces called tangible objects. After presenting the main principles, we describe a concrete platform, related MDA development processes and give several applications. These examples are contextual collaborative maintenance of industrial appliances and associated just-in-time mobile learning and nutritional coaching system supporting practice and learning of management of nutritional decisions in relation to specific requirements in health or high-level sport.

[1]  David Thevenin,et al.  Adaptation en interaction homme-machine : le cas de la plasticité. (Adaptation in Human Computer Interaction: the case of Plasticity) , 2001 .

[2]  Pedro A. Szekely.  Retrospective and Challenges for Model-Based Interface Development , 1996, DSV-IS.

[3]  Yuan-Kai Wang,et al.  Context awareness and adaptation in mobile learning , 2004, The 2nd IEEE International Workshop on Wireless and Mobile Technologies in Education, 2004. Proceedings..

[4]  Fabio Paternò,et al.  CTTE: Support for Developing and Analyzing Task Models for Interactive System Design , 2002, IEEE Trans. Software Eng..

[5]  Nicolas Plouznikoff,et al.  Caractéristiques, enjeux et défis de l'informatique portée , 2004, IHM '04.

[6]  Clarence A. Ellis,et al.  Groupware: some issues and experiences , 1991, CACM.

[7]  Wendy E. Mackay,et al.  Back to the real world , 1993, CACM.

[8]  John J. Leggett,et al.  Interaction styles and input/output devices , 1993, Behav. Inf. Technol..

[9]  J. H. Erik Andriessen,et al.  Working with Groupware: Understanding and Evaluating Collaboration Technology , 2012 .

[10]  Bertrand David,et al.  Contextual Mobile Learning for Repairing Industrial Machines: System Architecture and Development Process , 2008, Int. J. Adv. Corp. Learn..

[11]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[12]  William Noah Schilit,et al.  A system architecture for context-aware mobile computing , 1995 .

[13]  Fabio Paternò.  Model-Based Design and Evaluation of Interactive Applications , 2000 .

[14]  Wendy E. Mackay,et al.  Computer-Augmented Environments: Back to the Real World - Introduction to the Special Issue. , 1993 .

[15]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[16]  Michel Beaudouin-Lafon,et al.  Instrumental interaction: an interaction model for designing post-WIMP user interfaces , 2000, CHI.

[17]  Bertrand David,et al.  ORCHESTRA: Formalism to Express Mobile Cooperative Applications , 2006, CRIWG.

[18]  John M. Carroll,et al.  Making Use: Scenario-Based Design of Human-Computer Interactions , 2000 .

[19]  Bertrand David,et al.  IRVO: an Interaction Model for designing Collaborative Mixed Reality systems , 2005, ArXiv.

[20]  Jacques Wainer,et al.  A conceptual model of groupware , 1994, CSCW '94.

[21]  Bertrand David,et al.  Model-Driven Engineering of Cooperative Systems , 2005 .

[22]  James D. Foley,et al.  The human factors of computer graphics interaction techniques , 1984, IEEE Computer Graphics and Applications.

[23]  Mark Weiser.  The computer for the 21st century , 1991 .

[24]  John M. Carroll,et al.  Design rationale: concepts, techniques, and use , 1996 .

[25]  Jan O. Borchers.  A pattern approach to interaction design , 2001, DIS '00.

[26]  Jean-Yves Tigli,et al.  Ordinateur porté: dispositifs d'entrée sortie , 2005, IHM '05.