Mixed reality participants in smart meeting rooms and smart home environments

Human–computer interaction requires modeling of the user. A user profile typically contains preferences, interests, characteristics, and interaction behavior. However, in its multimodal interaction with a smart environment the user displays characteristics that show how the user, not necessarily consciously, verbally and nonverbally provides the smart environment with useful input and feedback. Especially in ambient intelligence environments we encounter situations where the environment supports interaction between the environment, smart objects (e.g., mobile robots, smart furniture) and human participants in the environment. Therefore it is useful for the profile to contain a physical representation of the user obtained by multi-modal capturing techniques. We discuss the modeling and simulation of interacting participants in a virtual meeting room, we discuss how remote meeting participants can take part in meeting activities and they have some observations on translating research results to smart home environments.

[1]  Alexander H. Waibel.  CHIL - Computers in the Human Interaction Loop , 2005, MVA.

[2]  Anton Nijholt.  Meetings in the virtuality continuum: send your avatar , 2005, 2005 International Conference on Cyberworlds (CW'05).

[3]  Kurt Saar,et al.  VIRTUS: a collaborative multi-user platform , 1999, VRML.

[4]  W. L. Johnson,et al.  Proceedings of the First International Joint Conference on Autonomous Agents and Multiagent Systems , 2002 .

[5]  Gustavo Alonso,et al.  Understanding replication in databases and distributed systems , 2000, Proceedings 20th IEEE International Conference on Distributed Computing Systems.

[6]  Samy Bengio,et al.  Towards Computer Understanding of Human Interactions , 2003, EUSAI.

[7]  Stephan Diehl,et al.  Proceedings of the fourth symposium on Virtual reality modeling language , 1999 .

[8]  Norbert A. Streitz,et al.  User requirements for intelligent home environments: a scenario-driven approach and empirical cross-cultural study , 2005, sOc-EUSAI '05.

[9]  Rune B. Lyngsø,et al.  Lecture Notes I , 2008 .

[10]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.

[11]  Witold Pedrycz,et al.  Ambient Intelligence, Wireless Networking, And Ubiquitous Computing , 2006 .

[12]  Tricia Walker,et al.  Computer science , 1996, English for academic purposes series.

[13]  Anton Nijholt,et al.  Meetings and Meeting Support in Ambient Intelligence , 2006 .

[14]  Dirk Heylen,et al.  Towards real-time Body Pose Estimation for Presenters in Meeting Environments , 2005, WSCG.

[15]  Sharon L. Oviatt,et al.  Individual differences in multimodal integration patterns: what are they and why do they exist? , 2005, CHI.

[16]  Emmanuel Frécon,et al.  Building distributed virtual environments to support collaborative work , 1998, VRST '98.

[17]  Dirk Heylen,et al.  Virtual meeting rooms: from observation to simulation , 2007, AI & SOCIETY.

[18]  David R. Traum,et al.  Embodied agents for multi-party dialogue in immersive virtual worlds , 2002, AAMAS '02.

[19]  Roel Vertegaal,et al.  OverHear: augmenting attention in remote social gatherings through computer-mediated hearing , 2005, CHI EA '05.

[20]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[21]  Jessica K. Hodgins,et al.  Temporal notions of synchronization and consistency in Beehive , 1997, SPAA '97.

[22]  Kiyoharu Aizawa,et al.  Experience retrieval in a ubiquitous home , 2005, CARPE '05.