Ambient Intelligence in Edutainment: Tangible Interaction with Life-Like Exhibit Guides

We present COHIBIT, an edutainment exhibit for theme parks in an ambient intelligence environment. It combines ultimate robustness and simplicity with creativity and fun. The visitors can use instrumented 3D puzzle pieces to assemble a car. The key idea of our edutainment framework is that all actions of a visitor are tracked and commented by two life-like guides. Visitors get the feeling that the anthropomorphic characters observe, follow and understand their actions and provide guidance and motivation for them. Our mixed-reality installation provides a tangible, (via the graspable car pieces), multimodal, (via the coordinated speech, gestures and body language of the virtual character team) and immersive (via the large-size projection of the life-like characters) experience for a single visitor or a group of visitors. The paper describes the context-aware behavior of the virtual guides, the domain modeling and context classification as well as the event recognition in the instrumented environment.

[1]  Wolfgang Wahlster,et al.  The anthropomorphized product shelf: Symmetric multimodal interaction with instrumented environments , 2006 .

[2]  Hiroshi Ishii,et al.  Emerging frameworks for tangible user interfaces , 2000, IBM Syst. J..

[3]  Howard Rheingold,et al.  Virtual Reality , 1991 .

[4]  Thomas Rist,et al.  CrossTalk: An Interactive Installation with Animated Presentation Agents , 2002 .

[5]  Adrian David Cheok,et al.  Magic Land : a 3 D Human Capture Mixed Reality System for Museum Experiences , 2005 .

[6]  Thomas Rist,et al.  Authoring scenes for adaptive, interactive performances , 2003, AAMAS '03.

[7]  John M. Carroll,et al.  Human-Computer Interaction in the New Millennium , 2001 .

[8]  Thomas Rist,et al.  Staging exhibitions: methods and tools for modelling narrative structure to produce interactive performances with virtual actors , 2003, Virtual Reality.

[9]  Philip R. Cohen,et al.  Tangible multimodal interfaces for safety-critical applications , 2004, CACM.

[10]  Patrick Gebhard,et al.  Using Real Objects to Communicate with Virtual Characters , 2005, IVA.

[11]  Mitsuru Ishizuka,et al.  Life-like characters - tools, affective functions, and applications , 2004, Life-like characters.

[12]  Wei Liu,et al.  Real-time 3D human capture system for mixed-reality art and entertainment , 2005, IEEE Transactions on Visualization and Computer Graphics.

[13]  Antonio Krüger,et al.  The museum visit: generating seamless personalized presentations on multiple devices , 2004, IUI '04.