Social immersive media: pursuing best practices for multi-user interactive camera/projector exhibits

Based on ten years' experience developing interactive camera/projector systems for public science and culture exhibits, we define a distinct form of augmented reality focused on social interaction: social immersive media. Our work abandons GUI metaphors and builds on the language of cinema, casting users as actors within simulated narrative models. We articulate philosophical goals, design principles, and interaction techniques that create strong emotional responses and social engagement through visceral interaction. We describe approaches to clearly communicate cultural and scientific ideas through the medium. And we demonstrate how practitioners can design interactions that promote specific social behaviors in users.

[1]  Makoto Iida,et al.  Transforming your shadow into colorful visual media: multi-projection of complementary colors , 2005, ACE '05.

[2]  David Rokeby Transforming Mirrors: Subjectivity and Control in Interactive Media , 1995 .

[3]  Charles Eames,et al.  Powers of ten , 2005 .

[4]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[5]  Brenda Laurel,et al.  Computers as theatre , 1991 .

[6]  Golan Levin,et al.  Sounds from Shapes: Audiovisual Performance with Hand Silhouette Contours in The Manual Input Sessions , 2005, NIME.

[7]  Steven M. Seitz,et al.  Techniques for interactive audience participation , 2002, SIGGRAPH '02.

[8]  Steven K. Feiner,et al.  Augmented reality: a new way of seeing. , 2002, Scientific American.

[9]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[10]  Alex Pentland,et al.  The ALIVE system: wireless, full-body interaction with autonomous agents , 1997, Multimedia Systems.

[11]  Kellogg S. Booth,et al.  Shadow Reaching : A New Perspective on Interaction for Large Wall Displays , 2007 .

[12]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[13]  Eileen Bowser,et al.  The Transformation of Cinema, 1907-1915 , 1990 .

[14]  J. Woodfill,et al.  Magic Morphin' Mirror: Person Detection and Tracking , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[15]  K. Crowley,et al.  Designing for Science: Implications from Everyday, Classroom, and Professional Settings. , 2001 .

[16]  Myron W. Krueger,et al.  VIDEOPLACE—an artificial reality , 1985, CHI '85.

[17]  Maurice Merleau-Ponty Phenomenology of Perception , 1964 .

[18]  F. Thomas,et al.  Disney Animation: The Illusion of Life , 1981 .

[19]  Daniel C. Robbins,et al.  Interactive shadows , 1992, UIST '92.

[20]  Gerfried Stocker,et al.  Cyberarts 2005: International Compendium Prix Ars Electronica , 2005 .

[21]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[22]  Daniel G. Aliaga,et al.  An object-oriented framework for the integration of interactive animation techniques , 1991, SIGGRAPH.

[23]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[24]  Myron W. Krueger Environmental technology: making the real world virtual , 1993, CACM.

[25]  L. S. Vygotskiĭ,et al.  Mind in society : the development of higher psychological processes , 1978 .

[26]  Anthony Tang,et al.  Shadow reaching: a new perspective on interaction for large displays , 2007, UIST.

[27]  J. Warren Unencumbered Full Body Interaction in Video Games , 2003 .

[28]  BlumbergBruce,et al.  The ALIVE system , 1997 .

[29]  James D. Hollan,et al.  Direct Manipulation Interfaces , 1985, Hum. Comput. Interact..

[30]  Perttu Hämäläinen,et al.  Martial arts in artificial reality , 2005, CHI.

[31]  Scott Brave,et al.  inTouch: a medium for haptic interpersonal communication , 1997, CHI Extended Abstracts.

[32]  J. Bruner Toward a Theory of Instruction , 1966 .

[33]  John Seely Brown,et al.  The coming age of calm technolgy , 1997 .

[34]  Katie Salen,et al.  Squidball: An Experiment in Large-Scale Motion Capture and Game Design , 2005, INTETAIN.

[35]  Brian Blau,et al.  Electronic Art and Animation Catalog , 1999 .

[36]  Stefan Schlechtweg,et al.  Non-photorealistic computer graphics: modeling, rendering, and animation , 2002 .

[37]  Mira Mezini,et al.  Pi: a Pattern Language , 2009, OOPSLA.

[38]  Ray Bradbury You are here : the Jerde Partnership International , 1999 .

[39]  William Buxton,et al.  Human-computer interaction: a multidisciplinary approach , 1987 .

[40]  Donald Crafton,et al.  Before Mickey: The Animated Film 1898-1928 , 1982 .

[41]  Bay-Wei Chang,et al.  Animation: from cartoons to the user interface , 1993, UIST '93.

[42]  Golan Levin,et al.  Interactive dynamic abstraction , 2000, NPAR '00.

[43]  Shelley Masion Rosenberg Bodily Communication , 1978 .

[44]  Hiroshi Ishii,et al.  ambientROOM: integrating ambient media with architectural space , 1998, CHI Conference Summary.

[45]  Hiroshi Ishii,et al.  curlybot: designing a new class of computational toys , 2000, CHI.

[46]  William Buxton,et al.  Large Displays in Automotive Design , 2000, IEEE Computer Graphics and Applications.

[47]  Andrew Matthews Shadow Garden , 2005 .

[48]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[49]  Stefan Agamanolis,et al.  Exertion interfaces: sports over a distance for social bonding and fun , 2003, CHI '03.

[50]  Dennis H. Rouvray,et al.  Beyond calculation: The next fifty years of computing , 1997 .

[51]  Jenny Edwards,et al.  Understanding Movement as Input for Interaction-a study of Two EyeToy(tm) Games , 2004 .