Turning Augmented Reality into a media: Design exploration to build a dedicated visual language

This work collects the explorations conducted within the EPFL+ECAL Lab by several designers to interpret the various spheres of action of Augmented Reality in order to derive visual principles. These principles seek to contribute to developing a specific visual grammar, which is essential if Augmented Reality is to go beyond technological performance to acquire the status of a true media, like all other vision-based media. This visual grammar constitutes a reference based on which designers may then build projects whose narrative and/or emotional content captivates the end-user. The research presented starts from an artistic approach through design and derives generic principles. The starting point is the development of actual AR installations and their presentation to the general public in the form of an evolving exhibition entitled Give Me More. Following two initial presentations in Lausanne and San Francisco, Give Me More was the winner of the DMY International Design Festival Berlin 2010. The designers' work relies on the software and research of the EPFL Computer Vision Laboratory (CVLab) and Dr Julien Pilet. The results have made it possible to define certain rules for visual links between the physical and virtual worlds, simple narrative principles for the animations and a global approach for the design of representation devices. The results also show that there is much work yet to be done in order to devise an initial global visual grammar for Augmented Reality — an absolute prerequisite to turn this into a fully-fledged media.

[1]  Dieter Schmalstieg,et al.  Global pose estimation using multi-sensor fusion for outdoor Augmented Reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[2]  Marc Cavazza,et al.  Narratology for Interactive Storytelling: A Critical Introduction , 2006, TIDSE.

[3]  Vincent Lepetit,et al.  Retexturing in the Presence of Complex Illumination and Occlusions , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[4]  Takuji Narumi,et al.  Digital Diorama system for museum exhibition , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[5]  Fredie Floré,et al.  Super Normal: Sensations of the Ordinary , 2011 .

[6]  Vincent Lepetit,et al.  The haunted book , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[7]  Blair MacIntyre,et al.  Butterfly effect: an augmented reality puzzle game , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[8]  Steven K. Feiner,et al.  Perceptual issues in augmented reality revisited , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[9]  Anna Carreras,et al.  Coupling digital and physical worlds in an AR magic show performance: Lessons learned , 2009, 2009 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media and Humanities.

[10]  P. Fua,et al.  Memories of the world of the mountains , 2009 .

[11]  Vincent Lepetit,et al.  Keypoint recognition using randomized trees , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Wolfgang Birkfellner,et al.  A head-mounted operating binocular for augmented reality visualization in medicine - design and initial evaluation , 2002, IEEE Transactions on Medical Imaging.

[13]  Julien Pilet,et al.  Happy wear , 2009, SIGGRAPH ASIA '09.