Windows to other places: exploring solutions for seeing through walls using handheld projection

Mobile projection offers an interesting technology for creating displays on any surface without a situated screen. In this paper, we investigate two concepts that use handheld projection to see to other places through a virtual window. Firstly, we present a projector phone based prototype which, when pointed to the walls of a room, reveals images and a video stream from the physical space on the other side of the wall. Secondly, a novel handheld dual-display virtual reality browser that opens a virtual window to a remote location is presented. This prototype combines two displays, a screen and a projected display. Both concepts were evaluated in user studies (n=22 and n=23). We report, for example, that mobile projector based browsing was considered more fun and inspiring than a screen and mouse format, and that the horizon level of the projected image should be kept horizontal when browsing.

[1]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[2]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[3]  Robert J. Teather,et al.  Exaggerated head motions for game viewpoint control , 2008, Future Play.

[4]  Ivan Poupyrev,et al.  SideBySide: ad-hoc multi-user interaction with handheld projectors , 2011, UIST.

[5]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[6]  Paul A. Beardsley,et al.  Natural video matting using camera arrays , 2006, ACM Trans. Graph..

[7]  Cullen D. Jackson,et al.  CAVE and fishtank virtual-reality displays: a qualitative and quantitative comparison , 2006, IEEE Transactions on Visualization and Computer Graphics.

[8]  Itiro Siio,et al.  Real-world interaction using the FieldMouse , 1999, UIST '99.

[9]  Matt Jones,et al.  Pico projectors: firefly or bright future? , 2012, INTR.

[10]  Keith Cheverst,et al.  Exploring User Reaction to Personal Projection when used in Shared Public Places: A Formative Study , 2009 .

[11]  Hans-Werner Gellersen,et al.  Personal Projectors for Pervasive Computing , 2012, IEEE Pervasive Computing.

[12]  Enrico Rukzio,et al.  Interactive phone call: synchronous remote collaboration and projected interactive surfaces , 2011, ITS '11.

[13]  Mary Czerwinski,et al.  Immersion in desktop virtual reality , 1997, UIST '97.

[14]  Xiang Cao,et al.  Interactive Environment-Aware Handheld Projectors for Pervasive Computing Spaces , 2012, Pervasive.

[15]  Clemens Holzmann,et al.  Wall Play: a novel wall/floor interaction concept for mobile projected gaming , 2012, Mobile HCI.

[16]  Marcelo Knörich Zuffo,et al.  An experience using X3D for virtual cultural heritage , 2007, Web3D '07.

[17]  Johannes Schöning,et al.  Marauders light: replacing the wand with a mobile camera projector unit , 2009, MUM.

[18]  Johannes Schöning,et al.  Map torchlight: a mobile augmented reality camera projector unit , 2009, CHI Extended Abstracts.

[19]  Moshe Mahler,et al.  HideOut: mobile projector interaction with tangible objects and surfaces , 2013, TEI '13.

[20]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[21]  Masahiko Inami,et al.  Optical camouflage using retro-reflective projection technology , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[22]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.

[23]  Frank H. Durgin,et al.  Distance Perception and the Visual Horizon in Head-Mounted Displays , 2005, TAP.

[24]  Chris Harrison,et al.  OmniTouch: wearable multitouch interaction everywhere , 2011, UIST.

[25]  Martin C. Emele,et al.  SPOTLIGHT NAVIGATION: INTERACTION WITH A HANDHELD PROJECTION DEVICE , 2004 .

[26]  Kosuke Sato,et al.  Document search support by making physical documents transparent in projection-based mixed reality , 2011, Virtual Reality.

[27]  Leonardo Bonanni,et al.  Attention-based design of augmented reality interfaces , 2005, CHI Extended Abstracts.

[28]  Ivan Poupyrev,et al.  Motionbeam: a metaphor for character interaction with handheld projectors , 2011, CHI.