HideOut: mobile projector interaction with tangible objects and surfaces

HideOut is a mobile projector-based system that enables new applications and interaction techniques with tangible objects and surfaces. HideOut uses a device mounted camera to detect hidden markers applied with infrared-absorbing ink. The obtrusive appearance of fiducial markers is avoided and the hidden marker surface doubles as a functional projection surface. We present example applications that demonstrate a wide range of interaction scenarios, including media navigation tools, interactive storytelling applications, and mobile games. We explore the design space enabled by the HideOut system and describe the hidden marker prototyping process. HideOut brings tangible objects to life for interaction with the physical world around us.

[1]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[2]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[3]  Hideki Koike,et al.  Transparent 2-D markers on an LCD tabletop system , 2009, CHI.

[4]  Lisa G. Cowan,et al.  ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows , 2011, CHI.

[5]  Scott E. Hudson,et al.  Moveable interactive projected displays using projector based tracking , 2005, UIST.

[6]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.

[7]  Scott E. Hudson,et al.  Foldable interactive displays , 2008, UIST '08.

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Chris Harrison,et al.  OmniTouch: wearable multitouch interaction everywhere , 2011, UIST.

[10]  Daniela Karin Rosner,et al.  Spyn: augmenting knitting to support storytelling and reflection , 2008, UbiComp.

[11]  Xiang Cao,et al.  Interactive Environment-Aware Handheld Projectors for Pervasive Computing Spaces , 2012, Pervasive.

[12]  Tovi Grossman,et al.  MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector , 2010, CHI.

[13]  Daniel J. Wigdor,et al.  AnatOnMe: facilitating doctor-patient communication using a projection-based handheld device , 2011, CHI.

[14]  Tek-Jin Nam.  Sketch-based rapid prototyping platform for hardware-software integrated interactive products , 2005, CHI EA '05.

[15]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[16]  Jong-Il Park,et al.  Invisible marker based augmented reality system , 2005, Visual Communications and Image Processing.

[17]  Hideki Koike,et al.  3-D interaction with a large wall display using transparent markers , 2010, AVI.

[18]  Masatoshi Okutomi,et al.  A user-friendly method to geometrically calibrate projector-camera systems , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[19]  Ivan Poupyrev,et al.  Motionbeam: a metaphor for character interaction with handheld projectors , 2011, CHI.

[20]  Greg Welch,et al.  Shader Lamps: Animating Real Objects With Image-Based Illumination , 2001, Rendering Techniques.

[21]  Jong-Il Park,et al.  Invisible Marker–Based Augmented Reality , 2010, Int. J. Hum. Comput. Interact..

[22]  Jong-Il Park,et al.  Invisible marker tracking for AR , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[23]  Hrvoje Benko,et al.  Combining multiple depth cameras and projectors for interactions on, above and between surfaces , 2010, UIST.

[24]  Martin C. Emele,et al.  SPOTLIGHT NAVIGATION: INTERACTION WITH A HANDHELD PROJECTION DEVICE , 2004 .

[25]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[26]  Dan Rosenfeld,et al.  Going beyond the display: a surface technology with an electronically switchable diffuser , 2008, UIST '08.

[27]  Pattie Maes,et al.  WUW - wear Ur world: a wearable gestural interface , 2009, CHI Extended Abstracts.

[28]  Jacob O. Wobbrock,et al.  Bonfire: a nomadic system for hybrid laptop-tabletop interaction , 2009, UIST '09.

[29]  Heidrun Schumann,et al.  Tangible views for information visualization , 2010, ITS '10.

[30]  Naokazu Yokoya,et al.  Localization system for large indoor environments using invisible markers , 2008, VRST '08.

[31]  Ivan Poupyrev,et al.  SideBySide: ad-hoc multi-user interaction with handheld projectors , 2011, UIST.

[32]  Naoki Kawakami,et al.  Twinkle: Interacting with physical surfaces using handheld projector , 2010, 2010 IEEE Virtual Reality Conference (VR).

[33]  Claudio S. Pinhanez.  The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[34]  Gwi-Tae Park,et al.  Anamorphosis Projection by Ubiquitous Display in Intelligent Space , 2009, HCI.

[35]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[36]  Max Mühlhäuser,et al.  LightBeam: nomadic pico projector interaction with real world objects , 2012, CHI EA '12.

[37]  Ramesh Raskar,et al.  Dynamic shader lamps : painting on movable objects , 2001, Proceedings IEEE and ACM International Symposium on Augmented Reality.