The design evolution of LuminAR: a compact and kinetic projected augmented reality interface

LuminAR is a new form factor for a compact and kinetic projected augmented reality interface. This video presents the design evolution iterations of the LuminAR prototypes. In this video we document LuminAR's design process, hardware and software implementation and demonstrate new kinetic interaction techniques. The work presented is motivated through a set of applications that explore scenarios for interactive and kinetic projected augmented reality interfaces. It also opens the door for further explorations of kinetic interaction and promotes the adoption of projected augmented reality as a commonplace user interface modality.

[1]  Claudio S. Pinhanez,et al.  Embedding Interactions in a Retail Store Environment: The Design and Lessons Learned , 2003, INTERACT.

[2]  Bruce Tog Tognazzini,et al.  The “Starfire” video prototype project: a case history , 1994, CHI '94.

[3]  Pierre Wellner,et al.  The DigitalDesk Calculator: Tangible Manipulation on , 1991 .

[4]  Chia Shen.  Multi-user interface and interactions on direct-touch horizontal surfaces: collaborative tabletop research at MERL , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[5]  Yoichi Sato,et al.  Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system , 2001, TCHI.

[6]  J. Geoffrey Chase,et al.  Human-Robot Collaboration: A Literature Review and Augmented Reality Approach in Design , 2008 .

[7]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[8]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[9]  Jakub Segen,et al.  Shadow gestures: 3D hand pose estimation using a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[10]  Jacob O. Wobbrock,et al.  Bonfire: a nomadic system for hybrid laptop-tabletop interaction , 2009, UIST '09.

[11]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[12]  Ramesh Raskar,et al.  Modern approaches to augmented reality: introduction to current approaches , 2006, SIGGRAPH Courses.

[13]  M. B. Widden,et al.  The spring-and-lever balancing mechanism, George Carwardine and the Anglepoise lamp , 2000 .

[14]  Pattie Maes,et al.  LuminAR: portable robotic augmented reality interface design and prototype , 2010, UIST '10.

[15]  William Newman,et al.  A desk supporting computer-based interaction with paper documents , 1992, CHI.

[16]  Alexandru Dancu,et al.  The Ultimate Display , 2014 .

[17]  William Buxton,et al.  Usability evaluation considered harmful (some of the time) , 2008, CHI.

[18]  Jun Rekimoto,et al.  Augmented surfaces: a spatially continuous work space for hybrid computing environments , 1999, CHI '99.

[19]  Alex Pentland,et al.  Learning words from sights and sounds: a computational model , 2002, Cogn. Sci..

[20]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[21]  Hao Jiang,et al.  WeSpace: the design development and deployment of a walk-up and share multi-surface visual collaboration system , 2009, CHI.

[22]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[23]  Cynthia Breazeal,et al.  Anticipatory Perceptual Simulation for Human-Robot Joint Practice: Theory and Application Study , 2008, AAAI.

[24]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[25]  Shahzad Malik,et al.  Visual touchpad: a two-handed gestural input device , 2004, ICMI '04.

[26]  Myron W. Krueger,et al.  VIDEOPLACE—an artificial reality , 1985, CHI '85.

[27]  Julien Letessier,et al.  Visual tracking of bare fingers for interactive surfaces , 2004, UIST '04.

[28]  Cynthia Breazeal,et al.  Experiments with a robotic computer: Body, affect and cognition interactions , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  C. Breazeal,et al.  Ensemble: fluency and embodiment for robots acting with humans , 2007 .

[30]  William Buxton,et al.  Issues and techniques in touch-sensitive tablet input , 1985, SIGGRAPH '85.

[31]  Shogo Nishida,et al.  Mobile Interfaces Using Body Worn Projector and Camera , 2009, HCI.

[32]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[33]  Pattie Maes,et al.  SixthSense: a wearable gestural interface , 2009, SIGGRAPH ASIA Art Gallery & Emerging Technologies.

[34]  Xiang Cao,et al.  Interacting with dynamically defined information spaces using a handheld projector and a pen , 2006, UIST.

[35]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[36]  J. Geoffrey Chase,et al.  Evaluating the Augmented Reality Human-Robot Collaboration System , 2008, 2008 15th International Conference on Mechatronics and Machine Vision in Practice.

[37]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[38]  Antonio Torralba,et al.  Small codes and large image databases for recognition , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  P. A. Besselink,et al.  LAMP ROBOT WITH MEMORY METAL DRIVES , 1991 .

[40]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[41]  Douglas Lanman,et al.  BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields , 2009, SIGGRAPH 2009.

[42]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[43]  Antonio Torralba,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 80 Million Tiny Images: a Large Dataset for Non-parametric Object and Scene Recognition , 2022 .

[44]  Seth E Hunter.  MemTable : contextual memory in group workspaces , 2009 .

[45]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[46]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.

[47]  Claudio S. Pinhanez,et al.  Steerable interfaces for pervasive computing spaces , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..