iCon: utilizing everyday objects as additional, auxiliary and instant tabletop controllers

This work describes a novel approach to utilizing everyday objects of users as additional, auxiliary, and instant tabletop controllers. Based on this approach, a prototype platform, called iCon, is developed to explore the possible design. Field studies and user studies reveal that utilizing everyday objects such as auxiliary input devices might be appropriate under a multi-task scenario. User studies further demonstrate that daily objects can generally be applied in low precision circumstances, low engagement with selected objects, and medium-to-high frequency of use. The proposed approach allows users to interact with computers while not altering their original work environments.

[1]  Pierre Dragicevic,et al.  Strategies for accelerating on-line learning of hotkeys , 2007, CHI.

[2]  Hiroshi Ishii,et al.  A comparison of spatial organization strategies in graphical and tangible user interfaces , 2000, DARE '00.

[3]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[4]  Tom Drummond,et al.  Interactive model reconstruction with user guidance , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[5]  Hiroshi Ishii,et al.  The tangible user interface and its evolution , 2008, CACM.

[6]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[7]  Eric Horvitz,et al.  Disruption and recovery of computing tasks: field study, analysis, and directions , 2007, CHI.

[8]  Orit Shaer,et al.  Reality-based interaction: a framework for post-WIMP interfaces , 2008, CHI.

[9]  Sean White,et al.  Visual Hints for Tangible Gestures in Augmented Reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[10]  David Kirsh,et al.  The Intelligent Use of Space , 1995, Artif. Intell..

[11]  Donald A. Norman,et al.  Things That Make Us Smart: Defending Human Attributes In The Age Of The Machine , 1993 .

[12]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[13]  Steven K. Feiner,et al.  Opportunistic controls: leveraging natural affordances as tangible user interfaces for augmented reality , 2008, VRST '08.

[14]  Curtis A. Siller,et al.  Emerging Technologies , 2008, 2018 IEEE International Meeting for Future of Electron Devices, Kansai (IMFEDK).

[15]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[16]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI Extended Abstracts.

[17]  Pranav Mistry,et al.  TaPuMa: tangible public map for information acquirement through the things we carry , 2008, Ambi-Sys '08.

[18]  Lars Erik Holmquist,et al.  WebStickers: using physical tokens to access, manage and share bookmarks to the Web , 2000, DARE '00.

[19]  Norbert A. Streitz,et al.  Roomware©: the second generation , 2002, CHI Extended Abstracts.

[20]  Ken Perlin,et al.  The UnMousePad: an interpolating multi-touch force-sensing input pad , 2009, SIGGRAPH 2009.

[21]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[22]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[23]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[24]  Hiroshi Ishii,et al.  Rubber shark as user interface , 2006, CHI EA '06.

[25]  Sy-Yen Kuo,et al.  MemoIcon: using everyday objects as physical icons , 2009, SIGGRAPH ASIA '09.

[26]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[27]  Itiro Siio.  InfoBinder: A pointing device for a virtual desktop system , 1995, HCI International 1995.

[28]  Thomas W. Malone,et al.  How do people organize their desks?: Implications for the design of office information systems , 1983, TOIS.

[29]  Sean White,et al.  Interaction and presentation techniques for shake menus in tangible augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.