SmartFinger: connecting devices, objects and people seamlessly

In this paper, we demonstrate a method to create a seamless information media 'channel' between the physical and digital worlds. Our prototype, SmartFinger, aims to achieve this goal with a finger-worn camera, which continuously captures images for the extraction of information from our surroundings. With this metaphorical channel, we have created a software architecture which allows users to capture and interact with various entities in our surroundings. The interaction design space of SmartFinger is discussed in terms of smart-connection, smart-sharing and smart-extraction of information. We believe this work will create numerous possibilities for future explorations.

[1]  Xing-Dong Yang,et al.  Magic finger: always-available input through finger instrumentation , 2012, UIST.

[2]  Roy Want,et al.  Bridging physical and virtual worlds with electronic tags , 1999, CHI '99.

[3]  Hiroshi Ishii,et al.  Designing the world as your palette , 2005, CHI EA '05.

[4]  Jun Rekimoto,et al.  Augment-able reality: situated communication through physical and digital spaces , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[5]  Xiang Cao,et al.  Grips and gestures on a multi-touch pen , 2011, CHI.

[6]  Lynn Wilcox,et al.  Embedded media markers: marks on paper that signify associated media , 2010, IUI '10.

[7]  Hiroshi Ishii,et al.  Slurp: tangibility spatiality and an eyedropper , 2008, CHI Extended Abstracts.

[8]  Jun Rekimoto,et al.  Pick-and-drop: a direct manipulation technique for multiple computer environments , 1997, UIST '97.

[9]  Suranga Nanayakkara,et al.  EyeRing: a finger-worn assistant , 2012, CHI EA '12.

[10]  Ranajit Chatterjee,et al.  Design of A Touch Sensor Based Single Finger Operated Wearable User-Interface Terminal , 2006, 2006 SICE-ICASE International Joint Conference.

[11]  Patrick Baudisch,et al.  Stitching: pen gestures that span multiple displays , 2004, AVI.

[12]  Hiroshi Ishii,et al.  I/O brush: drawing with everyday objects as ink , 2004, CHI.

[13]  Suranga Nanayakkara,et al.  Touch and copy, touch and paste , 2011, CHI EA '11.

[14]  Qiong Liu,et al.  PACER: toward a cameraphone-based paper interface for fine-grained and flexible interaction with documents , 2009, MM '09.

[15]  Lynn Wilcox,et al.  Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone , 2010, CHI.

[16]  Berna Erol,et al.  Mobile phones and information capture in the workplace , 2011, CHI Extended Abstracts.

[17]  Berna Erol,et al.  Whiteboard sharing: capture, process, and print or email , 2011, Electronic Imaging.