Multi-touch focus+context sketch-based interaction

In this paper we present a Focus+Context screen for combined pen and touch interaction. A tabletop display presents contextual information and enables multi-touch detection for navigation through frustrated total internal reflection (FTIR). A high resolution pen enabled display is continuously localized on the tabletop. It is used as a movable focus display and pen input device. The resulting system has a large virtual resolution for both display and pen interaction. We demonstrate the advantages of Focus+Context for pen-based interaction in combination with multi-touch navigation in applications that make use of sketch-based interfaces.

[1]  A. Agarwal,et al.  C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[2]  Benjamin B. Bederson,et al.  Space-scale diagrams: understanding multiscale interfaces , 1995, CHI '95.

[3]  Emmanuel Pietriga,et al.  Sigma lenses: focus-context transitions combining space, time and translucence , 2008, CHI.

[4]  Joseph J. LaViola,et al.  Sketching and gestures 101 , 2007, SIGGRAPH '07.

[5]  Marc Alexa,et al.  Continuous reference images for FTIR touch sensing , 2008, International Conference on Computer Graphics and Interactive Techniques.

[6]  Patrick Baudisch,et al.  Focus plus context screens: combining display technology with visualization techniques , 2001, UIST '01.

[7]  Mark Ashdown,et al.  The Escritoire: A Personal Projected Display , 2003, WSCG.

[8]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[9]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[10]  Lars Erik Holmquist,et al.  Ubiquitous graphics: combining hand-held and wall-size displays to interact with large images , 2006, AVI '06.

[11]  Daniel J. Wigdor,et al.  Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces , 2008, AVI '08.

[12]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, SIGGRAPH 2007.

[13]  Mario Costa Sousa,et al.  Sketch-based modeling: A survey , 2009, Comput. Graph..

[14]  Andreas Butz,et al.  A Wall-Sized Focus Plus Context Display , 2007, Fifth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom'07).

[15]  Brian P. Bailey,et al.  An Evaluation of Techniques for Controlling Focus+Context Screens , 2004, Graphics Interface.

[16]  Peter Brandl,et al.  Flux: a tilting multi-touch and pen based surface , 2009, CHI Extended Abstracts.

[17]  Jefferson Y. Han.  Multi-touch interaction wall , 2006, SIGGRAPH '06.

[18]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[19]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[20]  Marc Alexa,et al.  FiberMesh: designing freeform surfaces with 3D curves , 2007, ACM Trans. Graph..

[21]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[22]  Joseph J. LaViola.  Sketching and gestures 101 , 2006, SIGGRAPH Courses.