38.2: Direct Display Interaction via Simultaneous Pen + Multi‐touch Input

Current developments hint at a rapidly approaching future where simultaneous pen + multi-touch input becomes the gold standard for direct interaction on displays. We are motivated by a desire to extend pen and multi-touch input modalities, including their use in concert, to enable users to take better advantage of each.

[1]  Alison Kidd,et al.  The marks are on the knowledge worker , 1994, CHI '94.

[2]  Lenny Engelhardt.  P-36: Native Dual Mode Digitizers: Supporting Pen, Touch and Multi-Touch Inputs in One Device on any LCD , 2008 .

[3]  Ravin Balakrishnan,et al.  Codex: a dual screen tablet computer , 2009, CHI.

[4]  Xiang Cao,et al.  ShapeTouch: Leveraging contact shape on interactive surfaces , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[5]  Bill Buxton,et al.  Sketching User Experiences: Getting the Design Right and the Right Design , 2007 .

[6]  Daniel J. Wigdor,et al.  Combining and Measuring the Benefits of Bimanual Pen and Direct-Touch Interaction of Interfaces , 2008 .

[7]  Peter Brandl,et al.  Occlusion-aware menu design for digital tabletops , 2009, CHI Extended Abstracts.

[8]  Nicholas A. Knouf.  CHI 2009 Extended Abstracts , 2009 .

[9]  William Buxton,et al.  Issues in combining marking and direct manipulation techniques , 1991, UIST '91.

[10]  Sharon Oviatt,et al.  Designing Interfaces that Stimulate Ideational Super-fluency , 2009 .

[11]  Daniel J. Wigdor,et al.  Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces , 2008, AVI '08.

[12]  Patrick Baudisch,et al.  The springboard: multiple modes in one spring-loaded control , 2006, CHI.

[13]  Marisa E. Campbell.  CHI 2004 , 2004, INTR.

[14]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[15]  Y. Guiard.  Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[16]  Ka-Ping Yee,et al.  Two-handed interaction on a tablet display , 2004, CHI EA '04.

[17]  Mike Wu,et al.  Gesture registration, relaxation, and reuse for multi-point direct-touch surfaces , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[18]  interactions Staff,et al.  CHI 2005 , 2005 .

[19]  Kenton O'Hara,et al.  A diary study of work-related reading: design implications for digital reading devices , 1998, CHI.

[20]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[21]  Desney S. Tan,et al.  InkSeine: In Situ search for active note taking , 2007, CHI.

[22]  William Buxton,et al.  Manual deskterity: an exploration of simultaneous pen + touch direct input , 2010, CHI EA '10.