High-performance pen + touch modality interactions: a real-time strategy game eSports context

We used the situated context of real-time strategy (RTS) games to address the design and evaluation of new pen + touch interaction techniques. RTS play is a popular genre of Electronic Sports (eSports), games played and spectated at an extremely high level. Interaction techniques are critical for eSports players, because they so directly impact performance. Through this process, new techniques and implications for pen + touch and bi-manual interaction emerged. We enhance non-dominant hand (NDH) interaction with edge-constrained affordances, anchored to physical features of interactive sur- faces, effectively increasing target width. We develop bi-manual overloading, an approach to reduce the total number of occurrences of NDH retargeting. The novel isosceles lasso select technique facilitates selection of complex object subsets. Pen-in-hand interaction, dominant hand touch interaction performed with the pen stowed in the palm, also emerged as an efficient and expressive interaction paradigm.

[1]  William Buxton,et al.  Manual deskterity: an exploration of simultaneous pen + touch direct input , 2010, CHI EA '10.

[2]  Bernd Fröhlich,et al.  Two-handed direct manipulation on the responsive workbench , 1997, SI3D.

[3]  Stanislaw Zabramski Careless touch: a comparative evaluation of mouse, pen, and touch input in shape tracing task , 2011, OZCHI.

[4]  Jon Froehlich,et al.  Barrier pointing: using physical edges to assist target acquisition on mobile device touch screens , 2007, Assets '07.

[5]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .

[6]  Graham J. Wills Selection: 524,288 ways to say "this is interesting" , 1996, Proceedings IEEE Symposium on Information Visualization '96.

[7]  J I Todor,et al.  Handedness and hemispheric asymmetry in the control of movements. , 1978, Journal of motor behavior.

[8]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[9]  Paul Kabbash,et al.  Human performance using computer input devices in the preferred and non-preferred hands , 1993, INTERCHI.

[10]  E. Reed The Ecological Approach to Visual Perception , 1989 .

[11]  Andruid Kerne,et al.  Comparing multi-touch interaction techniques for manipulation of an abstract parameter space , 2011, ICMI '11.

[12]  G. Burch This is interesting. , 1970, American heart journal.

[13]  Daniel J. Wigdor,et al.  Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces , 2008, AVI '08.

[14]  I. Scott MacKenzie,et al.  Performance differences in the fingers, wrist, and forearm in computer input control , 1997, CHI.

[15]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[16]  Dennis Proffitt,et al.  Cooperative bimanual action , 1997, CHI.

[17]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[18]  William Buxton,et al.  Pen + touch = new tools , 2010, UIST.

[19]  Andruid Kerne,et al.  ZeroTouch: an optical multi-touch and free-air interaction architecture , 2012, CHI.

[20]  Olivier Chapuis,et al.  Evaluation of pointing performance on screen edges , 2008, AVI '08.

[21]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[22]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[23]  Paul K. Wright,et al.  Toolglasses, Marking Menus, and Hotkeys: A Comparison of One and Two-Handed Command Selection Techniques , 2004, Graphics Interface.

[24]  Gifford Cheung,et al.  Starcraft from the stands: understanding the game spectator , 2011, CHI.

[25]  Patrick Baudisch,et al.  The springboard: multiple modes in one spring-loaded control , 2006, CHI.