Using shear as a supplemental two-dimensional input channel for rich touchscreen interaction

Touch input is constrained, typically only providing finger X/Y coordinates. To access and switch between different functions, valuable screen real estate must be allocated to buttons and menus, or users must perform special actions, such as touch-and-hold, double tap, or multi-finger chords. Even still, this only adds a few bits of additional information, leaving touch interaction unwieldy for many tasks. In this work, we suggest using a largely unutilized touch input dimension: shear (force tangential to a screen's surface). Similar to pressure, shear can be used in concert with conventional finger positional input. However, unlike pressure, shear provides a rich, analog 2D input space, which has many powerful uses. We put forward five classes of advanced interaction that considerably expands the envelope of interaction possible on touchscreens.

[1]  Guy Weinzapfel,et al.  One-point touch input of vector information for computer displays , 1978, SIGGRAPH '78.

[2]  Geehyuk Lee,et al.  Force gestures: augmented touch screen gestures using normal and tangential force , 2011, CHI Extended Abstracts.

[3]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[4]  C. B. Gibbs,et al.  Controller design Interactions of controlling limbs, time-lags and gains in positional and velocity systems , 1962 .

[5]  Ken Hinckley,et al.  Sensor synaesthesia: touch in motion, and motion in touch , 2011, CHI.

[6]  Tovi Grossman,et al.  The design and evaluation of multitouch marking menus , 2010, CHI.

[7]  Daniel Vogel,et al.  The effect of spring stiffness and control gain with an elastic rate control pointing device , 2008, CHI.

[8]  Xiang Cao,et al.  ShapeTouch: Leveraging contact shape on interactive surfaces , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[9]  Margaret Minsky,et al.  Manipulating simulated objects with real-world gestures using a force and position sensitive screen , 1984, SIGGRAPH.

[10]  Hyunjeong Lee,et al.  Evaluation of human tangential force input performance , 2012, CHI.

[11]  Ravin Balakrishnan,et al.  Pressure marks , 2007, CHI.

[12]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[13]  Ivan Poupyrev,et al.  Gummi: a bendable computer , 2004, CHI '04.

[14]  Brad A. Myers,et al.  EdgeWrite: a stylus-based text entry method designed for high accuracy and stability of motion , 2003, UIST '03.

[15]  Sarah A. Douglas,et al.  Differences in movement microstructure of the mouse and the finger-controlled isometric joystick , 1996, CHI.

[16]  Khai N. Truong,et al.  Virtual shelves: interactions with orientation aware devices , 2009, UIST '09.

[17]  Daniel J. Wigdor,et al.  TiltText: using tilt for text input to mobile phones , 2003, UIST '03.

[18]  Yang Li,et al.  Experimental analysis of mode switching techniques in pen-based user interfaces , 2005, CHI.

[19]  Brad A. Myers,et al.  Integrating isometric joysticks into mobile phones for text entry , 2006, CHI EA '06.

[20]  Ravin Balakrishnan,et al.  Pressure widgets , 2004, CHI.

[21]  Masaki Omata,et al.  A multi-level pressure-sensing two-handed interface with finger-mounted pressure sensors , 2009, Graphics Interface.

[22]  Eric Lecolinet,et al.  MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb , 2009, CHI.

[23]  Chris Harrison,et al.  TapSense: enhancing finger interaction on touch surfaces , 2011, UIST.

[24]  Geehyuk Lee,et al.  Force gestures: augmenting touch screen gestures with normal and tangential forces , 2011, UIST.

[25]  H. Harry Asada,et al.  Measurement of finger posture and three-axis fingertip touch force using fingernail sensors , 2004, IEEE Transactions on Robotics and Automation.

[26]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[27]  Andy Cockburn,et al.  Zoofing!: faster list selections with pressure-zoom-flick-scrolling , 2009, OZCHI '09.

[28]  Ravin Balakrishnan,et al.  Zliding: fluid zooming and sliding for high precision parameter manipulation , 2005, UIST.

[29]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.