Empirical evaluation for finger input properties in multi-touch interaction

Current multi-touch interaction techniques typically only use the x-y coordinates of the human finger's contact with the screen. However, when fingers contact a touch-sensitive surface, they usually approach at an angle and cover a relatively large 2D area instead of a precise single point. In this paper, a Frustrated Total Internal Reflection (FTIR) based multi-touch device is used to collect the finger imprint data. We designed a series of experiments to explore human finger input properties and identified several useful properties such as contact area, contact shape and contact orientation which can be exploited to improve the performance of multi-touch selecting and pointing tasks. Based on the experimental results, we discuss some implications for the design of human finger input interfaces and propose several design prototypes which incorporate these implications. A set of raw data and several concrete recommendations which are useful for the research community are also presented.

[1]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[2]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[3]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[4]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[5]  Andrew D. Wilson TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[6]  A. D. Hall,et al.  Factors affecting performance using touch-entry systems: Tactual recognition fields and system accuracy. , 1988 .

[7]  Carl Gutwin,et al.  Superflick: a natural and efficient technique for long-distance object placement on digital tables , 2006, Graphics Interface.

[8]  Kenneth C. Smith,et al.  A multi-touch three dimensional touch-sensitive tablet , 1985, CHI '85.

[9]  Paul Kabbash,et al.  The “prince” technique: Fitts' law and selection using area cursors , 1995, CHI '95.

[10]  A. Patwardhan,et al.  Subpixel position measurement using 1D, 2D and 3D centroid algorithms with emphasis on applications in confocal microscopy , 1997 .

[11]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[12]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[13]  Shumin Zhai,et al.  High precision touch screen interaction , 2003, CHI '03.

[14]  Ravin Balakrishnan,et al.  Pressure widgets , 2004, CHI.

[15]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[16]  Ronald E. Anderson Social Impacts of Computing: Codes of Professional Ethics , 1992 .

[17]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[18]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[19]  Guy Weinzapfel,et al.  One-point touch input of vector information for computer displays , 1978, SIGGRAPH '78.

[20]  Andrew D. Wilson PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[21]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[22]  William Buxton,et al.  Issues and techniques in touch-sensitive tablet input , 1985, SIGGRAPH '85.

[23]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .