AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation

We present a finger-tracking system for touch-based interaction which can track 3D finger angle in addition to position, using low-resolution conventional capacitive sensors, therefore compensating for the inaccuracy due to pose variation in conventional touch systems. Probabilistic inference about the pose of the finger is carried out in real-time using a particle filter; this results in an efficient and robust pose estimator which also gives appropriate uncertainty estimates. We show empirically that tracking the full pose of the finger results in greater accuracy in pointing tasks with small targets than competitive techniques. Our model can detect and cope with different finger sizes and the use of either fingers or thumbs, bringing a significant potential for improvement in one-handed interaction with touch devices. In addition to the gain in accuracy we also give examples of how this technique could open up the space of novel interactions.

[1]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[3]  Matthias Bues,et al.  iSith - Intersection-based Spatial Interaction for Two Hands , 2006, 3D User Interfaces (3DUI'06).

[4]  Paul C. Schutte,et al.  The H-Metaphor as a Guideline for Vehicle Automation and Interaction , 2005 .

[5]  Patrick Baudisch,et al.  Separability of spatial manipulations in multi-touch interfaces , 2009, Graphics Interface.

[6]  Jun Rekimoto,et al.  PreSense: interaction techniques for finger sensing input devices , 2003, UIST '03.

[7]  Stéphane Huot,et al.  TapTap and MagStick: improving one-handed target acquisition on small touch-screens , 2008, AVI '08.

[8]  Eric Lecolinet,et al.  MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb , 2009, CHI.

[9]  Branko Ristic,et al.  Beyond the Kalman Filter: Particle Filters for Tracking Applications , 2004 .

[10]  Masatoshi Ishikawa,et al.  In-air typing interface for mobile devices with vibration feedback , 2010, SIGGRAPH '10.

[11]  Hong Zhang,et al.  An evaluation of one-handed techniques for multiple-target selection , 2009, CHI Extended Abstracts.

[12]  B. Bederson,et al.  Understanding Single-Handed Mobile Device Interaction , 2006 .

[13]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[14]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[15]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[16]  Chris Harrison,et al.  Abracadabra: wireless, high-precision, and unpowered finger input for very small mobile devices , 2009, UIST '09.

[17]  Daniel Vogel,et al.  Occlusion-aware interfaces , 2010, CHI.

[18]  Patrick Baudisch,et al.  Hover widgets: using the tracking state to extend the capabilities of pen-operated devices , 2006, CHI.

[19]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[20]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[21]  Simon Rogers,et al.  FingerCloud: uncertainty and autonomy handover incapacitive sensing , 2010, CHI.