User-specific touch models in a cross-device context

We present a machine learning approach to train user-specific offset models, which map actual to intended touch locations to improve accuracy. We propose a flexible framework to adapt and apply models trained on touch data from one device and user to others. This paper presents a study of the first published experimental data from multiple devices per user, and indicates that models not only improve accuracy between repeated sessions for the same user, but across devices and users, too. Device-specific models outperform unadapted user-specific models from different devices. However, with both user- and device-specific data, we demonstrate that our approach allows to combine this information to adapt models to the targeted device resulting in significant improvement. On average, adapted models improved accuracy by over 8%. We show that models can be obtained from a small number of touches (≈60). We also apply models to predict input-styles and identify users.

[1]  Daniel Buschek,et al.  Sparse selection of training data for touch correction systems , 2013, MobileHCI '13.

[2]  Simon Rogers,et al.  AnglePose: robust, precise capacitive touch tracking via 3d orientation estimation , 2011, CHI.

[3]  Patrick Baudisch,et al.  Understanding touch , 2011, CHI.

[4]  Paul C. Schutte,et al.  The H-Metaphor as a Guideline for Vehicle Automation and Interaction , 2005 .

[5]  Jacob O. Wobbrock,et al.  Personalized input: improving ten-finger touchscreen typing through automatic adaptation , 2012, CHI.

[6]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[7]  Tyler Baldwin,et al.  Towards online adaptation and personalization of key-target resizing for mobile devices , 2012, IUI '12.

[8]  Stéphane Huot,et al.  TapTap and MagStick: improving one-handed target acquisition on small touch-screens , 2008, AVI '08.

[9]  David R. Flatla,et al.  Calibration games: making calibration tasks enjoyable by adding motivating game elements , 2011, UIST.

[10]  Simon Rogers,et al.  FingerCloud: uncertainty and autonomy handover incapacitive sensing , 2010, CHI.

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[13]  Markus Löchtefeld,et al.  A user-specific machine learning approach for improving touch accuracy on mobile devices , 2012, UIST '12.

[14]  Niels Henze,et al.  100,000,000 taps: analysis and improvement of touch performance in the large , 2011, Mobile HCI.

[15]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.