Mouse pointing endpoint prediction using kinematic template matching

We present a new method of predicting the endpoints of mouse movements. While prior approaches to endpoint prediction have relied upon normative kinematic laws, regression, or control theory, our approach is straightforward but kinematically rich. Our key insight is to regard the unfolding velocity profile of a pointing movement as a 2-D stroke gesture and to use template matching to predict the endpoint based on prior observed movements. We call our technique kinematic template matching (KTM), which is simple to implement, user-adaptable, and kinematically expressive. In a study of 17 able-bodied participants evaluated over movement amplitudes ranging from 100-800 pixels, we found KTM to predict endpoints that were within 83 pixels of the true endpoint at 50% of the way through the movement, within 48 pixels at 75%, and within 39 pixels at 90%, using 1000 templates per participant. These accuracies make KTM as successful an approach to endpoint prediction as any prior technique, while being easier to implement and understand than most.

[1]  Yoshifumi Kitamura,et al.  A Fundamental Study on Error-Corrective Feedback Movement in a Positioning Task , 2002 .

[2]  Edward Lank,et al.  Speeding pointing in tiled widgets: understanding the effects of target expansion and misprediction , 2010, IUI '10.

[3]  Edward Lank,et al.  Endpoint prediction using motion kinematics , 2007, CHI.

[4]  Robert B. Fisher,et al.  Hypermedia image processing reference , 1996 .

[5]  Patrick Langdon,et al.  Multiple haptic targets for motion-impaired computer users , 2003, CHI '03.

[6]  Sigurd Mikkelsen,et al.  Validity of questionnaire self-reports on computer, mouse and keyboard usage during a four-week period , 2007, Occupational and Environmental Medicine.

[7]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Jacob O. Wobbrock,et al.  Taming wild behavior: the input observer for obtaining text entry and mouse pointing measures from everyday computer use , 2012, CHI.

[9]  Simon J. Godsill,et al.  User Target Intention Recognition from Cursor Position Using Kalman Filter , 2013, HCI.

[10]  Ravin Balakrishnan,et al.  Acquisition of expanding targets , 2002, CHI.

[11]  Mary Czerwinski,et al.  Drag-and-Pop and Drag-and-Pick: Techniques for Accessing Remote Screen Content on Touch- and Pen-Operated Systems , 2003, INTERACT.

[12]  Simon J. Godsill,et al.  Intent Recognition Using Neural Networks and Kalman Filters , 2013, CHI-KDD.

[13]  H. K. Oirschot Cursor Displacement and Velocity Profiles for Targets in Various Locations , 2001 .

[14]  Edward Lank,et al.  Effects of Target Size and Distance on Kinematic Endpoint Prediction , 2009 .

[15]  Anind K. Dey,et al.  Probabilistic pointing target prediction via inverse optimal control , 2012, IUI '12.

[16]  Jacob O. Wobbrock,et al.  A general-purpose target-aware pointing enhancement using pixel-level analysis of graphical interfaces , 2012, CHI.

[17]  Susumu Harada,et al.  The angle mouse: target-agnostic dynamic gain adjustment based on angular deviation , 2009, CHI.

[18]  Johanna D. Moore,et al.  Proceedings of the Conference on Human Factors in Computing Systems , 1989 .

[19]  Ehud Sharlin,et al.  Predictive interaction using the delphian desktop , 2005, UIST.

[20]  M. Robertson,et al.  Daily computer usage correlated with undergraduate students' musculoskeletal symptoms. , 2007, American journal of industrial medicine.

[21]  Atsuo Murata,et al.  Improvement of Pointing Time by Predicting Targets in Pointing With a PC Mouse , 1998, Int. J. Hum. Comput. Interact..

[22]  David M. Lane,et al.  A Process for Anticipating and Executing Icon Selection in Graphical User Interfaces , 2005, Int. J. Hum. Comput. Interact..

[23]  Daniel Vogel,et al.  The Impact of Control-Display Gain on User Performance in Pointing Tasks , 2008, Hum. Comput. Interact..