Modeling the Uncertainty in 2D Moving Target Selection

Understanding the selection uncertainty of moving targets is a fundamental research problem in HCI. However, the only few works in this domain mainly focus on selecting 1D moving targets with certain input devices, where the model generalizability has not been extensively investigated. In this paper, we propose a 2D Ternary-Gaussian model to describe the selection uncertainty manifested in endpoint distribution for moving target selection. We explore and compare two candidate methods to generalize the problem space from 1D to 2D tasks, and evaluate their performances with three input modalities including mouse, stylus, and finger touch. By applying the proposed model in assisting target selection, we achieved up to 4% improvement in pointing speed and 41% in pointing accuracy compared with two state-of-the-art selection technologies. In addition, when we tested our model to predict pointing errors in a realistic user interface, we observed high fit of 0.94 R2.

[1]  A. Murata,et al.  Extending Fitts' law to a three-dimensional pointing task. , 2001, Human movement science.

[2]  Zvi Drezner,et al.  Computation of the trivariate normal integral , 1994 .

[3]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[4]  Eli Brenner,et al.  Hitting moving targets: Co-operative control of 'when' and 'where' , 1996 .

[5]  J. Robson,et al.  Discrimination at threshold: Labelled detectors in human vision , 1981, Vision Research.

[6]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[7]  I. Scott MacKenzie,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[8]  T. Mergner,et al.  Object motion perception is shaped by the motor control mechanism of ocular pursuit , 2003, Experimental Brain Research.

[9]  Shumin Zhai,et al.  Bayesian touch: a statistical criterion of target selection with finger touch , 2013, UIST.

[10]  Phillip J. Bairstow,et al.  Analysis of hand movement to moving targets , 1987 .

[11]  Paul N. Somerville,et al.  A Fortran 90 Program for Evaluation of Multivariate Normal and Multivariate t Integrals Over Convex Regions , 1999 .

[12]  Hanns Hatt,et al.  Two cDNAs coding for histamine-gated ion channels in D. melanogaster , 2002, Nature Neuroscience.

[13]  P. Thompson Discrimination of moving gratings at and above detection threshold , 1983, Vision Research.

[14]  Gabor Stepan,et al.  Delay effects in the human sensory system during balancing , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  R. Bootsma,et al.  Timing an attacking forehand drive in table tennis. , 1990 .

[16]  Shumin Zhai,et al.  Speed-accuracy tradeoff in Fitts' law tasks-on the equivalency of actual and nominal pointing precision , 2004, Int. J. Hum. Comput. Stud..

[17]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[18]  I. Scott MacKenzie,et al.  Fitts' Throughput and the Remarkable Case of Touch-Based Target Selection , 2015, HCI.

[19]  Antti Oulasvirta,et al.  Modelling Error Rates in Temporal Pointing , 2016, CHI.

[20]  Tovi Grossman,et al.  Comet and target ghost: techniques for selecting moving targets , 2011, CHI.

[21]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[22]  Bruce Luber,et al.  Transcranial magnetic stimulation differentially affects speed and direction judgments , 2001, Experimental Brain Research.

[23]  Jacob O. Wobbrock,et al.  Modeling and predicting pointing errors in two dimensions , 2011, CHI.

[24]  E Brenner,et al.  Perception and action are based on the same visual information: distinction between position and velocity. , 1995, Journal of experimental psychology. Human perception and performance.

[25]  Martin S. Moran,et al.  A Test of Fitts' Law with Moving Targets , 1980, Human factors.

[26]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[27]  Tovi Grossman,et al.  Pointing at trivariate targets in 3D environments , 2004, CHI.

[28]  Shumin Zhai,et al.  Understanding the Uncertainty in 1D Unidirectional Moving Target Selection , 2018, CHI.

[29]  Anne-Marie Brouwer,et al.  Hitting moving targets , 1998, Experimental Brain Research.

[30]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[31]  Ravindra S Goonetilleke,et al.  Pointing Device Performance in Steering Tasks , 2016, Perceptual and motor skills.

[32]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[33]  Shumin Zhai,et al.  Performance evaluation of input devices in trajectory-based tasks: an application of the steering law , 1999, CHI '99.

[34]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI.

[35]  Antti Oulasvirta,et al.  Moving Target Selection: A Cue Integration Model , 2018, CHI.

[36]  Gregory Francis,et al.  Perceived motion in orientational afterimages: direction and speed , 2001, Vision Research.

[37]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[38]  Shumin Zhai,et al.  FFitts law: modeling finger touch with fitts' law , 2013, CHI.

[39]  Anne-Marie Brouwer,et al.  Hitting moving objects: is target speed used in guiding the hand? , 2002, Experimental Brain Research.

[40]  Shumin Zhai,et al.  Refining Fitts' law models for bivariate pointing , 2003, CHI '03.

[41]  Ken Nakayama,et al.  Biological image motion processing: A review , 1985, Vision Research.

[42]  George Marsaglia,et al.  The Monty Python Method for Generating Gamma Variables , 1999 .

[43]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[44]  Hongan Wang,et al.  Modeling a target-selection motion by leveraging an optimal feedback control mechanism , 2018, Sci. China Inf. Sci..

[45]  Xiang Cao,et al.  Speed-Accuracy Tradeoff in Trajectory-Based Tasks with Temporal Constraint , 2009, INTERACT.

[46]  E. Hoffmann Capture of moving targets: a modification of Fitts' Law , 1991 .

[47]  I. Scott MacKenzie,et al.  An error model for pointing based on Fitts' law , 2008, CHI.