Dynamics of Aimed Mid-air Movements

Mid-air arm movements are ubiquitous in VR, AR, and gestural interfaces. While mouse movements have received some attention, the dynamics of mid-air movements are understudied in HCI. In this paper we present an exploratory analysis of the dynamics of aimed mid-air movements. We explore the 3rd order lag (3OL) and existing 2nd order lag (2OL) models for modeling these dynamics. For a majority of movements the 3OL model captures mid-air dynamics better, in particular acceleration. The models can effectively predict the complete time series of position, velocity and acceleration of aimed movements given an initial state and a target using three (2OL) or four (3OL) free parameters.

[1]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[2]  T. Flash,et al.  Minimum-jerk, two-thirds power law, and isochrony: converging approaches to movement planning. , 1995, Journal of experimental psychology. Human perception and performance.

[3]  E. Todorov.  Optimality principles in sensorimotor control , 2004, Nature Neuroscience.

[4]  S. Grossberg,et al.  Neural dynamics of planned arm movements: emergent invariants and speed-accuracy properties during trajectory formation. , 1988, Psychological review.

[5]  Zoubin Ghahramani,et al.  Computational principles of movement neuroscience , 2000, Nature Neuroscience.

[6]  R. Plamondon,et al.  A multi-level representation paradigm for handwriting stroke generation. , 2006, Human movement science.

[7]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements: Part III. Kinetic outcomes , 1998, Biological Cybernetics.

[8]  K. Newell,et al.  Space-time accuracy of rapid movements. , 1993, Journal of motor behavior.

[9]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[10]  Denis Mottet,et al.  Behind Fitts' law: kinematic patterns in goal-directed movements , 2004, Int. J. Hum. Comput. Stud..

[11]  Tovi Grossman,et al.  Pointing at trivariate targets in 3D environments , 2004, CHI.

[12]  Tamar Flash,et al.  Computational approaches to motor control , 2001, Current Opinion in Neurobiology.

[13]  O. Bock.  Load compensation in human goal-directed arm movements , 1990, Behavioural Brain Research.

[14]  Y. Guiard.  On Fitts's and Hooke's laws: simple harmonic movement in upper-limb cyclical aiming. , 1993, Acta psychologica.

[15]  David E. Meyer,et al.  Speed—Accuracy Tradeoffs in Aimed Movements: Toward a Theory of Rapid Voluntary Action , 2018, Attention and Performance XIII.

[16]  E. R. Crossman,et al.  Feedback Control of Hand-Movement and Fitts' Law , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[17]  Michael I. Jordan,et al.  Optimal feedback control as a theory of motor coordination , 2002, Nature Neuroscience.

[18]  C. Bard,et al.  Directional control of rapid arm movements: the role of the kinetic visual feedback system. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[19]  Antti Oulasvirta,et al.  Informing the Design of Novel Input Methods with Muscle Coactivation Clustering , 2015, ACM Trans. Comput. Hum. Interact..

[20]  Denis Mottet,et al.  The dynamics of goal-directed rhythmical aiming , 1999, Biological Cybernetics.

[21]  Thomas B. Sheridan,et al.  Man-machine systems;: Information, control, and decision models of human performance , 1974 .

[22]  John M. Hollerbach,et al.  Workspace Effect in Arm Movement Kinematics Derived by Joint Interpolation , 1987 .

[23]  A. H. Norris,et al.  Speed and accuracy of movement and their changes with age. , 1969, Acta psychologica.

[24]  S. Schaal,et al.  Origins and violations of the 2/3 power law in rhythmic three-dimensional arm movements , 2000, Experimental Brain Research.

[25]  Tamar Flash,et al.  Models of human movement: Trajectory planning and inverse kinematics studies , 2013, Robotics Auton. Syst..

[26]  P. Viviani,et al.  The law relating the kinematic and figural aspects of drawing movements. , 1983, Acta psychologica.

[27]  R Osu,et al.  Possible explanations for trajectory curvature in multijoint arm movements. , 1997, Journal of experimental psychology. Human perception and performance.

[28]  T. Flash,et al.  Moving gracefully: quantitative theories of motor coordination , 1987, Trends in Neurosciences.

[29]  Jörg Müller,et al.  Control Theoretic Models of Pointing , 2017, ACM Trans. Comput. Hum. Interact..

[30]  Emanuel Todorov,et al.  Optimal control methods suitable for biomechanical systems , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[31]  Richard Gray Costello.  The Surge Model of the Well-Trained Human Operator in Simple Manual Control , 1968 .

[32]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[33]  E. Bizzi,et al.  Human arm trajectory formation. , 1982, Brain : a journal of neurology.

[34]  R. Suzuki,et al.  Minimum Muscle-Tension Change Trajectories Predicted by Using a 17-Muscle Model of the Monkey's Arm. , 1996, Journal of motor behavior.

[35]  Duane T. McRuer,et al.  A Review of Quasi-Linear Pilot Models , 1967 .

[36]  P. Viviani,et al.  Trajectory determines movement dynamics , 1982, Neuroscience.

[37]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[38]  Antti Oulasvirta,et al.  Is motion capture-based biomechanical simulation valid for HCI studies?: study and implications , 2014, CHI.

[39]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[40]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[41]  F. Pollick,et al.  The Three-Dimensional Curvature of Straight-Ahead Movements. , 1996, Journal of motor behavior.

[42]  Denis V. Efimov,et al.  Modeling pointing tasks in mouse-based human-computer interactions , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[43]  C. I. Howarth,et al.  The relationship between speed and accuracy of movement aimed at a target , 1971 .

[44]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Mitsuo Kawato,et al.  Adaptation and learning in control of voluntary movement by the central nervous system , 1988, Adv. Robotics.

[46]  John M. Flach,et al.  Control Theory for Humans: Quantitative Approaches To Modeling Performance , 2002 .

[47]  C. Atkeson,et al.  Kinematic features of unrestrained vertical arm movements , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Emanuel Todorov,et al.  Structured variability of muscle activations supports the minimal intervention principle of motor control. , 2009, Journal of neurophysiology.