Goal-directed aiming under restricted viewing conditions with confirmatory sensory feedback.

A substantial body of research has examined the speed-accuracy tradeoff captured by Fitts' law, demonstrating increases in movement time that occur as aiming tasks are made more difficult by decreasing target width and/or increasing the distance between targets. Yet, serial aiming movements guided by internal spatial representations, rather than by visual views of targets have not been examined in this manner, and the value of confirmatory feedback via different sensory modalities within this paradigm is unknown. Here we examined goal-directed serial aiming movements (tapping back and forth between two targets), wherein targets were visually unavailable during the task. However, confirmatory feedback (auditory, haptic, visual, and bimodal combinations of each) was delivered upon each target acquisition, in a counterbalanced, within-subjects design. Each participant performed the aiming task with their pointer finger, represented within an immersive virtual environment as a 1 cm white sphere, while wearing a head-mounted display. Despite visual target occlusion, movement times increased in accordance with Fitts' law. Though Fitts' law captured performance for each of the sensory feedback conditions, the slopes differed. The effect of increasing difficulty on movement times was least influential in the haptic condition, suggesting more efficient processing of confirmatory haptic feedback during aiming movements guided by internal spatial representations.

[1]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[2]  Matthew Heath,et al.  Visuomotor Memory for Target Location in Near and Far Reaching Spaces , 2007, Journal of motor behavior.

[3]  Matthew Heath,et al.  Can a visual representation support the online control of memory-dependent reaching? Evident from a variable spatial mapping paradigm. , 2003, Motor control.

[4]  Richard D. Morey,et al.  Confidence Intervals from Normalized Data: A correction to Cousineau (2005) , 2008 .

[5]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[6]  M. Shiffrar,et al.  Fitts's Law Holds for Action Perception , 2007, Psychological science.

[7]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[8]  S. Glover,et al.  Separate visual representations in the planning and control of action , 2004, Behavioral and Brain Sciences.

[9]  W. Helsen,et al.  A century later: Woodworth's (1899) two-component model of goal-directed aiming. , 2001, Psychological bulletin.

[10]  Denis Mottet,et al.  Informational constraints in human precision aiming , 2002, Neuroscience Letters.

[11]  R. Gray,et al.  Multisensory Information in the Control of Complex Motor Actions , 2008 .

[12]  Kristen L. Macuga,et al.  Differential contributions of the superior and inferior parietal cortex to feedback versus feedforward control of tools , 2014, NeuroImage.

[13]  Brendan D. Cameron,et al.  Target modality affects visually guided online control of reaching , 2015, Vision Research.

[14]  Frans C. T. van der Helm,et al.  Measuring Neuromuscular Control Dynamics During Car Following With Continuous Haptic Feedback , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  I. Scott MacKenzie,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[16]  R Plamondon,et al.  Speed/accuracy trade-offs in target-directed movements , 1997, Behavioral and Brain Sciences.

[17]  Y Agid,et al.  Temporal limits of spatial working memory in humans , 1998, The European journal of neuroscience.

[18]  L. Tremblay,et al.  Effect of task-specific execution on accuracy of imagined aiming movements , 2015, Neuroscience Letters.

[19]  Shumin Zhai,et al.  What You Feel Must Be What You See: Adding Tactile Feedback to the Trackpoint , 1999, INTERACT.

[20]  Andy Cockburn,et al.  Multimodal feedback for the acquisition of small targets , 2005, Ergonomics.

[21]  Annie W. Y. Ng,et al.  Finger response times to visual, auditory and tactile modality stimuli , 2012, IMECS 2012.

[22]  Philip N. Sabes,et al.  Flexible strategies for sensory integration during motor planning , 2005, Nature Neuroscience.

[23]  D. Elliott Chapter 2 Intermittent Versus Continuous Control of Manual Aiming Movements , 1992 .

[24]  S. Lederman,et al.  Texture perception: studies of intersensory organization using a discrepancy paradigm, and visual versus tactual psychophysics. , 1981, Journal of experimental psychology. Human perception and performance.

[25]  M Akamatsu,et al.  Please Scroll down for Article Ergonomics a Comparison of Tactile, Auditory, and Visual Feedback in a Pointing Task Using a Mouse-type Device , 2022 .

[26]  D. H. Warren,et al.  Immediate perceptual response to intersensory discrepancy. , 1980, Psychological bulletin.

[27]  Robert Gray,et al.  A Comparison of Tactile, Visual, and Auditory Warnings for Rear-End Collision Prevention in Simulated Driving , 2008, Hum. Factors.

[28]  D. Knill,et al.  The role of memory in visually guided reaching. , 2007, Journal of vision.

[29]  R A Abrams,et al.  Optimality in human motor performance: ideal control of rapid aimed movements. , 1988, Psychological review.

[30]  D. Wolpert,et al.  When Feeling Is More Important Than Seeing in Sensorimotor Adaptation , 2002, Current Biology.

[31]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[32]  Stephen H Scott,et al.  Dynamic Multisensory Integration: Somatosensory Speed Trumps Visual Accuracy during Feedback Control , 2016, The Journal of Neuroscience.

[33]  G. DeAngelis,et al.  Multisensory integration: psychophysics, neurophysiology, and computation , 2009, Current Opinion in Neurobiology.

[34]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[35]  Jiajia Yang,et al.  Fitts' law holds for pointing movements under conditions of restricted visual feedback. , 2010, Human movement science.

[36]  T. O. Kvålseth An alternative to Fitts’ law , 1980 .

[37]  William R. Wyatt,et al.  Effects of Auditory Feedback on Movement Time in a Fitts Task , 2010, Journal of motor behavior.

[38]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[39]  M S Graziano,et al.  Coding the locations of objects in the dark. , 1997, Science.

[40]  Jiajia Yang,et al.  Effects of aging on pointing movements under restricted visual feedback conditions. , 2015, Human movement science.

[41]  J. Duysens,et al.  The breakdown of Fitts’ law in rapid, reciprocal aiming movements , 2002, Experimental Brain Research.

[42]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.