A Fitts’ Law Evaluation of Visuo-haptic Fidelity and Sensory Mismatch on User Performance in a Near-field Disc Transfer Task in Virtual Reality

The trade-off between speed and accuracy in precision tasks is important to evaluate during user interaction with input devices. When different sensory cues are added or altered in such interactions, those cues have an effect on this trade-off, and thus, they affect overall user performance. For instance, adding cues like haptic feedback and stereoscopic viewing will result in more realistic user interaction, thus improving performance in these tasks. Also, adding a noticeable disparity between physical and virtual movements creates a mismatch between visual and proprioceptive systems, which generally has a negative effect on performance. In this study, we investigate the effects of haptic feedback, stereoscopic viewing, and visuo-proprioceptive mismatch on how quickly and accurately users complete a virtual pick-and-place task using the PHANToM OMNI. Through this experiment, we find that in the movement phase of a ring transfer, movement time and user performance are affected by haptic feedback and visuo-proprioceptive mismatch, and the main effects of stereoscopic viewing appears to be limited to the more precise step when the ring is around the target peg.

[1]  James R. Lewis,et al.  IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use , 1995, Int. J. Hum. Comput. Interact..

[2]  Frank Steinicke,et al.  A VR Study on Freehand vs. Widgets for 3D Manipulation Tasks , 2019, Mensch & Computer.

[3]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[4]  Gerd Bruder,et al.  Distance estimation in large immersive projection systems, revisited , 2015, 2015 IEEE Virtual Reality (VR).

[5]  Yuan-Shin Lee,et al.  Investigating Human Performance in a Virtual Reality Haptic Simulator as Influenced by Fidelity and System Latency , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Bliss M. Altenhoff,et al.  Effects of visual and proprioceptive information in visuo-motor calibration during a closed-loop physical reach task in immersive virtual environments , 2014, SAP.

[7]  Mohamed Fanni,et al.  Workspace mapping and control of a teleoperated endoscopic surgical robot , 2014, 2014 19th International Conference on Methods and Models in Automation and Robotics (MMAR).

[8]  Todd J. Johnsgard Fitt?s law with a virtual reality glove and a mouse: effects of gain , 1994 .

[9]  Ravin Balakrishnan,et al.  Acquisition of expanding targets , 2002, CHI.

[10]  Jeffrey W. Bertrand,et al.  Evaluating Multiple Levels of an Interaction Fidelity Continuum on Performance and Learning in Near-Field Training Simulations , 2018, IEEE Transactions on Visualization and Computer Graphics.

[11]  John P. McIntire,et al.  Stereoscopic 3D displays and human performance: A comprehensive review , 2014, Displays.

[12]  Robert Sessions Woodworth,et al.  THE ACCURACY OF VOLUNTARY MOVEMENT , 1899 .

[13]  I. MacKenzie,et al.  A note on the information-theoretic basis of Fitts' law. , 1989, Journal of motor behavior.

[14]  Lei Liu,et al.  Insights from Dividing 3D Goal-Directed Movements into Meaningful Phases , 2009, IEEE Computer Graphics and Applications.

[15]  Robert J. Teather,et al.  EZCursorVR: 2D Selection with Virtual Reality Head-Mounted Displays , 2018, Graphics Interface.

[16]  Mayra Donaji Barrera Machuca,et al.  Do Stereo Display Deficiencies Affect 3D Pointing? , 2018, CHI Extended Abstracts.

[17]  Allison M. Okamura,et al.  Haptics: The Present and Future of Artificial Touch Sensation , 2018, Annu. Rev. Control. Robotics Auton. Syst..

[18]  Jeffrey W. Bertrand,et al.  Effects of Stereoscopic Viewing and Haptic Feedback, Sensory-Motor Congruence and Calibration on Near-Field Fine Motor Perception-Action Coordination in Virtual Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[19]  Allison M. Okamura,et al.  Fingertip Tactile Devices for Virtual Object Manipulation and Exploration , 2017, CHI.

[20]  Robert J. Teather,et al.  Pointing at 3d target projections with one-eyed and stereo cursors , 2013, CHI.

[21]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[22]  Heather Culbertson,et al.  Importance of Matching Physical Friction, Hardness, and Texture in Creating Realistic Haptic Virtual Surfaces , 2017, IEEE Transactions on Haptics.

[23]  Carla Maria Dal Sasso Freitas,et al.  Cooperative object manipulation in immersive virtual environments: framework and techniques , 2002, VRST '02.

[24]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[25]  Krishna Bharat,et al.  Making computers easier for older adults to use: area cursors and sticky icons , 1997, CHI.

[26]  Robert J. Teather,et al.  FittsTilt: the application of Fitts' law to tilt-based interaction , 2012, NordiCHI.

[27]  Ryan P. McMahan Exploring the Effects of Higher-Fidelity Display and Interaction for Virtual Reality Games , 2011 .

[28]  MacKenzie Is A Note on the Information-Theoretic Basis for Fitts’ Law , 1989 .

[29]  Domenico Prattichizzo,et al.  Simplified design of haptic display by extending one-point kinesthetic feedback to multipoint tactile feedback , 2010, 2010 IEEE Haptics Symposium.

[30]  I. Scott MacKenzie,et al.  ISO 9241-9 evaluation of video game controllers , 2009, Graphics Interface.

[31]  João Marcelo X. N. Teixeira,et al.  Fishtank Everywhere: Improving Viewing Experience over 3D Content , 2014, HCI.

[32]  Jens Garstka View-dependent 3 D Projection using Depth-Image-based Head Tracking , 2011 .

[33]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[34]  I. Scott MacKenzie,et al.  Extending Fitts' law to two-dimensional tasks , 1992, CHI.

[35]  A. Murata,et al.  Extending Fitts' law to a three-dimensional pointing task. , 2001, Human movement science.

[36]  J. Guilford The Guilford‐Zimmerman Aptitude Survey , 1956 .

[37]  Michael R. M. Jenkin,et al.  Evaluating haptic feedback in virtual environments using ISO 9241–9 , 2010, 2010 IEEE Virtual Reality Conference (VR).

[38]  Gerd Bruder,et al.  Analysis of direct selection in head-mounted display environments , 2014, 2014 IEEE Symposium on 3D User Interfaces (3DUI).

[39]  Juan Pablo Wachs,et al.  Joint Surgeon Attributes Estimation in Robot-Assisted Surgery , 2018, HRI.

[40]  Larry F. Hodges,et al.  A schematic eye for virtual environments , 2016, 2016 IEEE Symposium on 3D User Interfaces (3DUI).

[41]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[42]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[43]  Gerald M. Fried,et al.  FLS Assessment of Competency Using Simulated Laparoscopic Tasks , 2008, Journal of Gastrointestinal Surgery.

[44]  Eric D. Ragan,et al.  Detection of Scaled Hand Interactions in Virtual Reality: The Effects of Motion Direction and Task Complexity , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[45]  Mar Gonzalez-Franco,et al.  The uncanny valley of haptics , 2018, Science Robotics.

[46]  Ferdinando A. Mussa-Ivaldi,et al.  Perception and Action in Teleoperated Needle Insertion , 2011, IEEE Transactions on Haptics.

[47]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[48]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[49]  T. O. Kvålseth An alternative to Fitts’ law , 1980 .

[50]  Andrew T. Duchowski,et al.  A rotary dial for gaze-based PIN entry , 2016, ETRA.

[51]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[52]  Paul Kabbash,et al.  The “prince” technique: Fitts' law and selection using area cursors , 1995, CHI '95.

[53]  Robert J. Teather,et al.  Pointing at 3D targets in a stereo head-tracked virtual environment , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[54]  Murat Cenk Cavusoglu,et al.  Effect of visuo-haptic co-location on 3D Fitts' task performance , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[55]  Allison M. Okamura,et al.  Vibration feedback models for virtual environments , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[56]  Marc Cavazza,et al.  2011 Ninth International Conference on Creating, Connecting and Collaborating through Computing , 2011 .

[57]  Antonio Krüger,et al.  Estimating Detection Thresholds for Desktop-Scale Hand Redirection in Virtual Reality , 2019, 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[58]  Isaac Cho,et al.  Evaluation of Cursor Offset on 3D Selection in VR , 2018, SUI.

[59]  Mary C. Whitton,et al.  Redirected touching: The effect of warping space on task performance , 2012, 2012 IEEE Symposium on 3D User Interfaces (3DUI).

[60]  Matthieu Poyade,et al.  Validation of a haptic virtual reality simulation in the context of industrial maintenance , 2012 .

[61]  Melina C Vassiliou,et al.  Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. , 2010, American journal of surgery.

[62]  G P Bingham,et al.  Comparing measures of monocular distance perception: verbal and reaching errors are not correlated. , 1998, Journal of experimental psychology. Human perception and performance.

[63]  Ravin Balakrishnan,et al.  Target acquisition in Fish Tank VR: The effects of Lag and Frame Rate , 1994 .

[64]  Robert J. Teather,et al.  The eyes don't have it: an empirical comparison of head-based and eye-based selection in virtual reality , 2017, SUI.

[65]  F. Barbagli,et al.  Evaluating haptics and 3D stereo displays using Fitts' law , 2004, Proceedings. Second International Conference on Creating, Connecting and Collaborating through Computing.

[66]  Wolfgang Stuerzlinger,et al.  The Effect of Rotational Jitter on 3D Pointing Tasks , 2019, CHI Extended Abstracts.

[67]  Serban R. Pop,et al.  The Use of Stereoscopy in a Neurosurgery Training Virtual Environment , 2016, PRESENCE: Teleoperators and Virtual Environments.