The Effects of Haptic Feedback and Visual Distraction on Pointing Task Performance

Previous research has not fully examined the effect of additional sensory feedback, particularly delivered through the haptic modality, in pointing task performance with visual distractions. This study examined the effect of haptic feedback and visual distraction on pointing task performance in a 3D virtual environment. Results indicate a strong positive effect of haptic feedback on performance in terms of task time and root mean square error of motion. Level of similarity between distractor objects and the target object significantly reduced performance, and subjective ratings indicated a sense of increased task difficulty as similarity increased. Participants produced the best performance in trials where distractor objects had a different color but the same shape as the target object and constant haptic assistive feedback was provided. Overall, this study provides insight toward the effect of object features and similarity and the effect of haptic feedback on pointing task performance.

[1]  H S Vitense,et al.  Multimodal feedback: an assessment of performance and mental workload , 2003, Ergonomics.

[2]  Gerard Jounghyun Kim,et al.  Effects of haptic feedback, stereoscopy, and image resolution on performance and presence in remote navigation , 2008, Int. J. Hum. Comput. Stud..

[3]  Ethan R. Buch,et al.  Effects of Parkinson's disease on visuomotor adaptation , 2003, Experimental Brain Research.

[4]  Mahdi Tavakoli,et al.  A haptic interface for computer-integrated endoscopic surgery and training , 2006, Virtual Reality.

[5]  A. Murata,et al.  Extending Fitts' law to a three-dimensional pointing task. , 2001, Human movement science.

[6]  Bernice E. Rogowitz,et al.  A rule-based tool for assisting colormap selection , 1995, Proceedings Visualization '95.

[7]  Carryl L. Baldwin,et al.  Equating Perceived Urgency Across Auditory, Visual, and Tactile Signals , 2012 .

[8]  Blake Hannaford,et al.  Parametric Study of Virtual Curvature Recognition: Discrimination Thresholds for Haptic and Visual Sensory Information , 2010, HAID.

[9]  Rüdiger Dillmann,et al.  Haptic output in multimodal user interfaces , 1997, IUI '97.

[10]  David B. Kaber,et al.  The Effects of Haptic and Visual Aiding on Psychomotor Task Strategy Development During Virtual Reality-Based Training , 2012 .

[11]  Tonya L. Smith-Jackson,et al.  Elicitation of Haptic User Interface Needs of People with Low Vision , 2013, Int. J. Hum. Comput. Interact..

[12]  Gavriel Salvendy,et al.  Impact of multimodal feedback on simulated ergonomic measurements in a virtual environment: A case study with manufacturing workers , 2012 .

[13]  Yves Guiard,et al.  Fitts' law in two-dimensional task space , 2004, Experimental Brain Research.

[14]  P Jolicoeur,et al.  The linear separability effect in color visual search: Ruling out the additive color hypothesis , 1998, Perception & psychophysics.

[15]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[16]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[17]  Mehdi Ammi,et al.  A framework for building haptic interactions for teleoperation systems , 2008, HAS '08.

[18]  Zhi Li,et al.  Controlled interaction: Strategies for using virtual reality to study perception , 2010, Behavior research methods.

[19]  Ju-Hwan Lee,et al.  The Effect of Multimodal Feedback Presented via a Touch Screen on the Performance of Older Adults , 2009, HAID.

[20]  Tonya L. Smith-Jackson,et al.  Haptic User Interfaces for the Visually Impaired: Implications for Haptically Enhanced Science Learning Systems , 2012, Int. J. Hum. Comput. Interact..

[21]  R J Jagacinski,et al.  Fitts' Law in two dimensions with hand and head movements. , 1983, Journal of motor behavior.

[22]  김경환.  Haptic Interface , 2001 .

[23]  Toomas Timpka,et al.  Adding Value with 3D Visualization and Haptic Forces to Radiosurgery—A Small Theory-Based, Quasi-Experimental Study , 2006, Journal of Medical Systems.

[24]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[25]  W. Cowan,et al.  Visual search for colour targets that are or are not linearly separable from distractors , 1996, Vision Research.

[26]  Shumin Zhai,et al.  Refining Fitts' law models for bivariate pointing , 2003, CHI '03.

[27]  James T. Enns,et al.  Target detection and localization in visual search: A dual systems perspective , 2003, Perception & psychophysics.

[28]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[29]  Deborah J. Aks,et al.  Visual search for size is influenced by a background texture gradient. , 1996, Journal of experimental psychology. Human perception and performance.

[30]  Timothy S. Miller,et al.  An insidious Haptic invasion: adding force feedback to the X desktop , 1998, UIST '98.

[31]  Mohamed Ashraf Ali,et al.  The Effects of Gain Adaptation for QoS Deterioration in Internet-based Teleoperation Involving Use of a Virtual Reality Interface , 2003 .

[32]  Christopher G. Healey,et al.  Choosing effective colours for data visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[33]  Hideo Kitagawa,et al.  Collision avoidance in an omni-directional wheelchair by using haptic feedback , 2005 .

[34]  Fumio Harashima,et al.  Assistance control on a haptic system for human adaptive mechatronics , 2006, Adv. Robotics.

[35]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[36]  Christine Mégard,et al.  The Effect of Haptic, Visual and Auditory Feedback on an Insertion Task on a 2-Screen Workbench , 2003 .

[37]  Ilona Heldal,et al.  Perception of color and space in virtual reality: a comparison between a real room and virtual reality models , 2004, IS&T/SPIE Electronic Imaging.

[38]  K. Sunnerhagen,et al.  Virtual reality and haptics as a training device for movement rehabilitation after stroke: a single-case study. , 2004, Archives of Physical Medicine and Rehabilitation.

[39]  Lee Skrypchuk,et al.  Visual-haptic feedback interaction in automotive touchscreens , 2012, Displays.

[40]  Gabriel Robles-De-La-Torre,et al.  The importance of the sense of touch in virtual and real environments , 2006, IEEE MultiMedia.

[41]  Yasuyo G. Ichihara.  Suitable digital color palette (DPC) for individual human color vision sensitivity , 1999, Electronic Imaging.

[42]  Frank Tendick,et al.  Haptic guidance: experimental evaluation of a haptic training method for a perceptual motor skill , 2002, Proceedings 10th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. HAPTICS 2002.

[43]  Charlotte Magnusson,et al.  Non Visual Haptic Audio Tools for Virtual Environments , 2006, HAID.

[44]  Bang Wong,et al.  Points of view: Color blindness , 2011, Nature Methods.

[45]  Stephen R. Ellis.  On Redundancy in the Design of Spatial instruments , 2005 .

[46]  Chang Soo Nam,et al.  The roles of sensory modalities in collaborative virtual environments (CVEs) , 2008, Comput. Hum. Behav..

[47]  Brian D. Simpson,et al.  Evaluation of a Collaborative Movement Task in a Distributed Three-Dimensional Virtual Environment , 2005 .

[48]  S. Sanders,et al.  Colour, design and virtual reality at JET , 2006 .

[49]  J. Duncan,et al.  Visual search and stimulus similarity. , 1989, Psychological review.

[50]  Ravi Kuber,et al.  Towards developing assistive haptic feedback for visually impaired internet users , 2007, CHI.

[51]  Karin Coninx,et al.  Target Acquisition with Force Feedback: The Effect of Different Forces on the User's Performance , 2009, HAID.

[52]  I. A. Jones,et al.  A virtual reality surgery simulation of cutting and retraction in neurosurgery with force-feedback , 2006, Comput. Methods Programs Biomed..

[53]  Doug A. Bowman,et al.  A Survey of Usability Evaluation in Virtual Environments: Classification and Comparison of Methods , 2002, Presence: Teleoperators & Virtual Environments.