Exploring the Impact of Visual-Haptic Registration Accuracy in Augmented Reality

In augmented reality (AR) systems featuring visual and haptic cues it is important to maintain a close match between the presented stimuli in order to create realistic environments. What is felt must match what is seen. However, this is a challenging task - AR systems inherently feature noise. This paper describes a study to explore the effect of disparities between visual and haptic cues in a targeting task in an AR environment. The results reveal that participants were highly sensitive to discrepancies between the modalities; performance degraded with registration errors of as low as 2 mm, suggesting this is practical limit for AR systems. Future work will explore how haptic rendering parameters such as cursor size and stiffness affect these results.

[1]  Masahiko Inami,et al.  Visuo-haptic display using head-mounted projector , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[2]  Hui Zhao,et al.  Collocation Accuracy of Visuo-Haptic System: Metrics and Calibration , 2011, IEEE Transactions on Haptics.

[3]  Gábor Székely,et al.  Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[4]  Wei Ji,et al.  3D Stereo Viewing Evaluation for the Virtual Haptic Back Project , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[5]  George D. Stetten,et al.  Optical merger of direct vision with virtual images for scaled teleoperation , 2006, IEEE Transactions on Visualization and Computer Graphics.

[6]  Gavin P. Lawrence,et al.  Inferring online and offline processing of visual feedback in target-directed movements from kinematic data , 2006, Neuroscience & Biobehavioral Reviews.

[7]  L. Faes,et al.  Quantifying the contribution of arm postural tremor to the outcome of goal-directed pointing task by displacement measures , 2004, Journal of Neuroscience Methods.

[8]  David Swapp,et al.  Interaction with co-located haptic feedback in virtual reality , 2006, Virtual Reality.

[9]  Christian Sandor,et al.  Visuo-Haptic Systems: Half-Mirrors Considered Harmful , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[10]  Human-Computer Interaction – INTERACT 2009 , 2009, Lecture Notes in Computer Science.

[11]  Dzmitry Aliakseyeu,et al.  Insight into Goal-Directed Movements: Beyond Fitts' Law , 2009, INTERACT.

[12]  Julie A. Jacko,et al.  Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments , 2002, Assets '02.

[13]  G. Dawe,et al.  Design of the ImmersiveTouch TM : a High-Performance Haptic Augmented Virtual Reality System , 2005 .

[14]  Martin Buss,et al.  Distributed PC-based haptic, visual and acoustic telepresence system-experiments in virtual and remote environments , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).