Influence of visual and haptic delays on stiffness perception in augmented reality

Visual delays are unavoidable in augmented reality setups and occur in different steps of the rendering pipeline. In the context of haptic interaction with virtual objects, it has been shown that delayed force feedback can alter the perception of object stiffness. We hypothesize that delays in augmented reality systems can have similar consequences. To test this, we carried out a user study to investigate the effect of visual and haptic delays on the perception of stiffness. The experiment has been performed in an optimized visuo-haptic augmented reality setup, which allows to artificially manipulate delays during visual and haptic rendering. In line with previous results, delays for haptic feedback resulted in decreased perceived stiffness. In contrast, visual delays caused an increase in perceived stiffness. However, the simultaneous occurrence of delays in both sensory channels led to a partial compensation of these effects. This could potentially help to correct stiffness perception of virtual objects in visuo-haptic augmented reality systems.

[1]  Henry Fuchs,et al.  Simulation-based design and rapid prototyping of a parallax-free, orthoscopic video see-through head-mounted display , 2005, Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR'05).

[2]  Ferdinando A. Mussa-Ivaldi,et al.  Perception of Delayed Stiffness , 2006 .

[3]  Henry Fuchs,et al.  Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization , 2000, Presence: Teleoperators & Virtual Environments.

[4]  Colin Swindells,et al.  System lag tests for augmented and virtual environments , 2000, UIST '00.

[5]  Hitoshi Ohnishi,et al.  Effect of Delay of Feedback Force on Perception of Elastic Force: A Psychophysical Approach , 2007, IEICE transactions on communications.

[6]  Ingrid M. L. C. Vogels,et al.  Detection of Temporal Delays in Visual-Haptic Interfaces , 2004, Hum. Factors.

[7]  Roberta L. Klatzky,et al.  Haptic Rendering and Psychophysical Evaluation of a Virtual Three-Dimensional Helical Spring , 2008, 2008 Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[8]  Caroline Jay,et al.  Delayed visual and haptic feedback in a reciprocal tapping task , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[9]  Caroline Jay,et al.  Modeling the effects of delayed haptic and visual feedback in a collaborative virtual environment , 2007, TCHI.

[10]  Nassir Navab,et al.  Measurement of absolute latency for video see through augmented reality , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[11]  Mark Billinghurst,et al.  A survey of evaluation techniques used in augmented reality studies , 2008, SIGGRAPH 2008.

[12]  Gábor Székely,et al.  Calibration, Registration, and Synchronization for High Precision Augmented Reality Haptics , 2009, IEEE Transactions on Visualization and Computer Graphics.

[13]  M A Srinivasan,et al.  Manual discrimination of compliance using active pinch grasp: The roles of force and work cues , 1995, Perception & psychophysics.

[14]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[15]  M. Di Luca,et al.  Effects of visual–haptic asynchronies and loading–unloading movements on compliance perception , 2011, Brain Research Bulletin.