Modifying Perceived Size of a Handled Object through Hand Image Deformation

In this study, we aim to construct a perception-based shape display system to provide users with the sensation of touching virtual objects of varying shapes using only a simple mechanism. Thus far, we have proved that identified curved surface shapes or edge angles can be modified by displacing the visual representation of the user's hand. However, using this method, we cannot emulate multifinger touch, because of spatial unconformity. To solve this problem, we focus on modifying the identification of shapes using two fingers by deforming the visual representation of the user's hand. We devised a video see-through system that enables us to change the perceived shape of an object that a user is touching visually. The visual representation of the user's hand is deformed as if the user were handling a visual object; however, the user is actually handling an object of a different shape. Using this system, we conducted two experiments to investigate the effects of visuo-haptic interaction and evaluate its effectiveness. One is an investigation on the modification of size perception to confirm that the fingers did not stroke the shape but only touched it statically. The other is an investigation on the modification of shape perception for confirming that the fingers dynamically stroked the surface of the shape. The results of these experiments show that the perceived sizes of objects handled using a thumb and other finger(s) could be modified if the difference between the size of physical and visual stimuli was in the −40% to 35% range. In addition, we found that the algorithm can create an effect of shape perception modification when users stroke the shape with multiple fingers.

[1]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[2]  Luv Kohli,et al.  Exploiting Perceptual Illusions to Enhance Passive Haptics , 2009 .

[3]  Takuji Narumi,et al.  Modifying an Identified Angle of Edged Shapes Using Pseudo-haptic Effects , 2012, EuroHaptics.

[4]  Olivier Martin,et al.  HEMP - hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis , 2009, Int. J. Hum. Comput. Stud..

[5]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[6]  Takuji Narumi,et al.  Modifying an identified curved surface shape using pseudo-haptic effect , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[7]  Hiroo Iwata,et al.  Project FEELEX: adding haptic surface to graphics , 2001, SIGGRAPH.

[8]  S Coren,et al.  A size contrast illusion without physical size differences. , 1971, The American journal of psychology.

[9]  H E Ross,et al.  Charpentier (1891) on the size—weight illusion , 1999, Perception & psychophysics.

[10]  Anatole Lécuyer,et al.  A study of the modification of the speed and size of the cursor for simulating pseudo-haptic bumps and holes , 2008, TAP.

[11]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[12]  Takuji Narumi,et al.  Augmented perception of satiety: controlling food consumption by changing apparent size of food with augmented reality , 2012, CHI.

[13]  Scott Schaefer,et al.  Image deformation using moving least squares , 2006, ACM Trans. Graph..

[14]  J. Gibson,et al.  Adaptation, after-effect and contrast in the perception of curved lines. , 1933 .

[15]  Fumihisa Shibata,et al.  Psychophysical Influence on Tactual Impression by Mixed-Reality Visual Stimulation , 2008, 2008 IEEE Virtual Reality Conference.

[16]  Takuji Narumi,et al.  Magic pot: interactive metamorphosis of the perceived shape , 2012, SIGGRAPH '12.

[17]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[18]  Thomas H. Massie,et al.  The PHANToM Haptic Interface: A Device for Probing Virtual Objects , 1994 .

[19]  Yuichi Ohta,et al.  Sensory Property in Fusion of Visual/Haptic Cues by Using Mixed Reality , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).