Toward "Pseudo-Haptic Avatars": Modifying the Visual Animation of Self-Avatar Can Simulate the Perception of Weight Lifting

In this paper we study how the visual animation of a self-avatar can be artificially modified in real-time in order to generate different haptic perceptions. In our experimental setup, participants could watch their self-avatar in a virtual environment in mirror mode while performing a weight lifting task. Users could map their gestures on the self-animated avatar in real-time using a Kinect. We introduce three kinds of modification of the visual animation of the self-avatar according to the effort delivered by the virtual avatar: 1) changes on the spatial mapping between the user's gestures and the avatar, 2) different motion profiles of the animation, and 3) changes in the posture of the avatar (upper-body inclination). The experimental task consisted of a weight lifting task in which participants had to order four virtual dumbbells according to their virtual weight. The user had to lift each virtual dumbbells by means of a tangible stick, the animation of the avatar was modulated according to the virtual weight of the dumbbell. The results showed that the altering the spatial mapping delivered the best performance. Nevertheless, participants globally appreciated all the different visual effects. Our results pave the way to the exploitation of such novel techniques in various VR applications such as sport training, exercise games, or industrial training scenarios in single or collaborative mode.

[1]  Mel Slater,et al.  Drumming in Immersive Virtual Reality: The Body Shapes the Way We Play , 2013, IEEE Transactions on Visualization and Computer Graphics.

[2]  Maud Marchal,et al.  Pseudo-haptic feedback augmented with visual and tactile vibrations , 2011, 2011 IEEE International Symposium on VR Innovation.

[3]  Fumihisa Shibata,et al.  Shape-COG Illusion: Psychophysical influence on center-of-gravity perception by mixed-reality visual stimulation , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[4]  Taku Komura,et al.  Can we distinguish biological motions of virtual humans?: perceptual study with captured motions of weight lifting , 2010, VRST '10.

[5]  Bryan Buchholz,et al.  ISB recommendation on definitions of joint coordinate systems of various joints for the reporting of human joint motion--Part II: shoulder, elbow, wrist and hand. , 2005, Journal of biomechanics.

[6]  Heinrich H. Bülthoff,et al.  A Communication Task in HMD Virtual Environments: Speaker and Listener Movement Improves Communication , 2010 .

[7]  W. Taylor,et al.  A survey of formal methods for determining the centre of rotation of ball joints. , 2006, Journal of biomechanics.

[8]  Jillian Hamilton.  Identifying with an avatar: A multidisciplinary perspective , 2009 .

[9]  Hideyuki Ando,et al.  Inducing human motion by visual manipulation , 2011, AH '11.

[10]  Anatole Lécuyer,et al.  Simulating Haptic Feedback Using Vision: A Survey of Research and Applications of Pseudo-Haptic Feedback , 2009, PRESENCE: Teleoperators and Virtual Environments.

[11]  Takuji Narumi,et al.  Augmented endurance: controlling fatigue while handling objects by affecting weight perception using augmented reality , 2013, CHI.

[12]  Maria V. Sanchez-Vives,et al.  Inducing Illusory Ownership of a Virtual Body , 2009, Front. Neurosci..

[13]  Abderrahmane Kheddar,et al.  Pseudo-haptic feedback: can isometric input devices simulate force feedback? , 2000, Proceedings IEEE Virtual Reality 2000 (Cat. No.00CB37048).

[14]  I ROCK,et al.  Vision and Touch: An Experimentally Created Conflict between the Two Senses , 1964, Science.

[15]  Olivier Martin,et al.  HEMP - hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis , 2009, Int. J. Hum. Comput. Stud..

[16]  Fereydoon Vafaei,et al.  Taxonomy of Gestures in Human Computer Interaction , 2013 .

[17]  Maria V. Sanchez-Vives,et al.  Towards a Digital Body: The Virtual Arm Illusion , 2008, Frontiers in human neuroscience.

[18]  T. Metzinger,et al.  Video Ergo Sum: Manipulating Bodily Self-Consciousness , 2007, Science.

[19]  Yasushi Kambayashi,et al.  Physical Instructional Support System Using Virtual Avatars , 2012, ACHI 2012.

[20]  mc schraefel,et al.  A Taxonomy of Gestures in Human Computer Interactions , 2005 .

[21]  Heinrich H. Bülthoff,et al.  The Effect of Viewing a Self-Avatar on Distance Judgments in an HMD-Based Virtual Environment , 2010, PRESENCE: Teleoperators and Virtual Environments.

[22]  Steve Benford,et al.  User embodiment in collaborative virtual environments , 1995, CHI '95.

[23]  M. Heller,et al.  Intersensory conflict between vision and touch: The response modality dominates when precise, attention-riveting judgments are required , 1999, Perception & psychophysics.

[24]  R. Klatzky,et al.  There's more to touch than meets the eye: The salience of object attributes for haptics with and without vision. , 1987 .

[25]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[26]  Simon Richir,et al.  Influence of control/display ratio on the perception of mass of manipulated objects in virtual environments , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[27]  Daniel Thalmann,et al.  Characterizing full-body reach duration across task and viewpoint modalities , 2008, J. Virtual Real. Broadcast..

[28]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[29]  Anatole Lécuyer,et al.  "Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system , 2001, Proceedings IEEE Virtual Reality 2001.

[30]  Heinrich H. Bülthoff,et al.  Welcome to Wonderland: The Influence of the Size and Shape of a Virtual Hand On the Perceived Size and Shape of Virtual Objects , 2013, PloS one.