Psychophysical influence of mixed-reality visual stimulation on sense of hardness

In a mixed-reality (MR) environment, the appearance of touchable objects can be changed by superimposing a computer-generated image (CGI) onto them (MR visual stimulation). At the same time, when humans sense the hardness of real objects, it is known that their perception is influenced not only by tactile information but also by visual information. In this paper, we studied the psychophysical influence on the sense of hardness by using a real object that has a CGI superimposed on it. In this experiment, we deform in an extreme way the CGI animation on the real object, while the subject pushes the real object using his/her finger. The results of the experiments found that human subjects sensed different hardnesses by emphasizing the dent deformation of the CGI animation.

[1]  Ferdinando A. Mussa-Ivaldi,et al.  Perception of Delayed Stiffness , 2006 .

[2]  Hirokazu Kato,et al.  Mixed Reality-Merging Real and Virtual Worlds , 1999 .

[3]  Hideyuki Tamura,et al.  A mixed reality system with visual and tangible interaction capability: application to evaluating automobile interior design , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[4]  M. A. Srinivassan.  The impact of visual information on the haptic perception of stiffness in virtual environments , 1996 .

[5]  B. MacIntyre,et al.  Guest Editors' Introduction: Moving Mixed Reality into the Real World , 2005, IEEE Computer Graphics and Applications.

[6]  Frank Biocca,et al.  Visual Touch in Virtual Environments: An Exploratory Study of Presence, Multimodal Interfaces, and Cross-Modal Sensory Illusions , 2001, Presence: Teleoperators & Virtual Environments.

[7]  Fumihisa Shibata,et al.  Analysis of Tactual Impression by Audio and Visual Stimulation for User Interface Design in Mixed Reality Environment , 2009, HCI.

[8]  Hitoshi Ohnishi,et al.  Effect of Delay of Feedback Force on Perception of Elastic Force: A Psychophysical Approach , 2007, IEICE transactions on communications.

[9]  Fumihisa Shibata,et al.  Psychophysical Influence on Tactual Impression by Mixed-Reality Visual Stimulation , 2008, 2008 IEEE Virtual Reality Conference.

[10]  Hideyuki Tamura,et al.  MR Platform: a basic body on which mixed reality applications are built , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[11]  Matthias Harders,et al.  Influence of visual and haptic delays on stiffness perception in augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.