Synthesis of Haptic and Auditory Senses Based on Physical Model

Currently most of virtual reality system with auditory feedback can produce good feel of presence to the users. In VR (Virtual Reality) environment, interactions with virtual objects are common events. Some systems provide sounds generated by interactions between virtual objects, although they are generated using modulation technique of prerecorded sounds. There is a limitation in that method. We should consider the sound generation method based on physical models. In this paper, we propose a method of synthesis haptic and auditory senses that is based on physical model. We have developed an auditory environment with haptic sensation. We equipped a speaker at the end effecter of the HapticMaster. The FEM (Finite Element Method) is used to calculate the vibration of the virtual object. And the sound pressure data at the speaker position are calculated based on the vibration in real time. The effectiveness of our method is tested through the experiments by users.