Contact Interaction with Integrated Audio and Haptics

We have developed a computer interface that simultaneously renders integrated auditory and haptic stimuli with very low latency. The interface includes a three degree of freedom (DOF) Pantograph haptic device that reads position input and renders force output. We synthesize audio by convolving the force profile generated by user interaction with the impulse response of the virtual surface. Thus, both auditory and haptic modes are tightly coupled. This system should aid in evaluating efficient algorithms for integrated rendering of both sensory modes. We will demonstrate the interface during the conference.