Feeling the motion of object in a dynamic image sequence through haptic interface

In this paper we discussed how to incorporate haptic signals with a dynamic image sequence or other words a video to feel the motion of objects in it. Haptic technologies are being used in a wide range of application areas. However, the incorporation of haptic interface technology into a video media is still in its infancy. With the invention of digital multimedia and immersive displays, significance of exploring new ways of interacting with video media has grown up. Rather than just seeing and hearing a video, viewers' experience can be further enhanced by letting them feel the movement of the objects in the video through haptic interface, as it is an additional sensation to seeing and hearing. The objective of this research is to use haptic interface technology to interact with a video and enable the viewers to feel the motion of objects in the video beyond passive watching and listening. In this paper, we discuss how to feel the motion, which is computed from frame to frame calculation of velocity using optical flow. For haptic motion rendering, we have proposed a method by experimentally evaluating two methods using a gain controller and using a non-linear function. To interact with the video we used the string based haptic device, SPIDAR, which provides a high definition force feedback sensation to users.

[1]  Ian Oakley,et al.  Haptic Interaction with Depth Video Media , 2005, PCM.

[2]  Alain Pruski,et al.  Real time facial feature points tracking with Pyramidal Lucas-Kanade algorithm , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Makoto Sato,et al.  A Proposal of a High Definition Haptic Rendering for Stability and Fidelity , 2006, 16th International Conference on Artificial Reality and Telexistence--Workshops (ICAT'06).

[4]  Jeha Ryu,et al.  3DTV System using Depth Image-Based Video in the MPEG-4 Multimedia Framework , 2007, 2007 3DTV Conference.

[5]  Yo-Sung Ho,et al.  3D video player system with haptic interaction based on depth image-based representation , 2006, IEEE Transactions on Consumer Electronics.

[6]  Makoto Sato,et al.  Tension based 7-DOF force feedback device: SPIDAR-G , 2002, Proceedings IEEE Virtual Reality 2002.

[7]  Yasuharu Koike,et al.  Tension Based 7 DOFs Force Feedback Device , 2002 .

[8]  Jun Wu,et al.  Virtual fixture based haptic rendering of handwriting , 2009, 2009 IEEE International Conference on Virtual Environments, Human-Computer Interfaces and Measurements Systems.

[9]  A. Murat Tekalp,et al.  Immersive haptic interaction with media , 2010, Visual Communications and Image Processing.

[10]  I. Oakley,et al.  Touch TV : Adding Feeling to Broadcast Media , 2003 .

[11]  Cagatay Basdogan,et al.  Haptics in minimally invasive surgical simulation and training , 2004, IEEE Computer Graphics and Applications.

[12]  Abdulmotaleb El-Saddik,et al.  Touchable 3D video system , 2009, TOMCCAP.

[13]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[14]  R. Cross.  The bounce of a ball , 1999 .

[15]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[16]  Vincent Hayward,et al.  Haptic interfaces and devices , 2004 .

[17]  Makoto Sato,et al.  A Haptic Virtual Environment for Molecular Chemistry Education , 2008, Trans. Edutainment.