Hyper-Interactive Video Browsing by a Remote Controller and Hand Gestures

Interactive video browsing tools are designed for e-learning applications on future interactive TVs. The integrated system includes an authoring tool that produces multi-paths videos and a playback tool that uses video tracking technology and a remote controller. The playback tool enables multi-modal interaction between the user and a multi-story video clip. Three types of hyper-interactive controls are incorporated, which include a reference link of a video object to show supplementary information on the Web, a hyper link to enable hyper-video jumps, and a choice link for online answers to pre-designed questions. The underlying video is coded using the standard MPEG technology, with navigation information hidden in the user-defined data of MPEG. Thus, the default sequence of a hypervideo can also be presented using an ordinary video player.

[1]  Jim Taylor.  DVD Demystified , 1998 .

[2]  J. Bing,et al.  MiTV: rethinking interactive TV , 2001, Proceedings Seventh International Conference on Virtual Systems and Multimedia.

[3]  Yoichi Sato,et al.  Real-time tracking of multiple fingertips and gesture recognition for augmented desk interface systems , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[4]  Hiroaki Ogata,et al.  XML-based video annotation system for language learning environment , 2001, Proceedings of the Second International Conference on Web Information Systems Engineering.

[5]  Fernando Pereira,et al.  Objective evaluation of video segmentation quality , 2003, IEEE Trans. Image Process..

[6]  José Miguel Salles Dias,et al.  O.G.R.E. - Open Gestures Recognition Engine , 2004, SIBGRAPI.

[7]  Pablo César,et al.  Open graphical framework for interactive TV , 2006, Multimedia Tools and Applications.

[8]  Liang-Jie Zhang,et al.  An integrated live interactive content insertion system for digital TV commerce , 2002, Fourth International Symposium on Multimedia Software Engineering, 2002. Proceedings..

[9]  Ian E. Smith,et al.  Authoring and Navigating Video in Space and Time , 1997, IEEE Multim..

[10]  Timothy K. Shih,et al.  An object-based hypervideo authoring system , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Yang Liu,et al.  A robust hand tracking and gesture recognition method for wearable visual interfaces and its applications , 2004, Third International Conference on Image and Graphics (ICIG'04).