A Novel Test-Bed for Immersive and Interactive Broadcasting Production Using Augmented Reality and Haptics

In this paper, we demonstrate an immersive and interactive broadcasting production system with a new haptically enhanced multimedia broadcasting chain. The system adapts Augmented Reality (AR) techniques, which merges captured videos and virtual 3D media seamlessly through multimedia streaming technology, and haptic interaction technology in near real-time. In this system, viewers at the haptic multimedia client can interact with AR broadcasting production transmitted via communication network. We demonstrate two test applications, which show that the addition of AR- and haptic-interaction to the conventional audio-visual contents can improve immersiveness and interactivity of viewers with rich contents service.

[1]  Jeha Ryu,et al.  An Electrotactile Device for Broadcasting and Game Applications , 2005 .

[2]  Jeha Ryu,et al.  Hardware Based 2 . 5 D Haptic Rendering Algorithm using Localized Occupancy Map Instance , 2004 .

[3]  Jongeun Cha,et al.  A haptically enhanced broadcasting system , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[4]  Jongeun Cha,et al.  Haptic Interaction in Realistic Multimedia Broadcasting , 2004, PCM.

[5]  Matt Hammond,et al.  Case studies in application of augmented reality in future media production , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[6]  Jong-Phil Kim,et al.  Smooth Haptic Interaction in Broadcasted Augmented Reality , 2005, INTERACT.

[7]  Christopher M. Brown,et al.  Haptics in augmented reality , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[8]  Joungil Yun,et al.  AR over MPEG-2 TS , 2005 .

[9]  Ralf Dörner,et al.  Accuracy in optical tracking with fiducial markers: an accuracy function for ARToolKit , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[10]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[11]  I. Oakley,et al.  Touch TV : Adding Feeling to Broadcast Media , 2003 .