An Object-Based Audio System for Interactive Broadcasting

This paper describes audio recording, delivery, and rendering for an end-to-end broadcast system allowing users free navigation of panoramic video content with matching interactive audio. The system is based on one developed as part of the EU FP7 funded project, FascinatE. The premise of the system was to allow users free navigation of an ultra-high definition 180 degree video panorama for a customizable viewing experience. From an audio perspective the complete audio scene is recorded and broadcast so the rendered sound scene at the user end may be customized to match the view point. The approach described here uses an object-based audio paradigm. This paper presents an overview of the system and describes how such a system is useful for facilitating an interactive broadcast.

[1]  Frank Melchior,et al.  Platform Independent Audio , 2013 .

[2]  Jens Ahrens,et al.  Analytic Methods of Sound Field Synthesis , 2012 .

[3]  Jürgen Herre,et al.  MPEG Spatial Audio Object Coding—The ISO/MPEG Standard for Efficient Coding of Interactive Audio Scenes , 2010 .

[4]  J. Daniel,et al.  Représentation de champs acoustiques, application à la transmission et à la reproduction de scènes sonores complexes dans un contexte multimédia , 2000 .

[5]  Georg Thallinger,et al.  Media Production, Delivery and Interaction for Platform Independent Systems: Format-Agnostic Media , 2013 .

[6]  Benjamin Guy Shirley,et al.  Improving television sound for people with hearing impairments , 2013 .

[7]  Nicolas Tsingos,et al.  Scalable Format and Tools to Extend the Possibilities of Cinema Audio , 2012 .

[8]  Frank Melchior,et al.  Object-based audio applied to football broadcasts , 2013, ImmersiveMe '13.

[9]  Sascha Spors,et al.  Object-based audio reproduction and the audio scene description format , 2010 .

[10]  Mark A. Poletti,et al.  Three-Dimensional Surround Sound Systems Based on Spherical Harmonics , 2005 .

[11]  Christian Weissig,et al.  Ultrahigh-Resolution Panoramic Imaging for Format-Agnostic Video Production , 2013, Proceedings of the IEEE.

[12]  Jens Spille,et al.  Object-based audio for interactive football broadcast , 2013, Multimedia Tools and Applications.

[13]  R. Duraiswami,et al.  Fast Multipole Methods for the Helmholtz Equation in Three Dimensions , 2005 .