Multimedia interactive services automation based on content indexing

On fixed or mobile television (TV), interactive services embedded in multimedia are key technologies as they forge links among the media, telecom, and services worlds. In a context where content evolves rapidly, the challenge is to be able to propose value-added services on live programs in real time. In this paper, we propose a solution that automates the generation of interactive TV applications, providing TV viewers with additional content in context with the original TV program. The proposed architecture is based on plug-in multimedia analyzers which generate a contextual description of the media and on an interactive scene generator to dynamically create related interactive scenes. Principles, architecture, implementation, and experiments are described; they are based on an application case related to interactive services added to a session of a French parliament TV program like “Les travaux de l'Assemblée Nationale” on the French television channel La Chaine Parlementaire (LCP).

[1]  A. Murat Tekalp,et al.  Robust color histogram descriptors for video segment retrieval and identification , 2002, IEEE Trans. Image Process..

[2]  Alexandros Eleftheriadis,et al.  MPEG-4 Systems: Elementary stream management , 2000, Signal Process. Image Commun..

[3]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[4]  Alexandros Eleftheriadis,et al.  MPEG-4's binary format for scene description , 2000, Signal Process. Image Commun..

[5]  Lifang Gu,et al.  Video analysis in MPEG compressed domain , 2002 .

[6]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[7]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[8]  Alan P. Parkes,et al.  Real-time multimedia tagging and content-based retrieval for CCTV surveillance systems , 2002, SPIE ITCom.

[9]  Melissa Kay House The future of interactive television , 1995 .

[10]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Chung-Hyun Ahn,et al.  Demonstration of Bidirectional Services Using MPEG-4 BIFS in Terrestrial DMB Systems , 2006 .

[12]  Xavier Rodet,et al.  An Accurate Timbre Model for Musical Instruments and its Application to Classification , 2006 .

[13]  A. IntracomS.,et al.  MELISA Multiplatform e-Publishing for Leisure and Interactive Sports Advertising , 2005 .

[14]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[15]  Ekram Khan,et al.  Player classification in interactive sport scenes using prior information region space analysis and number recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2000, IEEE Transactions on Multimedia.