Multimedia interactive services automation based on content indexing

On fixed or mobile television (TV), interactive services embedded in multimedia are key technologies as they forge links among the media, telecom, and services worlds. In a context where content evolves rapidly, the challenge is to be able to propose value-added services on live programs in real time. In this paper, we propose a solution that automates the generation of interactive TV applications, providing TV viewers with additional content in context with the original TV program. The proposed architecture is based on plug-in multimedia analyzers which generate a contextual description of the media and on an interactive scene generator to dynamically create related interactive scenes. Principles, architecture, implementation, and experiments are described; they are based on an application case related to interactive services added to a session of a French parliament TV program like “Les travaux de l'Assemblee Nationale” on the French television channel La Chaine Parlementaire (LCP).

[1]  Xavier Rodet,et al.  An Accurate Timbre Model for Musical Instruments and its Application to Classification , 2006 .

[2]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2006, IEEE Trans. Multim..

[3]  Ekram Khan,et al.  Player classification in interactive sport scenes using prior information region space analysis and number recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[4]  A. Murat Tekalp,et al.  Robust color histogram descriptors for video segment retrieval and identification , 2002, IEEE Trans. Image Process..

[5]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[6]  Alexandros Eleftheriadis,et al.  MPEG-4's binary format for scene description , 2000, Signal Process. Image Commun..

[7]  Alan P. Parkes,et al.  Real-time multimedia tagging and content-based retrieval for CCTV surveillance systems , 2002, SPIE ITCom.

[8]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[9]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[10]  Lifang Gu,et al.  Video analysis in MPEG compressed domain , 2002 .

[11]  Melissa Kay House.  The future of interactive television , 1995 .

[12]  Alexandros Eleftheriadis,et al.  MPEG-4 Systems: Elementary stream management , 2000, Signal Process. Image Commun..

[13]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[14]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[15]  Chung-Hyun Ahn,et al.  Demonstration of Bidirectional Services Using MPEG-4 BIFS in Terrestrial DMB Systems , 2006 .

[16]  Rama Chellappa,et al.  Human and machine recognition of faces: a survey , 1995, Proc. IEEE.

[17]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..