Searching Multimedia Data using MPEG-7 Descriptions in a Broadcast Terminal

MPEG-7 is an emerging standard for representing information carried by multimedia data. Such a standard is considered crucial for the oncoming integration of broadcast (TV) and Internet technologies and applications. This paper reports on the development of methods for searching multimedia data using MPEG-7 in the context of the SAMBITS application, and, in particular, in the development of a SAMBITS terminal. SAMBITS, a European broadcast application project, developed a multimedia studio and terminal technology for new interactive broadcast services based on the MPEG standards. This paper describes, after an introduction to MPEG7 and a description of SAMBITS, a retrieval model for MPEG-7 in a broadcast terminal. The retrieval model was developed and implemented using the HySpirit software, which is a flexible framework for representing complex data and describing retrieval functions effectively. A user interface was also implementing to provide insights in integrating a search functionality in a broadcast terminal.

[1]  Andrea Basso,et al.  Browsing and Retrieval of Full Broadcast-Quality Video , 1999 .

[2]  Jane Hunter.  MPEG-7: Behind the Scenes , 1999, D Lib Mag..

[3]  James P. Callan,et al.  Passage-level evidence in document retrieval , 1994, SIGIR '94.

[4]  C. Q. Lee,et al.  The Computer Journal , 1958, Nature.

[5]  Barry Smyth,et al.  Enabling technologies: a personalized television listings service. , 2000 .

[6]  Joseph Y. Halpern,et al.  A Guide to Completeness and Complexity for Modal Logics of Knowledge and Belief , 1992, Artif. Intell..

[7]  Gabriella Kazai,et al.  The Accessibility Dimension for Structured Document Retrieval , 2002, ECIR.

[8]  Alexis Tsipras,et al.  Greece , 1940, Nature.

[9]  KiferMichael,et al.  Logical foundations of object-oriented and frame-based languages , 1995 .

[10]  Jane Hunter,et al.  The Application of Metadata Standards to Video Indexing , 1998, ECDL.

[11]  Omar Abou Khaled,et al.  Indexing and retrieval of TV news programs based on MPEG-7 , 2001, ICCE. International Conference on Consumer Electronics (IEEE Cat. No.01CH37182).

[12]  Yihong Gong,et al.  Automatic parsing and indexing of news video , 1995, Multimedia Systems.

[13]  Mark E. Frisse.  Searching for Information in a Hypertext Medical Handbook , 1987, Hypertext.

[14]  Michael Kifer,et al.  Logical foundations of object-oriented and frame-based languages , 1995, JACM.

[15]  Mounia Lalmas,et al.  Using MPEG- at the Consumer Terminal in Broadcasting , 2002, EURASIP J. Adv. Signal Process..

[16]  Thomas Roelleke.  POOL: probabilistic object oriented logical representation and retrieval of complex objects: a model for hypermedia retrieval , 1999 .

[17]  Yves Chiaramella,et al.  A Model for Multimedia Information Retrieval , 1996 .

[18]  Antigone Fernande,et al.  Text Annotation , 2012 .

[19]  James Allan,et al.  Approaches to passage retrieval in full text information systems , 1993, SIGIR.

[21]  Philippe Jean Salembier Clairon,et al.  Analysis of video sequences: table of content and index creation , 1999 .

[22]  Albert Boonstra,et al.  6TH WORLD MULTICONFERENCE ON SYSTEMICS, CYBERNETICS AND INFORMATICS, VOL VIII, PROCEEDINGS , 2002 .

[23]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[24]  Norbert Fuhr,et al.  A probabilistic relational algebra for the integration of information retrieval and database systems , 1997, TOIS.

[25]  E. Frisse Mark,et al.  Searching for information in a hypertext medical handbook , 1988 .

[26]  Ross Wilkinson,et al.  Effective retrieval of structured documents , 1994, SIGIR '94.

[27]  Wayne H. Ward,et al.  Speech recognition , 1997 .

[28]  Mounia Lalmas,et al.  Integrating internet and digital video broadcast data 1 , 1999 .

[29]  Yves Chiaramella,et al.  Browsing and Querying: Two Complementary Approaches for Multimedia Information Retrieval , 1997, Hypertext, Information Retrieval, Multimedia.

[30]  Mounia Lalmas,et al.  A Dempster-Shafer indexing for the focused retrieval of a hierarchically structured document space: Implementation and experiments on a web museum collection , 2000, RIAO.

[31]  Alan F. Smeaton.  Indexing, Browsing, and Searching of Digital Video and Digital Audio Information , 2000, ESSIR.

[32]  Sung-Hyon Myaeng,et al.  A flexible model for retrieval of SGML documents , 1998, SIGIR '98.

[33]  Mounia Lalmas,et al.  Representing and retrieving structured documents using the Dempster-Shafer theory of evidence: modelling and evaluation , 1998, J. Documentation.

[34]  Norbert Fuhr,et al.  HySpirit - A Probabilistic Inference Engine for Hypermedia Retrieval in Large Databases , 1998, EDBT.

[35]  C. J. van Rijsbergen,et al.  A Non-Classical Logic for Information Retrieval , 1997, Comput. J..

[36]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[37]  FuhrNorbert,et al.  A probabilistic relational algebra for the integration of information retrieval and database systems , 1997 .

[38]  A. Favero,et al.  Italy , 1996, The Lancet.

[39]  David Schach,et al.  XML Query Language (XQL) , 1998, QL.

[40]  Shih-Fu Chang,et al.  MPEG-7 MDS Content Description Tools and Applications , 2001, CAIP.

[41]  J. Kellett.  London , 1914, The Hospital.

[42]  Alexander G. Hauptmann,et al.  Speech recognition in the Informedia Digital Video Library: uses and limitations , 1995, Proceedings of 7th IEEE International Conference on Tools with Artificial Intelligence.

[43]  Guido Moerkotte,et al.  Querying documents in object databases , 1997, International Journal on Digital Libraries.

[44]  C. M. Sperberg-McQueen,et al.  eXtensible Markup Language (XML) 1.0 (Second Edition) , 2000 .

[45]  Ronald Fagin,et al.  Reasoning about knowledge , 1995 .