Building a Large Annotation Ontology for Movie Video Retrieval

Multimedia content continues to grow rapidly. To ensure access to growing video collections, semantic indexing of images and videos has become a very important issue for data access, retrieval and actual application. For developing and evaluating semantic concepts searching annotation techniques, it is necessary to predefine a large lexicon, construction of a large benchmark data set, and annotation of videos in a rigorous fashion. In this paper we developed a method of movie's video benchmark data set, which includes (1) design of structure of movie semantic annotation ontology, (2) definition of lexicons and concepts that accommodate consumers' needs, and (3) building semantic relations among lexicons and concepts. To our knowledge, this is the first systematic work in the movie domain aimed at the definition of a large lexicon, construction of a large benchmark data set, and annotation of videos in a rigorous fashion. We test performance of the ontology on movie's video, and experiments demonstrate that our method is capable of annotation for movie's video.

[1]  Hong Heather Yu,et al.  A Hierarchical Multiresolution Video Shot Transition Detection Scheme , 1999, Comput. Vis. Image Underst..

[2]  Shih-Fu Chang,et al.  A fully automated content-based video search engine supporting spatiotemporal queries , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  Lexing Xie,et al.  Event Mining in Multimedia Streams , 2008, Proceedings of the IEEE.

[4]  Nenghai Yu,et al.  Semantics-Preserving Bag-of-Words Models and Applications , 2010, IEEE Transactions on Image Processing.

[5]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Marcel Worring,et al.  Building a visual ontology for video retrieval , 2005, MULTIMEDIA '05.

[7]  Wei Li,et al.  A Divide-And-Rule Scheme For Shot Boundary Detection Based on SIFT , 2010, J. Digit. Content Technol. its Appl..

[8]  Chong-Wah Ngo,et al.  Domain adaptive semantic diffusion for large scale context-based video annotation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[9]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[10]  Marcel Worring,et al.  Adding Semantics to Detectors for Video Retrieval , 2007, IEEE Transactions on Multimedia.

[11]  Joshua R. Smith,et al.  A Web-based System for Collaborative Annotation of Large Image and Video Collections , 2005 .

[12]  Jiebo Luo,et al.  Kodak consumer video benchmark data set : concept definition and annotation * * , 2008 .

[13]  Rong Yan,et al.  Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study With Broadcast News , 2007, IEEE Transactions on Multimedia.