Content based video retrieval systems

With the development of multimedia data types and available bandwidth there is huge demand of video retrieval systems, as users shift from text based retrieval systems to content based retrieval systems. Selection of extracted features play an important role in content based video retrieval regardless of video attributes being under consideration. These features are intended for selecting, indexing and ranking according to their potential interest to the user. Good features selection also allows the time and space costs of the retrieval process to be reduced. This survey reviews the interesting features that can be extracted from video data for indexing and retrieval along with similarity measurement methods. We also identify present research issues in area of content based video retrieval systems.

[1]  Louis G. Vuurpijl,et al.  Design guidelines for a Content-Based Image Retrieval color-selection interface , 2004 .

[2]  Ehud Rivlin,et al.  Understanding Video Events: A Survey of Methods for Automatic Interpretation of Semantic Occurrences in Video , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Maneesh Kumar Singh,et al.  State-of-the-art on spatio-temporal information-based video retrieval , 2009, Pattern Recognit..

[4]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[5]  Rong Yan,et al.  A review of text and image retrieval approaches for broadcast news video , 2007, Information Retrieval.

[6]  Liu Huayong Content-Based TV Sports Video Retrieval Based on Audio-Visual Features and Text Information , 2004 .

[7]  Ling Guan,et al.  Automatic relevance feedback for video retrieval , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[8]  Jhing-Fa Wang,et al.  Efficient news video querying and browsing based on distributed news video servers , 2006, IEEE Trans. Multim..

[9]  G. Stylios,et al.  An intelligent algorithm for automatic document summarization , 2003, International Conference on Natural Language Processing and Knowledge Engineering, 2003. Proceedings. 2003.

[10]  Georges Quénot,et al.  CLIPS at TRECVID : Shot Boundary Detection and Feature Detection , 2003, TRECVID.

[11]  Qingming Huang,et al.  JDL at TRECVID 2006 Shot Boundary Detection , 2006, TRECVID.

[12]  Tie-Yan Liu,et al.  Shot reconstruction degree: a novel criterion for key frame selection , 2004, Pattern Recognit. Lett..

[13]  Keiji Yanai,et al.  Finding visual concepts by web image mining , 2006, WWW '06.

[14]  Rainer Lienhart,et al.  The Holy Grail of Multimedia Information Retrieval: So Close or Yet So Far Away? , 2008 .

[15]  De Xu,et al.  Hierarchical Video Summarization Based on Video Structure and Highlight , 2006, SSPR/SPR.

[16]  Ramesh C. Jain,et al.  EventWeb: Developing a Human-Centered Computing System , 2008, Computer.

[17]  Guizhong Liu,et al.  A Multiple Visual Models Based Perceptive Analysis Framework for Multilevel Video Summarization , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Shih-Fu Chang,et al.  Generative, discriminative, and ensemble learning on multi-modal perceptual fusion toward news video story segmentation , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[19]  Rama Chellappa,et al.  From Videos to Verbs: Mining Videos for Activities using a Cascade of Dynamical Systems , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Marcel Worring,et al.  Adding Semantics to Detectors for Video Retrieval , 2007, IEEE Transactions on Multimedia.

[21]  Duy-Dinh Le,et al.  Face Retrieval in Broadcasting News Video by Fusing Temporal and Intensity Information , 2006, CIVR.

[22]  Lexing Xie,et al.  Event Mining in Multimedia Streams , 2008, Proceedings of the IEEE.

[23]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[24]  Kin-Man Lam,et al.  A new key frame representation for video segment retrieval , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Paul Over,et al.  Video shot boundary detection: Seven years of TRECVid activity , 2010, Comput. Vis. Image Underst..

[26]  Mubarak Shah,et al.  Detection and representation of scenes in videos , 2005, IEEE Transactions on Multimedia.

[27]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[28]  Andreas Girgensohn,et al.  Time-Constrained Keyframe Selection Technique , 2004, Multimedia Tools and Applications.

[29]  Shih-Fu Chang,et al.  Automatic discovery of query-class-dependent models for multimodal search , 2005, MULTIMEDIA '05.

[30]  Meng Wang,et al.  Manifold-ranking based video concept detection on large database and feature pool , 2006, MM '06.

[31]  Ting Liu,et al.  Video Segmentation via Temporal Pattern Classification , 2007, IEEE Transactions on Multimedia.

[32]  Thorsten Joachims,et al.  Optimizing search engines using clickthrough data , 2002, KDD.

[33]  David S. Doermann,et al.  Video retrieval of near-duplicates using κ-nearest neighbor retrieval of spatio-temporal descriptors , 2006, Multimedia Tools and Applications.

[34]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[35]  David C. Gibbon,et al.  Brief and high-interest video summary generation: evaluating the AT&T labs rushes summarizations , 2008, TVS '08.

[36]  Wen-Nung Lie,et al.  Content-based video retrieval based on object motion trajectory , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[37]  Rong Yan,et al.  Negative pseudo-relevance feedback in content-based video retrieval , 2003, MULTIMEDIA '03.

[38]  R. Lienhart A system for effortless content annotation to unfold the semantics in videos , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[39]  Liang-Hua Chen,et al.  Movie scene segmentation using background information , 2008, Pattern Recognit..

[40]  Li Huan,et al.  A General Method for Shot Boundary Detection , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[41]  Shih-Fu Chang,et al.  A Framework for Sub-Window Shot Detection , 2005, 11th International Multimedia Modelling Conference.

[42]  Tao Mei,et al.  EMS: Energy Minimization Based Video Scene Segmentation , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[43]  Liang Bai,et al.  Video shot boundary detection using Petri-Net , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[44]  Rong Yan,et al.  Co-training non-robust classifiers for video semantic concept detection , 2005, IEEE International Conference on Image Processing 2005.

[45]  Frédéric Béchet,et al.  Local and global models for spontaneous speech segment detection and characterization , 2009, 2009 IEEE Workshop on Automatic Speech Recognition & Understanding.

[46]  Paul Over,et al.  The trecvid 2007 BBC rushes summarization evaluation pilot , 2007, TVS '07.

[47]  Ryutarou Ohbuchi,et al.  Unsupervised learning from a corpus for shape-based 3D model retrieval , 2006, MIR '06.

[48]  Tao Mei,et al.  Correlative multi-label video annotation , 2007, ACM Multimedia.

[49]  Anil K. Jain,et al.  3D model-assisted face recognition in video , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[50]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[51]  Shiqiang Yang,et al.  An HMM-based framework for video semantic analysis , 2005, IEEE Trans. Circuits Syst. Video Technol..

[52]  Wesley De Neve,et al.  A compressed-domain approach for shot boundary detection on H.264/AVC bit streams , 2008, Signal Process. Image Commun..

[53]  Chia-Wen Lin,et al.  Fast video retrieval via the statistics of motion , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[54]  Ramesh Jain,et al.  Toward a Common Event Model for Multimedia Applications , 2007, IEEE MultiMedia.

[55]  Wallapak Tavanapong,et al.  Shot clustering techniques for story browsing , 2004, IEEE Transactions on Multimedia.

[56]  Minh-Son Dao,et al.  Video retrieval using video object-trajectory and edge potential function , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[57]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[58]  Frank Hopfgartner,et al.  Video browsing interfaces and applications: a review , 2010 .

[59]  Kebin Jia,et al.  Video Key Frame Extraction Based on Spatial-Temporal Color Distribution , 2008, 2008 International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[60]  Jianping Fan,et al.  Concept-oriented indexing of video databases: toward semantic sensitive retrieval and browsing , 2004, IEEE Transactions on Image Processing.

[61]  Lie Lu,et al.  A generic framework of user attention model and its application in video summarization , 2005, IEEE Trans. Multim..

[62]  Wei-Hao Lin,et al.  Exploring the utility of fast-forward surrogates for bbc rushes , 2008, TVS '08.

[63]  Alberto Del Bimbo,et al.  Automatic video annotation using ontologies extended with visual information , 2005, MULTIMEDIA '05.

[64]  Ankush Mittal,et al.  Automatic content-based retrieval and semantic classification of video content , 2006, International Journal on Digital Libraries.

[65]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[66]  Changsheng Xu,et al.  Semantic Event Extraction from Basketball Games using Multi-Modal Analysis , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[67]  Tao Mei,et al.  Modeling and Mining of Users' Capture Intention for Home Videos , 2007, IEEE Transactions on Multimedia.

[68]  Cordelia Schmid,et al.  Learning realistic human actions from movies , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[69]  Marcel Worring,et al.  Building a visual ontology for video retrieval , 2005, MULTIMEDIA '05.

[70]  Mohan S. Kankanhalli,et al.  Application Potential of Multimedia Information Retrieval , 2008, Proceedings of the IEEE.

[71]  Stuart Harvey Rubin,et al.  A Human-Centered Multiple Instance Learning Framework for Semantic Video Retrieval , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[72]  Chong-Wah Ngo,et al.  Motion-Based Video Representation for Scene Change Detection , 2004, International Journal of Computer Vision.

[73]  John R. Smith,et al.  IBM Research TRECVID-2009 Video Retrieval System , 2009, TRECVID.

[74]  Berna Erol,et al.  Multimedia thumbnails for documents , 2006, MM '06.

[75]  Paul Browne Video information retrieval using objects and ostensive relevance feedback , 2004, SAC '04.

[76]  Songyang Lao,et al.  A News Video Mining Method Based on Statistical Analysis and Visualization , 2004, CIVR.

[77]  Tiecheng Liu,et al.  Summarization of Visual Content in Instructional Videos , 2007, IEEE Transactions on Multimedia.

[78]  Rong Yan,et al.  Semi-supervised cross feature learning for semantic concept detection in videos , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[79]  Janko Calic,et al.  Spatial analysis in key-frame extraction using video segmentation , 2004 .

[80]  Nathalie Guyader,et al.  Video Summarization Based on Camera Motion and a Subjective Evaluation Method , 2007, EURASIP J. Image Video Process..

[81]  Alan Hanjalic,et al.  Affective video content representation and modeling , 2005, IEEE Transactions on Multimedia.

[82]  Umer Rashid,et al.  M3L: Architecture for Multimedia Information Retrieval , 2009, 2009 Sixth International Conference on Information Technology: New Generations.

[83]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[84]  Guoliang Fan,et al.  Joint Key-Frame Extraction and Object Segmentation for Content-Based Video Analysis , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[85]  S. Aksoy,et al.  A Relevance Feedback Technique for Multimodal Retrieval of News Videos , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[86]  Thomas S. Huang,et al.  Constructing table-of-content for videos , 1999, Multimedia Systems.

[87]  Marcin Grzegorzek,et al.  Shot boundary detection using spectral clustering , 2007, 2007 15th European Signal Processing Conference.

[88]  Bernd Freisleben,et al.  Semi-supervised learning for semantic video retrieval , 2007, CIVR '07.

[89]  Charles A. Bouman,et al.  ViBE: a compressed video database structured for active browsing and search , 2004, IEEE Transactions on Multimedia.

[90]  Marcel Worring,et al.  The Semantic Pathfinder: Using an Authoring Metaphor for Generic Multimedia Indexing , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[91]  Masaharu Ogawa,et al.  A highlight scene detection and video summarization system using audio feature for a personal video recorder , 2005, IEEE Transactions on Consumer Electronics.

[92]  Meng Wang,et al.  Efficient semantic annotation method for indexing large personal video database , 2006, MIR '06.

[93]  Shih-Fu Chang,et al.  Algorithms and system for segmentation and structure analysis in soccer video , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[94]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[95]  Lisa M. Brown,et al.  S3: The IBM Smart Surveillance System: From Transactional Systems to Observational Systems , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[96]  Peter J. L. van Beek,et al.  Detection of slow-motion replay segments in sports video for highlights generation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[97]  Meng Wang,et al.  Semi-automatic video annotation based on active learning with multiple complementary predictors , 2005, MIR '05.

[98]  G. Camara-Chavez,et al.  Shot Boundary Detection by a Hierarchical Supervised Approach , 2007, 2007 14th International Workshop on Systems, Signals and Image Processing and 6th EURASIP Conference focused on Speech and Image Processing, Multimedia Communications and Services.

[99]  Li-Rong Dai,et al.  Video Annotation by Active Learning and Cluster Tuning , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[100]  Evangelos Pallis,et al.  Shot boundary detection without threshold parameters , 2006, J. Electronic Imaging.

[101]  Alan F. Smeaton Techniques used and open challenges to the analysis, indexing and retrieval of digital video , 2007, Inf. Syst..

[102]  Rong Yan,et al.  Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study With Broadcast News , 2007, IEEE Transactions on Multimedia.

[103]  Shih-Fu Chang,et al.  Motion trajectory matching of video objects , 1999, Electronic Imaging.

[104]  Michael G. Christel,et al.  Mining Novice User Activity with TRECVID Interactive Retrieval Tasks , 2006, CIVR.

[105]  Qi Tian,et al.  Multilevel video representation with application to keyframe extraction , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[106]  Mubarak Shah,et al.  Video scene segmentation using Markov chain Monte Carlo , 2006, IEEE Transactions on Multimedia.

[107]  Meng Wang,et al.  Automatic video annotation by semi-supervised learning with kernel density estimation , 2006, MM '06.

[108]  Chi-Chun Lo,et al.  Video segmentation using a histogram-based fuzzy c-means clustering algorithm , 2001, Comput. Stand. Interfaces.

[109]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[110]  Alan F. Smeaton,et al.  Video retrieval using dialogue, keyframe similarity and video objects , 2005, IEEE International Conference on Image Processing 2005.

[111]  Keiichiro Hoashi,et al.  SVM-Based Shot Boundary Detection with a Novel Feature , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[112]  Nikolas P. Galatsanos,et al.  Video rushes summarization using spectral clustering and sequence alignment , 2008, TVS '08.

[113]  Brian D. Davison,et al.  Robust document image understanding technologies , 2004, HDP '04.

[114]  Rong Yan,et al.  Probabilistic latent query analysis for combining multiple retrieval sources , 2006, SIGIR.

[115]  In-So Kweon,et al.  Scalable temporal interest points for abstraction and classification of video events , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[116]  Yue Gao,et al.  A video summarization tool using two-level redundancy detection for personal video recorders , 2008, IEEE Transactions on Consumer Electronics.

[117]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[118]  Qingning Zeng,et al.  Shot Boundary Detection Based on Difference Sequences of Mutual Information , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[119]  Frank Hopfgartner,et al.  Simulated Testing of an Adaptive Multimedia Information Retrieval System , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[120]  Anindya Sarkar,et al.  Feature fusion and redundancy pruning for rush video summarization , 2007, TVS '07.

[121]  Raimondo Schettini,et al.  Erratum to: An innovative algorithm for key frame extraction in video summarization , 2006, Journal of Real-Time Image Processing.

[122]  Lide Wu,et al.  Key frame extraction using inter-shot information , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[123]  HongJiang Zhang,et al.  Motion texture: a new motion based video representation , 2002, Object recognition supported by user interaction for service robots.

[124]  Xiangyang Xue,et al.  Shot boundary detection using unsupervised clustering and hypothesis testing , 2004, 2004 International Conference on Communications, Circuits and Systems (IEEE Cat. No.04EX914).

[125]  Zygmunt Pizlo,et al.  Automated video program summarization using speech transcripts , 2006, IEEE Transactions on Multimedia.

[126]  Xian-Sheng Hua,et al.  To learn representativeness of video frames , 2005, MULTIMEDIA '05.

[127]  Ajay Divakaran,et al.  Broadcast Video Program Summarization using Face Tracks , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[128]  Steven C. H. Hoi,et al.  Chinese University of Hong Kong at TRECVID 2006: Shot Boundary Detection and Video Search , 2006, TRECVID.

[129]  Min Chen,et al.  Video Semantic Event/Concept Detection Using a Subspace-Based Multimedia Data Mining Framework , 2008, IEEE Transactions on Multimedia.

[130]  Dipti Prasad Mukherjee,et al.  Key Frame Estimation in Video Using Randomness Measure of Feature Point Pattern , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[131]  Ming-Syan Chen,et al.  Association and Temporal Rule Mining for Post-Filtering of Semantic Concept Detection in Video , 2008, IEEE Transactions on Multimedia.

[132]  Xinbo Gao,et al.  A Video Shot Boundary Detection Algorithm Based on Feature Tracking , 2006, RSKT.

[133]  Tobun Dorbin Ng,et al.  Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video , 2003, TRECVID.

[134]  Shih-Fu Chang,et al.  Video scene segmentation using video and audio features , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[135]  Bo Zhang,et al.  An online-optimized incremental learning framework for video semantic classification , 2004, MULTIMEDIA '04.

[136]  Wei-Ying Ma,et al.  Recent Advances and Challenges of Semantic Image/Video Search , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[137]  Xian-Sheng Hua,et al.  Multi-modality web video categorization , 2007, MIR '07.

[138]  Chong-Wah Ngo,et al.  A robust dissolve detector by support vector machine , 2003, ACM Multimedia.

[139]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[140]  Alberto Del Bimbo,et al.  Content-based retrieval of 3D models , 2006, TOMCCAP.

[141]  Shih-Fu Chang,et al.  Structure analysis of soccer video with domain knowledge and hidden Markov models , 2004, Pattern Recognit. Lett..

[142]  Jiebo Luo,et al.  Utilizing semantic word similarity measures for video retrieval , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[143]  Fernando Pereira,et al.  Automatic video summarization based on MPEG-7 descriptions , 2004, Signal Process. Image Commun..

[144]  Pong C. Yuen,et al.  Shot Boundary Detection: An Information Saliency Approach , 2008, 2008 Congress on Image and Signal Processing.

[145]  Xiaoqin Zhang,et al.  Trajectory-Based Video Retrieval Using Dirichlet Process Mixture Models , 2008, BMVC.

[146]  Michael Roe,et al.  Scanning electronic documents for personally identifiable information , 2006, WPES '06.

[147]  Yap-Peng Tan,et al.  Model-based clustering and analysis of video scenes , 2002, Proceedings. International Conference on Image Processing.

[148]  John R. Smith,et al.  On the detection of semantic concepts at TRECVID , 2004, MULTIMEDIA '04.

[149]  Michael C. Burl,et al.  Mining Patters of Activity from Video Data , 2004, SDM.

[150]  Yo-Sung Ho,et al.  Content-based event retrieval using semantic scene interpretation for automated traffic surveillance , 2001, IEEE Trans. Intell. Transp. Syst..

[151]  Neill W. Campbell,et al.  Visual abstraction of wildlife footage using Gaussian mixture models and the minimum description length criterion , 2002, Object recognition supported by user interaction for service robots.

[152]  Regunathan Radhakrishnan,et al.  Motion activity-based extraction of key-frames from video shots , 2002, Proceedings. International Conference on Image Processing.

[153]  Bo Zhang,et al.  Learning concepts from large scale imbalanced data sets using support cluster machines , 2006, MM '06.

[154]  Rong Yan,et al.  Learning query-class dependent weights in automatic video retrieval , 2004, MULTIMEDIA '04.

[155]  Changsheng Xu,et al.  Automatic mobile sports highlights , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[156]  Mubarak Shah,et al.  Scene detection in Hollywood movies and TV shows , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[157]  Fei Wu,et al.  Automatic Video Summarization by Affinity Propagation Clustering and Semantic Content Mining , 2008, 2008 International Symposium on Electronic Commerce and Security.

[158]  Vagelis Hristidis,et al.  A system for query-specific document summarization , 2006, CIKM '06.

[159]  Rong Yan,et al.  Video Retrieval Based on Semantic Concepts , 2008, Proceedings of the IEEE.

[160]  Ramesh Jain,et al.  Hierarchical photo stream segmentation using context , 2008, Electronic Imaging.

[161]  Werner Bailer,et al.  Comparison of content selection methods for skimming rushes video , 2008, TVS '08.

[162]  John R. Smith,et al.  Large-scale concept ontology for multimedia , 2006, IEEE MultiMedia.

[163]  Sang Uk Lee,et al.  Efficient video indexing scheme for content-based retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[164]  Tie-Yan Liu,et al.  Dynamic selection and effective compression of key frames for video abstraction , 2003, Pattern Recognit. Lett..

[165]  Andrew Zisserman,et al.  Person Spotting: Video Shot Retrieval for Face Sets , 2005, CIVR.

[166]  Ishwar K. Sethi,et al.  The PERSEUS Project: Creating Personalized Multimedia News Portal , 2001, MDM/KDD.

[167]  Tianming Liu,et al.  A novel video key-frame-extraction algorithm based on perceived motion energy model , 2003, IEEE Trans. Circuits Syst. Video Technol..

[168]  Ba Tu Truong,et al.  Scene extraction in motion pictures , 2003, IEEE Trans. Circuits Syst. Video Technol..

[169]  Santanu Chaudhury,et al.  Learning ontology for personalized video retrieval , 2007, MS '07.

[170]  Jun-Wei Hsieh,et al.  Motion-based video retrieval by trajectory matching , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[171]  Johan Montagnat,et al.  Texture based medical image indexing and retrieval: application to cardiac imaging , 2004, MIR '04.

[172]  Li Guo-hui,et al.  Video Mining:A Survey , 2006 .

[173]  Katsumi Tanaka,et al.  Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces , 2002, VDB.

[174]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[175]  Qi Tian,et al.  Semantic retrieval of video - review of research on video retrieval in meetings, movies and broadcast news, and sports , 2006, IEEE Signal Processing Magazine.

[176]  Michael G. Christel,et al.  Exploiting multiple modalities for interactive video retrieval , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[177]  Marcel Worring,et al.  The Mediamill Semantic Video Search Engine , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[178]  Nicu Sebe,et al.  Object Recognition for Video Retrieval , 2002, CIVR.

[179]  Liang-Hua Chen,et al.  An Integrated Approach to Video Retrieval , 2008, ADC.

[180]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[181]  Changick Kim,et al.  Object-based video abstraction using cluster analysis , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[182]  Hisashi Miyamori,et al.  Video annotation for content-based retrieval using human behavior analysis and domain knowledge , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[183]  Meng Wang,et al.  Correlative Linear Neighborhood Propagation for Video Annotation , 2009, IEEE Trans. Syst. Man Cybern. Part B.

[184]  Ramesh Jain,et al.  Concept annotation and search space decrement of digital photos using optical context information , 2008, Electronic Imaging.

[185]  Fei Wu,et al.  Automatic Video Summarization by Spatio-temporal Analysis and Non-trivial Repeating Pattern Detection , 2008, 2008 Congress on Image and Signal Processing.

[186]  Changsheng Xu,et al.  A Novel Framework for Semantic Annotation and Personalized Retrieval of Sports Video , 2008, IEEE Transactions on Multimedia.

[187]  George Economou,et al.  Key frame extraction in video sequences: a vantage points approach , 2007, 2007 IEEE 9th Workshop on Multimedia Signal Processing.

[188]  Tao Mei,et al.  Automatic Video Genre Categorization using Hierarchical SVM , 2006, 2006 International Conference on Image Processing.

[189]  Mei Han,et al.  Extract highlights from baseball game video with hidden Markov models , 2002, Proceedings. International Conference on Image Processing.

[190]  Li-Rong Dai,et al.  Video Annotation by Active Learning and Semi-Supervised Ensembling , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[191]  Seong-Yoon Shin,et al.  Video Shot Boundary Detection Algorithm , 2006, ICVGIP.

[192]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[193]  Jin Zhao,et al.  Video Retrieval Using High Level Features: Exploiting Query Matching and Confidence-Based Weighting , 2006, CIVR.

[194]  Alan F. Smeaton,et al.  Using video objects and relevance feedback in video retrieval , 2005, SPIE Optics East.

[195]  Ramesh C. Jain,et al.  Towards an ecosystem for semantics , 2007, MS '07.

[196]  Aggelos K. Katsaggelos,et al.  MINMAX optimal video summarization , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[197]  Bin Liu,et al.  MedSMan: a live multimedia stream querying system , 2008, Multimedia Tools and Applications.

[198]  David Doermann,et al.  Video indexing and retrieval based on recognized text , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..