SHIATSU: tagging and retrieving videos without worries

The dramatic growth of video content over modern media channels (such as the Internet and mobile phone platforms) directs the interest of media broadcasters towards the topics of video retrieval and content browsing. Several video retrieval systems benefit from the use of semantic indexing based on content, since it allows an intuitive categorization of videos. However, indexing is usually performed through manual annotation, thus introducing potential problems such as ambiguity, lack of information, and non-relevance of index terms. In this paper, we present SHIATSU, a complete system for video retrieval which is based on the (semi-)automatic hierarchical semantic annotation of videos exploiting the analysis of visual content; videos can then be searched by means of attached tags and/or visual features. We experimentally evaluate the performance of SHIATSU on two different real video benchmarks, proving its accuracy and efficiency.

[1]  Tudor Barbu,et al.  Novel automatic video cut detection technique using Gabor filtering , 2009, Comput. Electr. Eng..

[2]  Kuo-Chin Fan,et al.  Motion Flow-Based Video Retrieval , 2007, IEEE Transactions on Multimedia.

[3]  T. N. SHANMUGAM,et al.  AN ENHANCED CONTENT-BASED VIDEO RETRIEVAL SYSTEM BASED ON QUERY CLIP , 2010 .

[4]  Rong Yan,et al.  Can High-Level Concepts Fill the Semantic Gap in Video Retrieval? A Case Study With Broadcast News , 2007, IEEE Transactions on Multimedia.

[5]  Ilaria Bartolini,et al.  Imagination : Accurate Image Annotation Using Link-analysis Techniques ? , 2007 .

[6]  James Ze Wang,et al.  Toward Bridging the Annotation-Retrieval Gap in Image Search , 2007, IEEE MultiMedia.

[7]  Ilaria Bartolini,et al.  Imagination: Exploiting Link Analysis for Accurate Image Annotation , 2007, Adaptive Multimedia Retrieval.

[8]  Yan Liu,et al.  Semantic Extraction and Semantics-Based Annotation and Retrieval for Video Databases , 2004, Multimedia Tools and Applications.

[9]  Vasumathi Narayanan,et al.  A Survey of Content-Based Video Retrieval , 2008 .

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  B. S. Manjunath,et al.  Global annotation on georeferenced photographs , 2009, CIVR '09.

[12]  Shang-Hong Lai,et al.  Learning-Based Interactive Video Retrieval System , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Huan Zhao,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2009 .

[15]  Otthein Herzog,et al.  Automatic Shot Boundary Detection Combining Color, Edge, and Motion Features of Adjacent Frames , 2004, TRECVID.

[16]  Hanan Samet,et al.  Index-driven similarity search in metric spaces (Survey Article) , 2003, TODS.

[17]  Sameer Antani,et al.  An Evaluation of Color Histogram Based Methods in Video Indexing , 2007 .

[18]  Roberto Navigli,et al.  Word sense disambiguation: A survey , 2009, CSUR.

[19]  Pavel Zezula,et al.  Visual video retrieval system using MPEG-7 descriptors , 2010, SISAP.

[20]  Bo Zhang,et al.  A Robust Clustering Algorithm for Video Shots Using Haar Wavelet Transformation , 2007 .

[21]  Ronald Fagin,et al.  Multi-structural databases , 2005, PODS '05.

[22]  Ilaria Bartolini,et al.  Query processing issues in region-based image databases , 2010, Knowledge and Information Systems.

[23]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Latifur Khan,et al.  Automatic image annotation and retrieval using weighted feature selection , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[25]  Alex Rodriguez,et al.  VITALAS at TRECVID-2009 , 2009, TRECVID.

[26]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[27]  Nuno Vasconcelos,et al.  Bridging the Gap: Query by Semantic Example , 2007, IEEE Transactions on Multimedia.

[28]  Ilaria Bartolini,et al.  Windsurf: region-based image retrieval using wavelets , 1999, Proceedings. Tenth International Workshop on Database and Expert Systems Applications. DEXA 99.

[29]  Ilaria Bartolini,et al.  Shiatsu: semantic-based hierarchical automatic tagging of videos by segmentation using cuts , 2010, AIEMPro '10.

[30]  Marti A. Hearst Clustering versus faceted categories for information exploration , 2006, Commun. ACM.

[31]  Rong Yan,et al.  Video Retrieval Based on Semantic Concepts , 2008, Proceedings of the IEEE.

[32]  Ilaria Bartolini A Multi-faceted Browsing Interface for Digital Photo Collections , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[33]  Janko Calic,et al.  A rule-based video annotation system , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[35]  Latifur Khan,et al.  Image annotations by combining multiple evidence & wordNet , 2005, ACM Multimedia.

[36]  Chong-Wah Ngo,et al.  VIREO/DVMM at TRECVID 2009: High-Level Feature Extraction, Automatic Video Search, and Content-Based Copy Detection , 2009, TRECVID.

[37]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[38]  David C. Gibbon,et al.  AT&T Research at 2007 , 2007, TRECVID.

[39]  Nuno Vasconcelos,et al.  Query by Semantic Example , 2006, CIVR.

[40]  Nikolas P. Galatsanos,et al.  Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines , 2009, Pattern Recognit. Lett..

[41]  Ying Liu,et al.  A method of shot detection based on color and edge features , 2009, 2009 1st IEEE Symposium on Web Society.

[42]  Panagiotis G. Ipeirotis,et al.  Automatic construction of multifaceted browsing interfaces , 2005, CIKM '05.

[43]  Pavel Zezula,et al.  M-tree: An Efficient Access Method for Similarity Search in Metric Spaces , 1997, VLDB.