Large-scale video retrieval via semantic classification

Motivated by Google's great success on text document retrieval and recent progresses of semantic video understanding, researchers begin to build new generation of video retrieval systems that are able to support semantic sensitive video retrieval via keywords. Unfortunately, these systems are not able to provide satisfactory results for the masses because of several inter-related challenging problems. We have proposed novel algorithms to resolve some of these problems. Firstly, the salient object based semantic classification algorithm is proposed to extract semantic concepts of video clips. Secondly, the video visualization based interactive retrieval framework is proposed to help users input semantic and visual queries efficiently and effectively. Finally, the concept-oriented skimming algorithm is proposed to help users efficiently check search results.

[1]  Jianping Fan,et al.  Concept-oriented video skimming and adaptation via semantic classification , 2004, MIR '04.

[2]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[3]  Jianping Fan,et al.  Concept-oriented indexing of video databases: toward semantic sensitive retrieval and browsing , 2004, IEEE Transactions on Image Processing.

[4]  Jianping Fan,et al.  Exploring Large-Scale Video News via Interactive Visualization , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[5]  Milind R. Naphade,et al.  A probabilistic framework for semantic video indexing, filtering, and retrieval , 2001, IEEE Trans. Multim..

[6]  Rainer Lienhart,et al.  Automatic classification of images on the Web , 2001, IS&T/SPIE Electronic Imaging.

[7]  Jianping Fan,et al.  Learning the semantics of images by using unlabeled samples , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Jianping Fan,et al.  Concept-oriented video skimming via semantic video classification , 2004, MULTIMEDIA '04.

[9]  Edward Y. Chang,et al.  Confidence-based dynamic ensemble for image annotation and semantics discovery , 2003, MULTIMEDIA '03.