Video exploration: from multimedia content analysis to interactive visualization

This paper presents 3 interfaces to access video contents. The stream explorer allows to explore and to segment video streams. The video explorer shows a synthetic view of structured TV programmes. The collection explorer proposes cartographies of large video collections. Based on visual and textual automatic processing, proximities and redundancies are analyzed, allowing the emergence of different levels of structure. This is made possible thanks to the volume of data considered: 7 channels during 100 days, ie 16000 hours or 20 Millions key frames. These three tools allow efficient exploration of video contents at different levels of interest: image, shot and sequence, programme and collection level.

[1]  Andreas Noack,et al.  An Energy Model for Visual Graph Clustering , 2003, GD.

[2]  Marcel Worring,et al.  Lexicon-based Browsers for Searching in News Video Archives , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[3]  Thomas Sikora,et al.  Hierarchical image database browsing environment with embedded relevance feedback , 2002, Proceedings. International Conference on Image Processing.

[4]  Shih-Fu Chang,et al.  Clustering methods for video browsing and annotation , 1996, Electronic Imaging.

[5]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[6]  Marcel Worring,et al.  The Mediamill Semantic Video Search Engine , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[7]  Andreas Noack,et al.  Energy-Based Clustering of Graphs with Nonuniform Degrees , 2005, GD.

[8]  Olivier Buisson,et al.  A posteriori multi-probe locality sensitive hashing , 2008, ACM Multimedia.

[9]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[10]  Riad Hammoud,et al.  Interactive Video: Algorithms and Technologies (Signals and Communication Technology) , 2006 .

[11]  Jenny Benois-Pineau,et al.  DAG-based visual interfaces for navigation in indexed video content , 2006, Multimedia Tools and Applications.

[12]  Laura A. Dabbish,et al.  A multi-view intelligent editor for digital video libraries , 2001, JCDL '01.

[13]  Shingo Uchihashi,et al.  Video Manga: generating semantically meaningful video summaries , 1999, MULTIMEDIA '99.

[14]  Pierangelo Migliorati,et al.  Interactive visualization of video content and associated description for semantic annotation , 2009, Signal Image Video Process..

[15]  David Salesin,et al.  Schematic storyboarding for video visualization and editing , 2006, SIGGRAPH 2006.

[16]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction, 2nd Edition , 2001, Springer Series in Statistics.

[17]  Marcel Worring,et al.  Learned Lexicon-Driven Interactive Video Retrieval , 2006, CIVR.

[18]  Jonathan J. Hull,et al.  A paper-based interface for video browsing and retrieval , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[19]  D. Ruppert.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[20]  Olivier Buisson,et al.  Image collection structuring based on evidential active learner , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[21]  Michael A. Smith,et al.  Video skimming and characterization through the combination of image and language understanding techniques , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  Sudipto Guha,et al.  ROCK: a robust clustering algorithm for categorical attributes , 1999, Proceedings 15th International Conference on Data Engineering (Cat. No.99CB36337).