Interactive components for visual exploration of multimedia archives

With the increase of online resources, one main challenge for multimedia content providers is to provide efficient and user friendly tools for a deep and shallow navigation adapted to large scale audiovisual content. This paper describes a generic framework to build visual interactive applications the objectives of which are to enhance the understanding and to allow easy access to multimedia resources and management. Visual Maps are built on multi-modal similarity matrices computed from automatically extracted descriptors and use graph clustering and layout methods. Active relevance feedback methods are applied to allow users to control the maps evolution according to their needs. The First results of users' evaluation are presented for one of our tools.

[1]  Olivier Buisson,et al.  Content-Based Copy Retrieval Using Distortion-Based Probabilistic Similarity Search , 2007, IEEE Transactions on Multimedia.

[2]  Denis Pellerin,et al.  Interactive Visualization Tool with Graphic Table of Video Contents , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[3]  Larson,et al.  Supporting radio archive workflows with vocabulary independent spoken keyword search , 2007 .

[4]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[5]  Brian Shackel,et al.  Human factors for informatics usability , 1991 .

[6]  Olivier Buisson,et al.  Feature statistical retrieval applied to content based copy identification , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[7]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[8]  Andreas Noack,et al.  An Energy Model for Visual Graph Clustering , 2003, GD.

[9]  Olivier Buisson,et al.  Image collection structuring based on evidential active learner , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[10]  Olivier Buisson,et al.  Z-grid-based probabilistic retrieval for scaling up content-based copy detection , 2007, CIVR '07.

[11]  Andreas Noack,et al.  Energy-Based Clustering of Graphs with Nonuniform Degrees , 2005, GD.

[12]  Olivier Buisson,et al.  Robust voting algorithm based on labels of behavior for video copy detection , 2006, MM '06.

[13]  N. Boujemaa.  IKONA: INTERACTIVE SPECIFIC AND GENERIC IMAGE RETRIEVAL , 2003 .

[14]  Ben Shneiderman,et al.  Designing the user interface - strategies for effective human-computer interaction, 2nd Edition , 1992 .

[15]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[16]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[17]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[18]  Nozha Boujemaa,et al.  Fuzzy Clustering with Pairwise Constraints for Knowledge-Driven Image Categorization , 2004, EWIMT.