MULTIMEDIACYCLE: CONSOLIDATING THE HYFORGE FRAMEWORK TOWARDS IMPROVED SCALABILITY AND USABILITY

The aim of this project is to explore new user interfaces and data organization for database navigation within the MediaCycle software. Both issues are deeply interconnected since the database display depends on the internal data organization and vice-versa, the data organization has to be chosen to allow useful and meaningful displays as well as intuitive navigation. Because each data type or application might require a specific visualization, we expanded the plugin architecture of MediaCycle to facilitate the testing of various prototypes. Two types of practical applications have been considered: query by similarity and database exploration. We present here a new browsing interface that combines both types, as well as some tests of external controllers (3D mouse, trackpad, . . . ) that can potentially enhance the navigation process.

[1]  Ruofei Zhang,et al.  Multimedia Data Mining: A Systematic Introduction to Concepts and Theory , 2008 .

[2]  Hans-Christoph Steiner.  A unified toolkit for accessing human interface devices in pure data and Max/MSP , 2007, NIME '07.

[3]  Julius O. Smith,et al.  HSP: A Simple and Effective Open-Source Platform for Implementing Haptic Musical Instruments , 2009, NIME.

[4]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[5]  C. Tomasi.  The Earth Mover's Distance, Multi-Dimensional Scaling, and Color-Based Image Retrieval , 1997 .

[6]  Qi Tian,et al.  Visualization and User-Modeling for Browsing Personal Photo Libraries , 2004, International Journal of Computer Vision.

[7]  Thierry Dutoit,et al.  DeviceCycle: Rapid and Reusable Prototyping of Gestural Interfaces, Applied to Audio Browsing by Similarity , 2010, NIME.

[8]  Simone Santini,et al.  Integrated browsing and querying for image databases , 2000, IEEE MultiMedia.

[9]  Stéphane Dupont,et al.  VIDEO NAVIGATION TOOL: APPLICATION TO BROWSING A DATABASE OF DANCERS' PERFORMANCES , 2009 .

[10]  Nicu Sebe,et al.  CHORUS Deliverable 2.1: State of the Art on Multimedia Search Engines , 2007 .

[11]  Jean Vanderdonckt,et al.  An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components , 2009, EICS '09.

[12]  Thomas Deselaers,et al.  Exploring The Relationship Between Feature and Perceptual Visual Spaces , 2022 .

[13]  Matthias Ehrgott,et al.  Multicriteria Optimization , 2005 .

[14]  Philippe Fortemps,et al.  MEDIACYCLE: BROWSING AND PERFORMING WITH SOUND AND IMAGE LIBRARIES , 2009 .

[15]  Marcel Worring,et al.  Interactive access to large image collections using similarity-based visualization , 2008, J. Vis. Lang. Comput..

[16]  L. Dagum,et al.  OpenMP: an industry standard API for shared-memory programming , 1998 .

[17]  K. Holyoak,et al.  The Cambridge handbook of thinking and reasoning , 2005 .

[18]  Daniel Heesch,et al.  A survey of browsing models for content based image retrieval , 2008, Multimedia Tools and Applications.

[19]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Daniel A. Keim,et al.  Information Visualization and Visual Data Mining , 2002, IEEE Trans. Vis. Comput. Graph..