A multimedia interactive search engine based on graph-based and non-linear multimodal fusion

This paper presents an interactive multimedia search engine, which is capable of searching into multimedia collections by fusing textual and visual information. Apart from multimedia search, the engine is able to perform text search and image retrieval independently using both high-level and low-level information. The images of the multimedia collection are organized by color, offering fast browsing in the image collection.

[1]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Thomas Seidl,et al.  Content-based exploration of multimedia databases , 2013, 2013 11th International Workshop on Content-Based Multimedia Indexing (CBMI).

[3]  Yiannis Kompatsiaris,et al.  VERGE: A Multimodal Interactive Search Engine for Video Browsing and Retrieval , 2016, MMM.

[4]  Yiannis Kompatsiaris,et al.  Retrieval of Multimedia Objects by Fusing Multiple Modalities , 2016, ICMR.

[5]  Heikki Mannila,et al.  Random projection in dimensionality reduction: applications to image and text data , 2001, KDD '01.

[6]  Pablo N. Mendes,et al.  Improving efficiency and accuracy in multilingual entity extraction , 2013, I-SEMANTICS '13.

[7]  Yiannis Kompatsiaris,et al.  A hybrid graph-based and non-linear late fusion approach for multimedia retrieval , 2016, 2016 14th International Workshop on Content-Based Multimedia Indexing (CBMI).

[8]  Jan Lansky,et al.  MLES: Multilayer Exploration Structure for Multimedia Exploration , 2015, ADBIS.

[9]  Yiannis Kompatsiaris,et al.  ITI-CERTH participation to TRECVID 2015 , 2015, TRECVID.

[10]  Gabriela Csurka,et al.  Unsupervised Visual and Textual Information Fusion in CBMIR Using Graph-Based Methods , 2015, TOIS.

[11]  Cordelia Schmid,et al.  Aggregating local descriptors into a compact image representation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Panu Somervuo,et al.  Self-organizing maps of symbol strings , 1998, Neurocomputing.

[13]  Kai Uwe Barthel,et al.  ImageMap - Visually Browsing Millions of Images , 2015, MMM.