LIG-MRIM at NTCIR-12 Lifelog Semantic Access Task

This paper describes the participation of the LIG-MRIM research team to the Lifelog Semantic Access sub-task of the NTCIR-12 (2016). Our approach mainly relies on mapping the query terms to visual concepts computed on the Lifel-ogs images according to two separated learning schemes. A post-processing is then performed if the topic is related to temporal, location or activity information associated with the images. The results obtained are promising for a first participation to such a task, with event-based MAP above 29% and an event-based nDCG value close to 39%. Team Name MRIM Subtasks Lifelog Semantic Access Task

[1]  Georges Quénot,et al.  TRECVID 2015 - An Overview of the Goals, Tasks, Data, Evaluation Mechanisms and Metrics , 2011, TRECVID.

[2]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Omer Levy,et al.  word2vec Explained: deriving Mikolov et al.'s negative-sampling word-embedding method , 2014, ArXiv.

[5]  Georges Quénot,et al.  A factorized model for multiple SVM and multi-label classification for large scale multimedia indexing , 2015, 2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI).

[6]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[7]  Georges Quénot,et al.  Descriptor optimization for multimedia indexing and retrieval , 2013, Multimedia Tools and Applications.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  Rami Albatal,et al.  NTCIR Lifelog: The First Test Collection for Lifelog Research , 2016, SIGIR.

[10]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[11]  Philipp Scholl,et al.  Adaptivity , 2011, IATEL - Interdisciplinary Approaches to Technology-enhanced Learning.

[12]  Proceedings of the 12th NTCIR Conference on Evaluation of Information Access Technologies, National Center of Sciences, Tokyo, Japan, June 7-10, 2016 , 2016, NTCIR.