Overview of ImageCLEFlifelog 2017: Lifelog Retrieval and Summarization

Despite the increasing number of successful related work- shops and panels, lifelogging has rarely been the subject of a rigorous comparative benchmarking exercise. Following the success of the new lifelog evaluation task at NTCIR-12, the first ImageCLEF 2017 LifeLog task aims to bring the attention of lifelogging to a wide audience and to promote research into some of the key challenges of the coming years. The ImageCLEF 2017 LifeLog task aims to be a comparative evaluation framework for information access and retrieval systems operating over personal lifelog data. Two subtasks were available to participants; all tasks use a single mixed modality data source from three lifeloggers for a period of about one month each. The data contains a large collection of wearable camera images, an XML description of the semantic locations, as well as the physical activities of the lifeloggers. Additional visual concept information was also provided by exploiting the Caffe CNN-based visual concept detector. For the two sub-tasks, 51 topics were chosen based on the real interests of the lifeloggers. In this first year three groups participated in the task, submitting 19 runs across all subtasks, and all participants also provided working notes papers. In general, the groups performance is very good across the tasks, and there are interesting insights into these very relevant challenges.

[1]  Bart Thomee,et al.  Overview of the ImageCLEF 2012 Flickr Photo Annotation and Retrieval Task , 2012, CLEF.

[2]  Roberto Paredes,et al.  Overview of the ImageCLEF 2016 Scalable Concept Image Annotation Task , 2016, CLEF.

[3]  Bogdan Ionescu,et al.  A Textual Filtering of HOG-Based Hierarchical Clustering of Lifelog Data , 2017, CLEF.

[4]  Emmanuel Dellandréa,et al.  Overview of the ImageCLEF 2015 Scalable Image Annotation, Localization and Sentence Generation task , 2015, CLEF.

[5]  Roberto Paredes,et al.  Overview of the ImageCLEF 2012 Scalable Web Image Annotation Task , 2012, CLEF.

[6]  Michael Riegler,et al.  Overview of ImageCLEF 2017: Information Extraction from Images , 2017, CLEF.

[7]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[8]  Francesco G. B. De Natale,et al.  Multimodal Retrieval with Diversification and Relevance Feedback for Tourist Attraction Images , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[9]  Francesco G. B. De Natale,et al.  A hybrid approach for retrieving diverse social images of landmarks , 2015, 2015 IEEE International Conference on Multimedia and Expo (ICME).

[10]  Vigneshwaran Subbaraju,et al.  VC-I2R@ImageCLEF2017: Ensemble of Deep Learned Features for Lifelog Video Summarization , 2017, CLEF.

[11]  B. Thomee,et al.  Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask , 2013, CLEF.

[12]  Mauricio Villegas Santamaría,et al.  Overview of the ImageCLEF 2014 Scalable Concept Image Annotation Task , 2014 .