An Interactive Lifelog Retrieval System for Activities of Daily Living Understanding

This paper describes the participation of the Organizer Team in the ImageCLEFlifelog 2018 Daily Living Understanding and Lifelog Moment Retrieval. In this paper, we propose how to exploit LIFER, an interactive lifelog search engine to solve the two tasks: Lifelog Moment Retrieval and Activities of Daily Living Understanding. We propose approaches for both baseline, which aim to provide a reference system for other approaches, and human-in-the-loop, which advance the baseline results.

[1]  Francesco G. B. De Natale,et al.  Multimodal Retrieval with Diversification and Relevance Feedback for Tourist Attraction Images , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[2]  Dietmar Saupe,et al.  Chaos and fractals - new frontiers of science (2. ed.) , 2004 .

[3]  Duc-Tien Dang-Nguyen,et al.  A Baseline Search Engine for Personal Life Archives , 2017, LTA@MM.

[4]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[5]  Henning Müller,et al.  Datasets column: diversity and credibility for social images and image retrieval , 2018, ACMMR.

[6]  Rami Albatal,et al.  Senseseer mobile-cloud-based Lifelogging framework , 2013, 2013 IEEE International Symposium on Technology and Society (ISTAS): Social Implications of Wearable Computing and Augmediated Reality in Everyday Life.

[7]  Lifeng Sun,et al.  Computer Vision for Lifelogging: Characterizing Everyday Activities Based on Visual Semantics , 2018, CVPR 2018.

[8]  Michael Riegler,et al.  Overview of ImageCLEF 2018: Challenges, Datasets and Evaluation , 2018, CLEF.

[9]  Alan F. Smeaton,et al.  An Examination of a Large Visual Lifelog , 2008, AIRS.

[10]  Alan F. Smeaton,et al.  Using bluetooth and GPS metadata to measure event similarity in SenseCam Images , 2007 .

[11]  Juhan Nam,et al.  Multimodal Deep Learning , 2011, ICML.

[12]  Proceedings of the 2018 ACM Workshop on The Lifelog Search Challenge , 2018, ICMR.

[13]  David J. Crandall,et al.  Deepdiary: Lifelogging image captioning and summarization , 2018, J. Vis. Commun. Image Represent..

[14]  Yong Tang,et al.  Large-scale semantic web image retrieval using bimodal deep learning techniques , 2018, Inf. Sci..

[15]  P. Ganesh Kumar,et al.  Content based image retrieval using deep learning process , 2018, Cluster Computing.

[16]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[17]  Michael Riegler,et al.  Challenges and Opportunities within Personal Life Archives , 2018, ICMR.

[18]  Duc-Tien Dang-Nguyen,et al.  LIFER: An Interactive Lifelog Retrieval System , 2018, LSC@ICMR.

[19]  Geoffrey Zweig,et al.  From captions to visual concepts and back , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.

[21]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2018: Daily Living Understanding and Lifelog Moment Retrieval , 2018, CLEF.

[22]  Jason J. Jung,et al.  Visualizing Multidimensional Lifelogging Data: A Case Study on MyMovieHistory Project , 2018, Cybern. Syst..