[Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018)

The Lifelog Search Challenge (LSC) is an international content retrieval competition that evaluates search for personal lifelog data. At the LSC, content-based search is performed over a multi-modal dataset, continuously recorded by a lifelogger over 27 days, consisting of multimedia content, biometric data, human activity data, and information activities data. In this work, we report on the first LSC that took place in Yokohama, Japan in 2018 as a special workshop at ACM International Conference on Multimedia Retrieval 2018 (ICMR 2018). We describe the general idea of this challenge, summarise the participating search systems as well as the evaluation procedure, and analyse the search performance of the teams in various aspects. We try to identify reasons why some systems performed better than others and provide an outlook as well as open issues for upcoming iterations of the challenge.

[1]  Klaus Schöffmann,et al.  The ITEC Collaborative Video Search System at the Video Browser Showdown 2018 , 2018, MMM.

[2]  Jakub Lokoc,et al.  Using an Interactive Video Retrieval Tool for LifeLog Data , 2018, LSC@ICMR.

[3]  Noel E. O'Connor,et al.  LoggerMan, a Comprehensive Logging and Visualization Tool to Capture Computer Usage , 2016, MMM.

[4]  Vinh-Tiep Nguyen,et al.  Lifelogging Retrieval based on Semantic Concepts Fusion , 2018, LSC@ICMR.

[5]  Rami Albatal,et al.  A Test Collection for Interactive Lifelog Retrieval , 2019, MMM.

[6]  Cathal Gurrin,et al.  An Interactive Lifelog Search Engine for LSC2018 , 2018, LSC@ICMR.

[7]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[8]  Petia Radeva,et al.  LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task , 2016, NTCIR.

[9]  Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017 , 2017, TREC.

[10]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2018: Daily Living Understanding and Lifelog Moment Retrieval , 2018, CLEF.

[11]  George Awad,et al.  On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017 , 2018, IEEE Transactions on Multimedia.

[12]  Steven Simske,et al.  Beyond quantified self: data for wellbeing , 2014, CHI Extended Abstracts.

[13]  Rami Albatal,et al.  Overview of NTCIR-12 Lifelog Task , 2016, NTCIR.

[14]  Rob Kitchin,et al.  ‘Outlines of a World Coming into Existence’: Pervasive Computing and the Ethics of Forgetting , 2007 .

[15]  Michael Riegler,et al.  Overview of ImageCLEF 2018: Challenges, Datasets and Evaluation , 2018, CLEF.

[16]  Cathal Gurrin,et al.  Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018 , 2018, LSC@ICMR.

[17]  Paul Over,et al.  TRECVID: evaluating the effectiveness of information retrieval tasks on digital video , 2004, MULTIMEDIA '04.

[18]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[19]  Duc-Tien Dang-Nguyen,et al.  LIFER: An Interactive Lifelog Retrieval System , 2018, LSC@ICMR.

[20]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.

[21]  Klaus Schöffmann,et al.  lifeXplore at the Lifelog Search Challenge 2018 , 2018, LSC@ICMR.

[22]  Michael Riegler,et al.  Challenges and Opportunities within Personal Life Archives , 2018, ICMR.

[23]  Alessandro Del Sole,et al.  Microsoft Computer Vision APIs Distilled , 2018, Apress.

[24]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[25]  Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum, Avignon, France, September 10-14, 2018 , 2018, CLEF.

[26]  Minh-Triet Tran,et al.  Personal Diary Generation from Wearable Cameras with Concept Augmented Image Captioning and Wide Trail Strategy , 2018, SoICT 2018.

[27]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[28]  Alan F. Smeaton,et al.  Constructing a SenseCam visual diary as a media process , 2008, Multimedia Systems.

[29]  Michael Riegler,et al.  Building a Disclosed Lifelog Dataset: Challenges, Principles and Processes , 2017, CBMI.

[30]  Yiqun Liu,et al.  Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research , 2018, SIGF.