Paper Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge ( LSC 2018 )

The Lifelog Search Challenge (LSC) is an international content retrieval competition that evaluates search for personal lifelog data. At the LSC, content-based search is performed over a multi-modal dataset, continuously recorded by a lifelogger over 27 days, consisting of multimedia content, biometric data, human activity data, and information activities data. In this work, we report on the first LSC that took place in Yokohama, Japan in 2018 as a special workshop at ACM International Conference on Multimedia Retrieval 2018 (ICMR 2018). We describe the general idea of this challenge, summarise the participating search systems as well as the evaluation procedure, and analyse the search performance of the teams in various aspects. We try to identify reasons why some systems performed better than others and provide an outlook as well as open issues for upcoming iterations of the challenge.

[1]  Michael Riegler,et al.  Building a Disclosed Lifelog Dataset: Challenges, Principles and Processes , 2017, CBMI.

[2]  Petia Radeva,et al.  LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task , 2016, NTCIR.

[3]  Michael Riegler,et al.  Challenges and Opportunities within Personal Life Archives , 2018, ICMR.

[4]  Rami Albatal,et al.  A Test Collection for Interactive Lifelog Retrieval , 2019, MMM.

[5]  Michael Riegler,et al.  Overview of ImageCLEF 2018: Challenges, Datasets and Evaluation , 2018, CLEF.

[6]  Cathal Gurrin,et al.  Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018 , 2018, LSC@ICMR.

[7]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.

[8]  George Awad,et al.  On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017 , 2018, IEEE Transactions on Multimedia.

[9]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[10]  Steven Simske,et al.  Beyond quantified self: data for wellbeing , 2014, CHI Extended Abstracts.

[11]  Minh-Triet Tran,et al.  [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018) , 2019, ITE Transactions on Media Technology and Applications.

[12]  Noel E. O'Connor,et al.  LoggerMan, a Comprehensive Logging and Visualization Tool to Capture Computer Usage , 2016, MMM.

[13]  Minh-Triet Tran,et al.  Personal Diary Generation from Wearable Cameras with Concept Augmented Image Captioning and Wide Trail Strategy , 2018, SoICT 2018.

[14]  Vinh-Tiep Nguyen,et al.  Lifelogging Retrieval based on Semantic Concepts Fusion , 2018, LSC@ICMR.

[15]  Klaus Schöffmann,et al.  The ITEC Collaborative Video Search System at the Video Browser Showdown 2018 , 2018, MMM.

[16]  Working Notes of CLEF 2018 - Conference and Labs of the Evaluation Forum, Avignon, France, September 10-14, 2018 , 2018, CLEF.

[17]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[18]  Alessandro Del Sole,et al.  Microsoft Computer Vision APIs Distilled , 2018, Apress.

[19]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[20]  Rob Kitchin,et al.  ‘Outlines of a World Coming into Existence’: Pervasive Computing and the Ethics of Forgetting , 2007 .

[21]  Yiqun Liu,et al.  Report on NTCIR-13: The Thirteenth Round of NII Testbeds and Community for Information Access Research , 2018, SIGF.

[22]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2018: Daily Living Understanding and Lifelog Moment Retrieval , 2018, CLEF.

[23]  Klaus Schöffmann,et al.  lifeXplore at the Lifelog Search Challenge 2018 , 2018, LSC@ICMR.

[24]  Duc-Tien Dang-Nguyen,et al.  LIFER: An Interactive Lifelog Retrieval System , 2018, LSC@ICMR.

[25]  Proceedings of The Twenty-Sixth Text REtrieval Conference, TREC 2017, Gaithersburg, Maryland, USA, November 15-17, 2017 , 2017, TREC.

[26]  Jakub Lokoc,et al.  Using an Interactive Video Retrieval Tool for LifeLog Data , 2018, LSC@ICMR.

[27]  Cathal Gurrin,et al.  An Interactive Lifelog Search Engine for LSC2018 , 2018, LSC@ICMR.

[28]  Paul Over,et al.  TRECVID: evaluating the effectiveness of information retrieval tasks on digital video , 2004, MULTIMEDIA '04.

[29]  Alan F. Smeaton,et al.  Constructing a SenseCam visual diary as a media process , 2008, Multimedia Systems.