Advances in Lifelog Data Organisation and Retrieval at the NTCIR-14 Lifelog-3 Task

Lifelogging refers to the process of digitally capturing a continuous and detailed trace of life activities in a passive manner. In order to assist the research community to make progress in the organisation and retrieval of data from lifelog archives, a lifelog task was organised at NTCIR since edition 12. Lifelog-3 was the third running of the lifelog task (at NTCIR-14) and the Lifelog-3 task explored three different lifelog data access related challenges, the search challenge, the annotation challenge and the insights challenge. In this paper we review the dataset created for this activity, activities of participating teams who took part in these challenges and we highlight learnings for the community from the NTCIR-Lifelog challenges.

[1]  Vigneshwaran Subbaraju,et al.  VCI2R at the NTCIR-13 Lifelog-2 Lifelog Semantic Access Task , 2017, NTCIR Conference on Evaluation of Information Access Technologies.

[2]  David J. Crandall,et al.  Privacy behaviors of lifeloggers using wearable cameras , 2014, UbiComp.

[3]  Cathal Gurrin,et al.  DCU at the NTCIR-13 Lifelog-2 Task , 2017 .

[4]  Guido Zuccon,et al.  QUT at the NTCIR Lifelog Semantic Access Task , 2016, NTCIR.

[5]  Jiang Zhou,et al.  The use of wearable cameras in assessing children's dietary intake and behaviours in China , 2019, Appetite.

[6]  Michael Riegler,et al.  Building a Disclosed Lifelog Dataset: Challenges, Principles and Processes , 2017, CBMI.

[7]  Kelly A. Mackintosh,et al.  Can Wearable Cameras Be Used to Validate School-Aged Children’s Lifestyle Behaviours? , 2019, Children.

[8]  Georges Quénot,et al.  LIG-MRIM at NTCIR-12 Lifelog Semantic Access Task , 2016, NTCIR.

[9]  Rami Albatal,et al.  Overview of the NTCIR-14 Lifelog-3 task , 2019 .

[10]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Hsin-Hsi Chen,et al.  An Interactive Approach to Integrating External Textual Knowledge for Multimodal Lifelog Retrieval , 2019, LSC '19.

[12]  Petia Radeva,et al.  LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task , 2016, NTCIR.

[13]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2018: Daily Living Understanding and Lifelog Moment Retrieval , 2018, CLEF.

[14]  Marc Langheinrich,et al.  Remembering through lifelogging: A survey of human memory augmentation , 2016, Pervasive Mob. Comput..

[15]  Minh-Triet Tran,et al.  [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018) , 2019, ITE Transactions on Media Technology and Applications.

[16]  Liang-Pu Chen,et al.  Image Searching by Events with Deep Learning for NTCIR-12 Lifelog , 2016, NTCIR.

[17]  Minh-Triet Tran,et al.  A Baseline Interactive Retrieval Engine for Visual Lifelogs at the NTCIR-14 Lifelog-3 Task , 2019, NTCIR.

[18]  Rami Albatal,et al.  Overview of NTCIR-12 Lifelog Task , 2016, NTCIR.

[19]  Vinh-Tiep Nguyen,et al.  Smart Lifelog Retrieval System with Habit-based Concepts and Moment Visualization , 2019, LSC '19.

[20]  Jiang Zhou,et al.  Kids'Cam: An Objective Methodology to Study the World in Which Children Live. , 2017, American journal of preventive medicine.

[21]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[22]  D. Kahneman,et al.  A Survey Method for Characterizing Daily Life Experience: The Day Reconstruction Method , 2004, Science.

[23]  Weiguo Fan,et al.  VTIR at the NTCIR-12 2016 Lifelog Semantic Access Task , 2016, NTCIR.

[24]  Bolei Zhou,et al.  Places: A 10 Million Image Database for Scene Recognition , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  P. Schofield,et al.  The use of a wearable camera to explore daily functioning of older adults living with persistent pain: Methodological reflections and recommendations , 2018, Journal of rehabilitation and assistive technologies engineering.

[26]  Rob Kitchin,et al.  ‘Outlines of a World Coming into Existence’: Pervasive Computing and the Ethics of Forgetting , 2007 .

[27]  Alan F. Smeaton,et al.  LifeLogging: Personal Big Data , 2014, Found. Trends Inf. Retr..

[28]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.