Organiser Team at ImageCLEFlifelog 2020: A Baseline Approach for Moment Retrieval and Athlete Performance Prediction using Lifelog Data

For the LMRT task at ImageCLEFlifelog 2020, LIFER 3.0, a new version of the LIFER system with improvements in the user interface and system affordance, is used and evaluated via feedback from a user experiment. In addition, since both tasks share a common dataset, LIFER 3.0 borrows some features from the LifeSeeker system deployed for the Lifelog Search Challenge; which are free-text search, visual similarity search and elastic sequencing filter. For the SPLL task, we proposed a naive solution by capturing the rate of change in running speed and weight, then obtain the target changes for each subtask using average computation and linear regression model. The results presented in this paper can be used as comparative baselines for other participants in the ImageCLEFlifelog 2020 challenge.

[1]  Minh-Triet Tran,et al.  LifeSeeker 2.0: Interactive Lifelog Search Engine at LSC 2020 , 2020, LSC@ICMR.

[2]  Minh-Triet Tran,et al.  Introduction to the Third Annual Lifelog Search Challenge (LSC'20) , 2020, ICMR.

[3]  Antonio,et al.  ImageCLEF 2020: Multimedia Retrieval in Lifelogging, Medical, Nature, and Internet Applications , 2020, ECIR.

[4]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2019: Solve My Life Puzzle and Lifelog Moment Retrieval , 2019, CLEF.

[5]  Michael Riegler,et al.  LIFER 2.0: Discovering Personal Lifelog Insights using an Interactive Lifelog Retrieval System , 2019, CLEF.

[6]  Rami Albatal,et al.  Overview of the NTCIR-14 Lifelog-3 task , 2019 .

[7]  Minh-Triet Tran,et al.  LifeSeeker: Interactive Lifelog Search Engine at LSC 2019 , 2019, LSC@ICMR.

[8]  Dongyoon Han,et al.  Character Region Awareness for Text Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2018: Daily Living Understanding and Lifelog Moment Retrieval , 2018, CLEF.

[10]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.

[11]  Michael Riegler,et al.  Overview of ImageCLEFlifelog 2017: Lifelog Retrieval and Summarization , 2017, CLEF.

[12]  Lei Zhang,et al.  Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Michael S. Bernstein,et al.  Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations , 2016, International Journal of Computer Vision.

[14]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Matthieu Guillaumin,et al.  Food-101 - Mining Discriminative Components with Random Forests , 2014, ECCV.

[16]  Alan F. Smeaton,et al.  Experiences of Aiding Autobiographical Memory Using the SenseCam , 2012, Hum. Comput. Interact..

[17]  Martin Schrepp,et al.  Construction and Evaluation of a User Experience Questionnaire , 2008, USAB.

[18]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[19]  Minh-Triet Tran,et al.  Overview of ImageCLEF Lifelog 2020: Lifelog Moment Retrieval and Sport Performance Lifelog , 2020, CLEF.

[20]  Michael Riegler,et al.  Paper Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge ( LSC 2018 ) , 2019 .

[21]  Vinh-Tiep Nguyen,et al.  Lifelog Moment Retrieval with Advanced Semantic Extraction and Flexible Moment Visualization for Exploration , 2019, CLEF.

[22]  Jie Xia,et al.  ZJUTCVR Team at ImageCLEFlifelog2019 Lifelog Moment Retrieval Task , 2019, CLEF.

[23]  Stefan Kahl,et al.  Automated Lifelog Moment Retrieval based on Image Segmentation and Similarity Scores , 2019, CLEF.

[24]  Koji Zettsu,et al.  BIDAL@imageCLEFlifelog2019: The Role of Content and Context of Daily Activities in Insights from Lifelogs , 2019, CLEF.

[25]  Michael Riegler,et al.  An Interactive Lifelog Retrieval System for Activities of Daily Living Understanding , 2018, CLEF.

[26]  Bogdan Ionescu,et al.  Multimedia Lab @ ImageCLEF 2018 Lifelog Moment Retrieval Task , 2018, CLEF.

[27]  Rami Albatal,et al.  Overview of NTCIR-12 Lifelog Task , 2016, NTCIR.

[28]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[29]  Minh-Triet Tran,et al.  A Baseline Interactive Retrieval Engine for the NTCIR-14 Lifelog-3 Semantic Access Task , 2022 .