Myscéal: An Experimental Interactive Lifelog Retrieval System for LSC'20

The Lifelog Search Challenge (LSC), is an annual comparative bench-marking activity for comparing approaches to interactive retrieval from multi-modal lifelogs. Being an interactive search challenge, issues such as retrieval accuracy, search speed and usability of inter-faces are key challenges that must be addressed by every participant. In this paper, we introduce Myscéal, an interactive lifelog retrieval engine designed to support novice users to retrieve items of interest from a large multimodal lifelog. Additionally, we also introduce anew similarity measure called "aTFIDF", to match a user's free-text information need with the multimodal lifelog index.

[1]  K. Sparck Jones,et al.  Simple, proven approaches to text retrieval , 1994 .

[2]  Klaus Schöffmann,et al.  lifeXplore at the Lifelog Search Challenge 2019 , 2019, LSC '19.

[3]  Minh-Triet Tran,et al.  [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018) , 2019, ITE Transactions on Media Technology and Applications.

[4]  Jakub Lokoc,et al.  Enhanced VIRET Tool for Lifelog Data , 2019, LSC '19.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Gordon Bell,et al.  MyLifeBits: fulfilling the Memex vision , 2002, MULTIMEDIA '02.

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Michael Riegler,et al.  Challenges and Opportunities within Personal Life Archives , 2018, ICMR.

[10]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[11]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[12]  Claudio Gennaro,et al.  Large-Scale Image Retrieval with Elasticsearch , 2018, SIGIR.

[13]  Minh-Triet Tran,et al.  Introduction to the Third Annual Lifelog Search Challenge (LSC'20) , 2020, ICMR.

[14]  Marcel Worring,et al.  Exquisitor at the Lifelog Search Challenge 2019 , 2019, LSC@ICMR.

[15]  Petia Radeva,et al.  LEMoRe: A Lifelog Engine for Moments Retrieval at the NTCIR-Lifelog LSAT Task , 2016, NTCIR.

[16]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[17]  Wiebke Wagner,et al.  Steven Bird, Ewan Klein and Edward Loper: Natural Language Processing with Python, Analyzing Text with the Natural Language Toolkit , 2010, Lang. Resour. Evaluation.

[18]  Diane Kelly,et al.  Methods for Evaluating Interactive Information Retrieval Systems with Users , 2009, Found. Trends Inf. Retr..

[19]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[20]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[21]  Duc-Tien Dang-Nguyen,et al.  A Baseline Search Engine for Personal Life Archives , 2017, LTA@MM.

[22]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[23]  Gordon Bell,et al.  Passive capture and ensuing issues for a personal lifetime store , 2004, CARPE'04.

[24]  Rami Albatal,et al.  Overview of NTCIR-12 Lifelog Task , 2016, NTCIR.

[25]  Minh-Triet Tran,et al.  LifeSeeker: Interactive Lifelog Search Engine at LSC 2019 , 2019, LSC@ICMR.

[26]  Heiko Schuldt,et al.  Retrieval of Structured and Unstructured Data with vitrivr , 2019, LSC@ICMR.

[27]  Rami Albatal,et al.  Overview of NTCIR-13 Lifelog-2 Task , 2017, NTCIR.

[28]  Bolei Zhou,et al.  Scene Parsing through ADE20K Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Peter Oram.  WordNet: An electronic lexical database. Christiane Fellbaum (Ed.). Cambridge, MA: MIT Press, 1998. Pp. 423. , 2001, Applied Psycholinguistics.

[30]  Cathal Gurrin,et al.  Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018 , 2018, LSC@ICMR.

[31]  Rami Albatal,et al.  NTCIR Lifelog: The First Test Collection for Lifelog Research , 2016, SIGIR.

[32]  Hui Wei,et al.  Creating Efficient Visual Codebook Ensembles for Object Categorization , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.