A Two-Level Lifelog Search Engine at the LSC 2019

The rise of affordable wearable devices makes visual lifelog data easier to collect. This data can then be retrieved as an aside memory usable as well for people with memory issues or in daily life to be more efficient. This paper presents the retrieval system designed for the Lifelog Search Challenge 2019 competition. This retrieval system offers two search levels: a semantic one and an image-based one. The data used for the indexing for both levels (semantic data for the text-based method or combinations of HSV Histogram and BRIEF features for the example-based one) as well as the architecture of the overall system is described. Results from our experiments are promising. The text-based search engine has disparate results that strongly depend on the keywords used for the query. For the example search engine, the best features are composed of both HSV histogram and BRIEF features. Despite encouraging results, the processing time appears to be a limitation.

[1]  Steven C. H. Hoi,et al.  A two-view learning approach for image tag ranking , 2011, WSDM '11.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Dong Liu,et al.  Tag ranking , 2009, WWW '09.

[4]  Wolfgang Nejdl,et al.  Can all tags be used for search? , 2008, CIKM '08.

[5]  Aaron Duane.  Virtual Reality Lifelog Explorer , 2018 .

[6]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[7]  Jakub Lokoc,et al.  Using an Interactive Video Retrieval Tool for LifeLog Data , 2018, LSC@ICMR.

[8]  Cathal Gurrin,et al.  Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018 , 2018, LSC@ICMR.

[9]  Vannevar Bush,et al.  As we may think , 1945, INTR.

[10]  Klaus Schöffmann,et al.  LSE2018 Panel - Challenges of Lifelog Search and Access , 2018, LSC@ICMR.

[11]  Mohammad Qatawneh,et al.  Image Clustering using Color, Texture and Shape Features , 2011, KSII Trans. Internet Inf. Syst..

[12]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[13]  Vinh-Tiep Nguyen,et al.  Lifelogging Retrieval based on Semantic Concepts Fusion , 2018, LSC@ICMR.

[14]  Klaus Schöffmann,et al.  lifeXplore at the Lifelog Search Challenge 2018 , 2018, LSC@ICMR.

[15]  Rob Kitchin,et al.  ‘Outlines of a World Coming into Existence’: Pervasive Computing and the Ethics of Forgetting , 2007 .

[16]  Gareth J. F. Jones,et al.  Augmenting human memory using personal lifelogs , 2010, AH.

[17]  Sanjay Silakari,et al.  Image Clustering Using Color and Texture , 2009, 2009 First International Conference on Computational Intelligence, Communication Systems and Networks.