Automatically augmenting lifelog events using pervasively generated content from millions of people.

In sensor research we take advantage of additional contextual sensor information to disambiguate potentially erroneous sensor readings or to make better informed decisions on a single sensor’s output. This use of additional information reinforces, validates, semantically enriches, and augments sensed data. Lifelog data is challenging to augment, as it tracks one’s life with many images including the places they go, making it non-trivial to find associated sources of information. We investigate realising the goal of pervasive user-generated content based on sensors, by augmenting passive visual lifelogs with “Web 2.0” content collected by millions of other individuals.

[1]  S. Cessie,et al.  Ridge Estimators in Logistic Regression , 1992 .

[2]  Alan F. Smeaton,et al.  Automatically Segmenting LifeLog Data into Events , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[3]  S. Sathiya Keerthi,et al.  Improvements to Platt's SMO Algorithm for SVM Classifier Design , 2001, Neural Computation.

[4]  Pat Langley,et al.  Estimating Continuous Distributions in Bayesian Classifiers , 1995, UAI.

[5]  Alan F. Smeaton,et al.  Everyday concept detection in visual lifelogs: validation, relationships and trends , 2010, Multimedia Tools and Applications.

[6]  Joo-Hwee Lim,et al.  Scene Recognition with Camera Phones for Tourist Information Access , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  George A. Miller,et al.  Introduction to WordNet: An On-line Lexical Database , 1990 .

[8]  A. Baddeley Your Memory: A User's Guide , 1982 .

[9]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[10]  Paul Over,et al.  High-level feature detection from video in TRECVid: a 5-year retrospective of achievements , 2009 .

[11]  Hideaki Takeda,et al.  Ubiquitous Memories: a memory externalization system using physical objects , 2007, Personal and Ubiquitous Computing.

[12]  Bettina Berendt,et al.  Tags are not metadata, but "just more content" - to some people , 2007, ICWSM.

[13]  Mohamed Batouche,et al.  Virtualized Real Object Integration and Manipulation in an Augmented Scene , 2005, CAIP.

[14]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[15]  Oded Nov,et al.  What drives content tagging: the case of photos on Flickr , 2008, CHI.

[16]  A. Owen,et al.  The neural basis of effective memory therapy in a patient with limbic encephalitis , 2009, Journal of Neurology Neurosurgery & Psychiatry.

[17]  Alan F. Smeaton,et al.  Context-Aware Person Identification in Personal Photo Collections , 2009, IEEE Transactions on Multimedia.

[18]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[19]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[20]  A. Smeaton,et al.  Combination of content analysis and context features for digital photograph retrieval. , 2005 .

[21]  Ting Liu,et al.  Clustering Billions of Images with Large Scale Nearest Neighbor Search , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[22]  Zongpeng Li,et al.  Youtube traffic characterization: a view from the edge , 2007, IMC '07.

[23]  Roelof van Zwol,et al.  Flickr: Who is Looking? , 2007, Web Intelligence.

[24]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[25]  Mor Naaman,et al.  Towards automatic extraction of event and place semantics from flickr tags , 2007, SIGIR.

[26]  Jeffrey M. Zacks,et al.  Event understanding and memory in healthy aging and dementia of the Alzheimer type. , 2006, Psychology and aging.

[27]  Rong Yan,et al.  How many high-level concepts will fill the semantic gap in news video retrieval? , 2007, CIVR '07.

[28]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[29]  P. Schmitz,et al.  Inducing Ontology from Flickr Tags , 2006 .

[30]  G. Bell,et al.  A digital life , 2007 .