Adaptive timeline interface to personal history data

As the growth of stored personal digital information, such as photographs and emails, is continuously increasing, new tools for browsing and searching are needed. We introduce an intelligent mobile information access tool for personal data. The data are presented in an adaptive timeline where the displayed items function as search cues. The novelty is that the visualization is dynamically changed to emphasize relevant items, which makes them easier to recognize and select. The relevance is inferred during usage of the system from user feedback. In a user study, the dynamic timeline-based interface on a mobile device was shown to require less effort than conventional textual search.

[1]  M. Naaman,et al.  Lost in memories: interacting with photo collections on PDAs , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[2]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[3]  L. Standing Learning 10,000 pictures. , 1973, The Quarterly journal of experimental psychology.

[4]  Gareth J. F. Jones,et al.  Augmenting human memory using personal lifelogs , 2010, AH.

[5]  Walter Bender,et al.  iRemember: a personal, long-term memory prosthesis , 2006, CARPE '06.

[6]  Steve Hodges,et al.  SenseCam: A wearable camera that stimulates and rehabilitates autobiographical memory , 2011, Memory.

[7]  L. Standing Learning 10000 pictures , 1973 .

[8]  Erkki Oja,et al.  TRECVID 2013 Workshop, Gaithersburg, USA, November 20-22, 2013 , 2013 .

[9]  R. Baeza-Yates,et al.  Exploratory Search Using Timelines , 2007 .

[10]  Gary Marchionini,et al.  Synthesis Lectures on Information Concepts, Retrieval, and Services , 2009 .

[11]  Cees Snoek,et al.  Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video Retrieval , 2011, MMM.

[12]  Susan T. Dumais,et al.  Searching to eliminate personal information management , 2006, CACM.

[13]  Susan T. Dumais,et al.  Fast, flexible filtering with phlat , 2006, CHI.

[14]  Mark S. Ackerman,et al.  The perfect search engine is not enough: a study of orienteering behavior in directed search , 2004, CHI.

[15]  James M. Rehg,et al.  CENTRIST: A Visual Descriptor for Scene Categorization , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  David Elsweiler,et al.  Towards memory supporting personal information management tools , 2007 .

[17]  A. E. Hoerl,et al.  Ridge regression: biased estimation for nonorthogonal problems , 2000 .

[18]  Paul D. Clough,et al.  Easy on that trigger dad: a study of long term family photo retrieval , 2009, Personal and Ubiquitous Computing.

[19]  Susan T. Dumais,et al.  Milestones in Time: The Value of Landmarks in Retrieving Information from Personal Stores , 2003, INTERACT.

[20]  Rafi Nachmias,et al.  Improved search engines and navigation preference in personal information management , 2008, TOIS.

[21]  Erkki Oja,et al.  Class distributions on SOM surfaces for feature extraction and object retrieval , 2004, Neural Networks.

[22]  Abigail Sellen,et al.  Beyond total capture , 2010, Commun. ACM.

[23]  Alan F. Smeaton,et al.  Constructing a SenseCam visual diary as a media process , 2008, Multimedia Systems.

[24]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[25]  Jorma Laaksonen,et al.  PicSOM Experiments in TRECVID 2018 , 2015, TRECVID.

[26]  Gerard Salton,et al.  The SMART Retrieval System—Experiments in Automatic Document Processing , 1971 .

[27]  Jan Haas,et al.  CONTASK: Context-Sensitive Task Assistance in the Semantic Desktop , 2010, ICEIS.

[28]  Ofer Bergman,et al.  The use of attention resources in navigation versus search , 2013, Personal and Ubiquitous Computing.

[29]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[30]  Tiziana Catarci,et al.  Digital memories in an era of ubiquitous computing and abundant storage , 2006, CACM.

[31]  Samuel Kaski,et al.  Probabilistic Proactive Timeline Browser , 2011, ICANN.

[32]  Alan F. Smeaton,et al.  Automatically augmenting lifelog events using pervasively generated content from millions of people. , 2010 .

[33]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.