Information Access Tasks and Evaluation for Personal Lifelogs

Emerging personal lifelog (PL) collections contain permanent digital records of information associated with individuals’ daily lives. This can include materials such as emails received and sent, web content and other documents with which they have interacted, photographs, videos and music experienced passively or created, logs of phone calls and text messages, and also personal and contextual data such as location (e.g. via GPS sensors), persons and objects present (e.g. via Bluetooth) and physiological state (e.g. via biometric sensors). PLs can be collected by individuals over very extended periods, potentially running to many years. Such archives have many potential applications including helping individuals recover partial forgotten information, sharing experiences with friends or family, telling the story of one’s life, clinical applications for the memory impaired, and fundamental psychological investigations of memory. The Centre for Digital Video Processing (CDVP) at Dublin City University is currently engaged in the collection and exploration of applications of large PLs. We are collecting rich archives of daily life including textual and visual materials, and contextual context data. An important part of this work is to consider how the effectiveness of our ideas can be measured in terms of metrics and experimental design. While these studies have considerable similarity with traditional evaluation activities in areas such as information retrieval and summarization, the characteristics of PLs mean that new challenges and questions emerge. We are currently exploring the issues through a series of pilot studies and questionnaires. Our initial results indicate that there are many research questions to be explored and that the relationships between personal memory, context and content for these tasks is complex and fascinating.

[1]  Susan T. Dumais,et al.  Fast, Flexible Filtering with Phlat — Personal Search and Organization Made Easy , 2006 .

[2]  Craig A. N. Soules Using Context to Assist in Personal File Retrieval (CMU-CS-06-147) , 2006 .

[3]  Kevin M. Brooks,et al.  Metalinear cinematic narrative : theory, process, and tool , 1999 .

[4]  G. Bell,et al.  A digital life , 2007 .

[5]  Jim Gemmell,et al.  Telling Stories with Mylifebits , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[6]  Gareth J. F. Jones,et al.  Towards computational autobiographical narratives through human digital memories , 2008, SRMC '08.

[7]  Shahram Izadi,et al.  SenseCam: A Retrospective Memory Aid , 2006, UbiComp.

[8]  Muriel Garreta Domingo,et al.  Ten emotion heuristics: guidelines for assessing the user's affective dimension easily and cost-effectively , 2007, BCS HCI.

[9]  J. G. Tanenbaum,et al.  Affective Interaction Design and Narrative Presentation , 2007, AAAI Fall Symposium: Intelligent Narrative Technologies.

[10]  Siobhan Chapman Logic and Conversation , 2005 .

[11]  Yi Chen,et al.  Integrating memory context into personal information re-finding , 2008 .

[12]  David Birchfield,et al.  Communicating everyday experiences , 2004, SRMC '04.

[13]  D. McAdams,et al.  The Psychology of Life Stories , 2001 .

[14]  Ellen M. Voorhees,et al.  The TREC-5 Confusion Track: Comparing Retrieval Methods for Scanned Text , 2000, Information Retrieval.

[15]  Alan F. Smeaton,et al.  Keyframe detection in visual lifelogs , 2008, PETRA '08.

[16]  Gareth J. F. Jones,et al.  A study of remembered context for information access from personal digital archives , 2008, IIiX.

[17]  Paul Over,et al.  The trecvid 2007 BBC rushes summarization evaluation pilot , 2007, TVS '07.

[18]  Kiyoharu Aizawa,et al.  Efficient retrieval of life log based on context and content , 2004, CARPE'04.

[19]  Alan F. Smeaton,et al.  An Examination of a Large Visual Lifelog , 2008, AIRS.

[20]  Kathleen McKeown,et al.  A Platform for Symbolically Encoding Human Narratives , 2007, AAAI Fall Symposium: Intelligent Narrative Technologies.

[21]  Kiyoharu Aizawa,et al.  Context-based video retrieval system for the life-log applications , 2003, MIR '03.

[22]  Liadh Kelly,et al.  Applying contextual memory cues for retrieval from personal information archives , 2008 .

[23]  Susan Bluck,et al.  The Life Story Schema , 2000 .

[24]  Kevin M. Brooks Do story agents use rocking chairs? The theory and implementation of one model for computational narrative , 1997, MULTIMEDIA '96.

[25]  David Elsweiler,et al.  Towards memory supporting personal information management tools , 2007, J. Assoc. Inf. Sci. Technol..

[26]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[27]  Abigail Sellen,et al.  Do life-logging technologies support memory for the past?: an experimental study using sensecam , 2007, CHI.

[28]  Craig A. N. Soules,et al.  Connections: using context to enhance file search , 2005, SOSP '05.

[29]  Susan T. Dumais,et al.  Milestones in Time: The Value of Landmarks in Retrieving Information from Personal Stores , 2003, INTERACT.

[30]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[31]  Warren Sack Stories and Social Networks , 1999 .

[32]  Nasser Peyghambarian Thanks for the memory , 1995, Nature.

[33]  Amy Bruckman,et al.  THE COMBINATORICS OF STORYTELLING: MYSTERY TRAIN INTERACTIVE , 1990 .