YouPivot: improving recall with contextual search

According to cognitive science literature, human memory is predicated on contextual cues (e.g., room, music) in the environment. During recall tasks, we associate information/activities/objects with contextual cues. However, computer systems do not leverage our natural process of using contextual cues to facilitate recall. We present a new interaction technique, Pivoting, that allows users to search for contextually related activities and find a target piece of information (often not semantically related). A sample motivation for contextual search would be, 'what was that website I was looking at when Yesterday by The Beatles was last playing?' Our interaction technique is grounded in the cognitive science literature, and is demonstrated in our system YouPivot. In addition, we present a new personal annotation method, called TimeMarks, to further support contextual recall and the pivoting process. In a pilot study, participants were quicker to identify websites, and preferred using YouPivot, compared to current tools. YouPivot demonstrates how principles of human memory can be applied to enhance the search of digital information.

[1]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[2]  Jason I. Hong,et al.  Contextual web history: using visual and contextual cues to improve web browser history , 2009, CHI.

[3]  Susan T. Dumais,et al.  Fast, flexible filtering with phlat , 2006, CHI.

[4]  Joshua M. Hailpern,et al.  WISE:: a wizard interface supporting enhanced usability , 2006, Assets '06.

[6]  Karrie Karahalios,et al.  The CLOTHO project: predicting application utility , 2010, Conference on Designing Interactive Systems.

[7]  David Gelernter,et al.  Lifestreams: a storage model for personal data , 1996, SGMD.

[8]  Brad A. Myers,et al.  What to do when search fails: finding information by association , 2008, CHI.

[9]  Gordon Bell,et al.  MyLifeBits: a personal database for everything , 2006, CACM.

[10]  Craig A. N. Soules,et al.  Connections: using context to enhance file search , 2005, SOSP '05.

[11]  Susan T. Dumais,et al.  Milestones in Time: The Value of Landmarks in Retrieving Information from Personal Stores , 2003, INTERACT.

[12]  Steven M. Smith Environmental context—dependent memory. , 1988 .

[13]  Tara Matthews,et al.  Fitting an activity-centric system into an ecology of workplace tools , 2010, CHI.

[14]  Thomas G. Dietterich,et al.  The life and times of files and information: a study of desktop provenance , 2010, CHI.

[15]  Lucy T. Nowell,et al.  ThemeRiver: visualizing theme changes over time , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[16]  Jeffrey Heer,et al.  Protovis: A Graphical Toolkit for Visualization , 2009, IEEE Transactions on Visualization and Computer Graphics.

[17]  Aaron S. Benjamin,et al.  Memory is More than just Remembering: Strategic Control of Encoding, Accessing Memory, and Making Decisions , 2007 .

[18]  Steven M. Smith Remembering In and Out of Context , 1979 .

[19]  Jason Nieh,et al.  DejaView: a personal virtual computer recorder , 2007, SOSP.

[20]  David R. Karger,et al.  Haystack: A General-Purpose Information Management Tool for End Users Based on Semistructured Data , 2005, CIDR.

[21]  Karrie Karahalios,et al.  Clotho and Lachesis: Building, Optimizing and Validating Models to Predict Important Applications in a Real-World Context , 2010 .

[22]  Victoria Bellotti,et al.  Taskmaster: recasting email as task management , 2002 .

[23]  Victor Kaptelinin,et al.  UMEA: translating interaction histories into project contexts , 2003, CHI '03.

[24]  Martin Wattenberg,et al.  ManyEyes: a Site for Visualization at Internet Scale , 2007, IEEE Transactions on Visualization and Computer Graphics.

[25]  Robert A. Bjork,et al.  On the puzzling relationship between environmental context and human memory. , 1989 .

[26]  Dominique L. Scapin,et al.  What do people recall about their documents?: implications for desktop search tools , 2007, IUI '07.

[27]  M. Lamming,et al.  "Forget-me-not" Intimate Computing in Support of Human Memory , 1994 .

[28]  Martin Wattenberg,et al.  Stacked Graphs – Geometry & Aesthetics , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  Eric Horvitz,et al.  Learning Predictive Models of Memory Landmarks , 2004 .

[30]  W. Cleveland,et al.  Graphical Perception: Theory, Experimentation, and Application to the Development of Graphical Methods , 1984 .

[31]  H SCHLOSBERG,et al.  Similarity in stimulating conditions as a variable in retroactive inhibition. , 1951, Journal of experimental psychology.

[32]  J. Greenspoon,et al.  Stimulus conditions and retroactive inhibition. , 1957, Journal of experimental psychology.

[33]  Jun Rekimoto,et al.  Time-machine computing: a time-centric approach for the information environment , 1999, UIST '99.