The Streams of Our Lives: Visualizing Listening Histories in Context

The choices we take when listening to music are expressions of our personal taste and character. Storing and accessing our listening histories is trivial due to services like Last.fm, but learning from them and understanding them is not. Existing solutions operate at a very abstract level and only produce statistics. By applying techniques from information visualization to this problem, we were able to provide average people with a detailed and powerful tool for accessing their own musical past. LastHistory is an interactive visualization for displaying music listening histories, along with contextual information from personal photos and calendar entries. Its two main user tasks are (1) analysis, with an emphasis on temporal patterns and hypotheses related to musical genre and sequences, and (2) reminiscing, where listening histories and context represent part of one's past. In this design study paper we give an overview of the field of music listening histories and explain their unique characteristics as a type of personal data. We then describe the design rationale, data and view transformations of LastHistory and present the results from both a laband a large-scale online study. We also put listening histories in contrast to other lifelogging data. The resonant and enthusiastic feedback that we received from average users shows a need for making their personal data accessible. We hope to stimulate such developments through this research.

[1]  Susan T. Dumais,et al.  Milestones in Time: The Value of Landmarks in Retrieving Information from Personal Stores , 2003, INTERACT.

[2]  Martin Wattenberg,et al.  Arc diagrams: visualizing structure in strings , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[3]  Patrick Baudisch,et al.  Time quilt: scaling up zoomable photo browsers for large, unstructured photo collections , 2005, CHI EA '05.

[4]  Martin Wattenberg,et al.  Stacked Graphs – Geometry & Aesthetics , 2008, IEEE Transactions on Visualization and Computer Graphics.

[5]  Adrian C. North,et al.  Uses of Music in Everyday Life , 2004 .

[6]  Tim Pohle,et al.  Dynamic Playlist Generation Based on Skipping Behavior , 2005, ISMIR.

[7]  John V. Carlis,et al.  Interactive visualization of serial periodic data , 1998, UIST '98.

[8]  Tamara Munzner,et al.  Increasing the utility of quantitative empirical studies for meta-analysis , 2008, BELIV '08.

[9]  Jarke J. van Wijk,et al.  Cluster and Calendar Based Visualization of Time Series Data , 1999, INFOVIS.

[10]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[11]  John T. Stasko,et al.  Using Graphic History in Browsing the World Wide Web , 1995, World Wide Web J..

[12]  François Pachet,et al.  Representing Musical Genre: A State of the Art , 2003 .

[13]  Danah Boyd,et al.  Digital artifacts for remembering and storytelling: posthistory and social network fragments , 2004, 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the.

[14]  Marc Alexa,et al.  Visualizing time-series on spirals , 2001, IEEE Symposium on Information Visualization, 2001. INFOVIS 2001..

[15]  P. Sánchez,et al.  VISUALIZATION METHODS FOR TIME-DEPENDENT DATA-AN OVERVIEW , 2003 .

[16]  Allan Kuchinsky,et al.  Requirements for photoware , 2002, CSCW '02.

[17]  Josep Lluís Arcos,et al.  Visualizing and Exploring Personal Music Libraries , 2004, ISMIR.

[18]  W. Bruce Croft,et al.  Deriving concept hierarchies from text , 1999, SIGIR '99.

[19]  Matt Jones,et al.  Organizing digital music for use: an examination of personal music collections , 2004, ISMIR.

[20]  Amanda Spink,et al.  Real life, real users, and real needs: a study and analysis of user queries on the web , 2000, Inf. Process. Manag..

[21]  Eric Freeman,et al.  Lifestreams: Organizing your Electronic Life* , 1995 .

[22]  Andreas Butz,et al.  Pulling strings from a tangle: visualizing a personal music listening history , 2009, IUI.

[23]  Adam Mathes,et al.  Folksonomies-Cooperative Classification and Communication Through Shared Metadata , 2004 .

[24]  Andreas Paepcke,et al.  Time as essence for photo browsing through personal digital libraries , 2002, JCDL '02.

[25]  Ben Shneiderman,et al.  A Visual Interface for Multivariate Temporal Data: Finding Patterns of Events across Multiple Histories , 2006, 2006 IEEE Symposium On Visual Analytics Science And Technology.

[26]  Fernanda B. Viégas,et al.  Visualizing email content: portraying relationships from conversational histories , 2006, CHI.

[27]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[28]  J. G. Snodgrass,et al.  Does the generation effect occur for pictures? , 2000, The American journal of psychology.

[29]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[30]  Colin Ware,et al.  Cognitive Measurements of Graph Aesthetics , 2002, Inf. Vis..

[31]  Heidrun Schumann,et al.  Visualizing time-oriented data - A systematic view , 2007, Comput. Graph..

[32]  Ben Shneiderman,et al.  Dynamic Query Tools for Time Series Data Sets: Timebox Widgets for Interactive Exploration , 2004, Inf. Vis..

[33]  Frank Bentley,et al.  Personal vs. commercial content: the similarities between consumer use of photos and music , 2006, CHI.

[34]  Ben Shneiderman,et al.  LifeLines: visualizing personal histories , 1996, CHI.

[35]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[36]  P. S. Sastry,et al.  A survey of temporal data mining , 2006 .