Exploratory browsing: enhancing the browsing experience with media collections

In recent years the digital media has influenced many areas of our life. The transition from analogue to digital has substantially changed our ways of dealing with media collections. Today‟s interfaces for managing digital media mainly offer fixed linear models corresponding to the underlying technical concepts (folders, events, albums, etc.), or the metaphors borrowed from the analogue counterparts (e.g., stacks, film rolls). However, people‟s mental interpretations of their media collections often go beyond the scope of linear scan. Besides explicit search with specific goals, current interfaces can not sufficiently support the explorative and often non-linear behavior. This dissertation presents an exploration of interface design to enhance the browsing experience with media collections. The main outcome of this thesis is a new model of Exploratory Browsing to guide the design of interfaces to support the full range of browsing activities, especially the Exploratory Browsing. We define Exploratory Browsing as the behavior when the user is uncertain about her or his targets and needs to discover areas of interest (exploratory), in which she or he can explore in detail and possibly find some acceptable items (browsing). According to the browsing objectives, we group browsing activities into three categories: Search Browsing, General Purpose Browsing and Serendipitous Browsing. In the context of this thesis, Exploratory Browsing refers to the latter two browsing activities, which goes beyond explicit search with specific objectives. We systematically explore the design space of interfaces to support the Exploratory Browsing experience. Applying the methodology of User-Centered Design, we develop eight prototypes, covering two main usage contexts of browsing with personal collections and in online communities. The main studied media types are photographs and music. The main contribution of this thesis lies in deepening the understanding of how people‟s exploratory behavior has an impact on the interface design. This thesis contributes to the field of interface design for media collections in several aspects. With the goal to inform the interface design to support the Exploratory Browsing experience with media collections, we present a model of Exploratory Browsing, covering the full range of exploratory activities around media collections. We investigate this model in different usage contexts and develop eight prototypes. The substantial implications gathered during the development and evaluation of these prototypes inform the further refinement of our model: We uncover the underlying transitional relations between browsing activities and discover several stimulators to encourage a fluid and effective activity transition. Based on this model, we propose a catalogue of general interface

[1]  Mor Naaman,et al.  Context data in geo-referenced digital photo collections , 2004, MULTIMEDIA '04.

[2]  Andrew D. Miller,et al.  Give and take: a study of consumer photo-sharing culture and practice , 2007, CHI.

[3]  Harold W. Thimbleby,et al.  User interface design , 1990, ACM Press Frontier Series.

[4]  Patrick Baudisch,et al.  Time quilt: scaling up zoomable photo browsers for large, unstructured photo collections , 2005, CHI EA '05.

[5]  Keiji Yanai,et al.  Mining cultural differences from a large number of geotagged photos , 2009, WWW '09.

[6]  Elaine Toms,et al.  Understanding and facilitating the browsing of electronic text , 2000, Int. J. Hum. Comput. Stud..

[7]  Ichiro Fujinaga,et al.  jAudio: An Feature Extraction Library , 2005, ISMIR.

[8]  Owen Kaser,et al.  Tag-Cloud Drawing: Algorithms for Cloud Visualization , 2007, ArXiv.

[9]  Mor Naaman,et al.  From Where to What: Metadata Sharing for Digital Photographs with Geographic Coordinates , 2003, OTM.

[10]  Marc Davis,et al.  From “ What ? ” to “ Why ? ” : The Social Uses of Personal Photos , 2004 .

[11]  Hsinchun Chen,et al.  Link prediction approach to collaborative filtering , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[12]  Ulrike Gretzel,et al.  Behavioral Foundations for Human-Centric Travel Decision-Aid Systems , 2002, ENTER.

[13]  Bernard Kerr TagOrbitals: a tag index visualization , 2006, SIGGRAPH '06.

[14]  Laura Sebastia,et al.  e-Tourism: A Tourist Recommendation and Planning Application , 2008, ICTAI.

[15]  Rui Li,et al.  Towards effective browsing of large scale social annotations , 2007, WWW '07.

[16]  Susanne Boll,et al.  MobiDENK - mobile multimedia in monument conservation , 2004, IEEE MultiMedia.

[17]  Michael L. Creech,et al.  FotoFile: a consumer multimedia organization and retrieval system , 1999, CHI '99.

[18]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[19]  Ricardo da Silva Torres,et al.  Visual structures for image browsing , 2003, CIKM '03.

[20]  Andreas Butz,et al.  PhotoMagnets: supporting flexible browsing and searching in photo collections , 2010, ICMI-MLMI '10.

[21]  Mark W. Newman,et al.  Listening in: practices surrounding iTunes music sharing , 2005, CHI.

[22]  Fernanda B. Viégas,et al.  Artifacts of the Presence Era: Using Information Visualization to Create an Evocative Souvenir , 2004, IEEE Symposium on Information Visualization.

[23]  Kenton O'Hara,et al.  Jukola: democratic music choice in a public space , 2004, DIS '04.

[24]  Otmar Hilliges,et al.  Getting sidetracked: display design and occasioning photo-talk with the photohelix , 2009, CHI.

[25]  Yvonne Rogers,et al.  Beyond Interaction Design: Beyond Human-Computer Interaction , 2001 .

[26]  Rodrigo Santamaría Vicente,et al.  Overlapping Clustered Graphs: Co-authorship Networks Visualization , 2008 .

[27]  Gary Marchionini,et al.  Exploratory search , 2006, Commun. ACM.

[28]  Kerry Rodden,et al.  Does organisation by similarity assist image browsing? , 2001, CHI.

[29]  Beth Logan,et al.  Content-Based Playlist Generation: Exploratory Experiments , 2002, ISMIR.

[30]  Masataka Goto,et al.  MusicSun: A New Approach to Artist Recommendation , 2007, ISMIR.

[31]  Wolfgang Prinz,et al.  Group storytelling for team awareness and entertainment , 2004, NordiCHI '04.

[32]  Yong Yu,et al.  Exploring social annotations for the semantic web , 2006, WWW '06.

[33]  Austin Henderson,et al.  Interaction design: beyond human-computer interaction , 2002, UBIQ.

[34]  Andreas Butz,et al.  Photohelix: Browsing, Sorting and Sharing Digital Photo Collections , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[35]  Fernanda B. Viégas,et al.  Visualizing email content: portraying relationships from conversational histories , 2006, CHI.

[36]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[37]  Chris Janiszewski,et al.  The Influence of Display Characteristics on Visual Exploratory Search Behavior , 1998 .

[38]  Monica M. C. Schraefel,et al.  The evolving mSpace platform: leveraging the semantic web on the trail of the memex , 2005, HYPERTEXT '05.

[39]  Tamara Munzner,et al.  MusicLand: Exploratory Browsing in Music Space , 2004 .

[40]  Steffen Lohmann,et al.  Comparison of Tag Cloud Layouts: Task-Related Performance and Visual Exploration , 2009, INTERACT.

[41]  Steffen Pauws,et al.  User Evaluation of a New Interactive Playlist Generation Concept , 2005, ISMIR.

[42]  Xavier Serra,et al.  SIMAC: semantic interaction with music audio contents , 2005 .

[43]  Abigail Sellen,et al.  Understanding photowork , 2006, CHI.

[44]  Laura A. Dabbish,et al.  Labeling images with a computer game , 2004, AAAI Spring Symposium: Knowledge Collection from Volunteer Contributors.

[45]  Marc Davis,et al.  The uses of personal networked digital imaging: an empirical study of cameraphone photos and sharing , 2005, CHI Extended Abstracts.

[46]  Ben Shneiderman,et al.  Tree visualization with tree-maps: 2-d space-filling approach , 1992, TOGS.

[47]  Tim Pohle,et al.  GENERATING SIMILARITY-BASED PLAYLISTS USING TRAVELING SALESMAN ALGORITHMS , 2005 .

[48]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[49]  Berry Eggen,et al.  Realization and User Evaluation of an Automatic Playlist Generator , 2003, ISMIR.

[50]  John T. Stasko,et al.  Personalized Peripheral Information Awareness Through Information Art , 2004, UbiComp.

[51]  J. Stasko,et al.  Focus+context display and navigation techniques for enhancing radial, space-filling hierarchy visualizations , 2000, IEEE Symposium on Information Visualization 2000. INFOVIS 2000. Proceedings.

[52]  Nicholas J. Belkin,et al.  Categories of Music Description and Search Terms and Phrases Used by Non-Music Experts , 2002, ISMIR.

[53]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[54]  Beth Logan,et al.  Music Recommendation from Song Sets , 2004, ISMIR.

[55]  Francesco Ricci,et al.  Supporting Travel Decision Making Through Personalized Recommendation , 2004, Designing Personalized User Experiences in eCommerce.

[56]  Ben Shneiderman,et al.  Universal usability , 2000, Commun. ACM.

[57]  Kevin Li,et al.  Faceted metadata for image search and browsing , 2003, CHI '03.

[58]  Fabio Vignoli,et al.  Visual Playlist Generation on the Artist Map , 2005, ISMIR.

[59]  Ryen W. White,et al.  Supporting exploratory search , 2006 .

[60]  Max L. Wilson A Nine Month Report on Progress Towards a Framework for Evaluating Advanced Search Interfaces considering Information Retrieval and Human Computer Interaction , 2007 .

[61]  Lars Erik Holmquist,et al.  Between aesthetics and utility: designing ambient information visualizations , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[62]  Kirsten Swearingen,et al.  Interaction Design for Recommender Systems , 2002 .

[63]  Masataka Goto,et al.  MusicRainbow: A New User Interface to Discover Artists Using Audio-based Similarity and Web-based Labeling , 2006, ISMIR.

[64]  Martin F. Porter,et al.  An algorithm for suffix stripping , 1997, Program.

[65]  Mor Naaman,et al.  How flickr helps us make sense of the world: context and content in community-contributed media collections , 2007, ACM Multimedia.

[66]  Dimitris Plexousakis,et al.  Incremental Collaborative Filtering for Highly-Scalable Recommendation Algorithms , 2005, ISMIS.

[67]  Adam N. Joinson,et al.  Looking at, looking up or keeping up with people?: motives and use of facebook , 2008, CHI.

[68]  Maxwell A. Pretzlav Last . fm Explorer : An Interactive Visualization of Hierarchical Time-Series Data , 2008 .

[69]  Andreas Rieger,et al.  BerlinTainment: an agent-based context-aware entertainment planning system , 2005, IEEE Communications Magazine.

[70]  O. Ramsay,et al.  Serendipity: Accidental Discoveries in Science (Roberts, Royston M.) , 1990 .

[71]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[72]  Mary Czerwinski,et al.  PhotoTOC: automatic clustering for browsing personal photographs , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[73]  D. Norman,et al.  User Centered System Design: New Perspectives on Human-Computer Interaction , 1988 .

[74]  Mario Romero,et al.  A preliminary investigation of Alien Presence , 2005 .

[75]  Andreas Paepcke,et al.  TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware , 2006, CHI.

[76]  John T. Stasko,et al.  Dust & Magnet: Multivariate Information Visualization Using a Magnet Metaphor , 2005, Inf. Vis..

[77]  Andreas Komninos,et al.  AmbientDJ: Enabling Interaction between People and Socially Aware Environments , 2008, MIRW.

[78]  Fabio Vignoli,et al.  Digital Music Interaction Concepts: A User Study , 2004, ISMIR.

[79]  Judith S. Donath,et al.  PeopleGarden: creating data portraits for users , 1999, UIST '99.

[80]  Ben Shneiderman,et al.  Visualization methods for personal photo collections: browsing and searching in the PhotoFinder , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[81]  Eero Sormunen,et al.  End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive , 2004, Information Retrieval.

[82]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[83]  Fabio Vignoli,et al.  A Music Retrieval System Based on User Driven Similarity and Its Evaluation , 2005, ISMIR.

[84]  Kerry Rodden,et al.  How do people manage their digital photographs? , 2003, CHI '03.

[85]  Mor Naaman,et al.  HT06, tagging paper, taxonomy, Flickr, academic article, to read , 2006, HYPERTEXT '06.

[86]  Adrian Popescu,et al.  Deducing trip related information from flickr , 2009, WWW '09.

[87]  Josep Lluís Arcos,et al.  Visualizing and Exploring Personal Music Libraries , 2004, ISMIR.

[88]  Joseph F. McCarthy,et al.  MusicFX: an arbiter of group preferences for computer supported collaborative workouts , 1998, CSCW '98.

[89]  G. Widmer,et al.  EVALUATION OF FREQUENTLY USED AUDIO FEATURES FOR CLASSIFICATION OF MUSIC INTO PERCEPTUAL CATEGORIES , 2005 .

[90]  Kirsten Swearingen,et al.  Beyond Algorithms: An HCI Perspective on Recommender Systems , 2001 .

[91]  Mathias Lux,et al.  Lire: lucene image retrieval: an extensible java CBIR library , 2008, ACM Multimedia.

[92]  Ulrich Schiel,et al.  SEI-Tur: A System Based on Composed Web-Service Discovery to Support the Creation of Trip Plans , 2007, First International Conference on the Digital Society (ICDS'07).

[93]  Thomas Hofmann,et al.  Robust collaborative filtering , 2007, RecSys '07.

[94]  Barry Smyth,et al.  PeerChooser: visual interactive recommendation , 2008, CHI.

[95]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[96]  E. Pampalk Islands of Music Analysis, Organization, and Visualization of Music Archives , 2002 .

[97]  B. Shneiderman,et al.  Motivating Annotation for Personal Digital Photo Libraries : Lowering Barriers While Raising Incentives , 2022 .

[98]  Marc Torrens,et al.  Context-aware mobile assistants for optimal interaction: a prototype for supporting the business traveler , 2004, IUI '04.

[99]  Andreas Paepcke,et al.  TeamSearch: comparing techniques for co-present collaborative search of digital media , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[100]  Chris North,et al.  An insight-based methodology for evaluating bioinformatics visualizations , 2005, IEEE Transactions on Visualization and Computer Graphics.

[101]  David M. Mount,et al.  The analysis of a simple k-means clustering algorithm , 2000, SCG '00.

[102]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[103]  C.C. Marshall,et al.  Sharing encountered information: digital libraries get a social life , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[104]  Oded Nov,et al.  What drives content tagging: the case of photos on Flickr , 2008, CHI.

[105]  Jungwon Cho,et al.  Personalization Method for Tourist Point of Interest (POI) Recommendation , 2006, KES.

[106]  J. Stephen Downie,et al.  Survey Of Music Information Needs, Uses, And Seeking Behaviours: Preliminary Findings , 2004, ISMIR.

[107]  Alan F. Smeaton,et al.  MediAssist: Using Content-Based Analysis and Context to Manage Personal Photo Collections , 2006, CIVR.

[108]  Wolfgang Kienreich,et al.  On the Beauty and Usability of Tag Clouds , 2008, 2008 12th International Conference Information Visualisation.

[109]  Martin Wattenberg,et al.  Artistic Data Visualization: Beyond Visual Analytics , 2007, HCI.

[110]  Sidney S. Fels,et al.  The MUSICtable: A Map-Based Ubiquitous System for Social Interaction with a Digital Music Collection , 2005, ICEC.

[111]  Albrecht Schmidt,et al.  Implicit personalization of public environments using bluetooth , 2008, CHI Extended Abstracts.

[112]  Kentaro Toyama,et al.  Geographic location tags on digital images , 2003, ACM Multimedia.

[113]  Tim Pohle,et al.  Dynamic Playlist Generation Based on Skipping Behavior , 2005, ISMIR.

[114]  Inderpal Singh Mumick,et al.  The Dynamic Homefinder: Evaluating Dynamic Queries In A Real-Estate Information Exploration System , 1999 .

[115]  Dominique Cardon,et al.  The Stength of Weak cooperation: A Case Study on Flickr , 2008, ArXiv.

[116]  Mor Naaman,et al.  Leveraging context to resolve identity in photo albums , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[117]  John T. Stasko,et al.  A taxonomy of ambient information systems: four patterns of design , 2006, AVI '06.

[118]  H. Garcia-Molina,et al.  Automatic organization for digital photographs with geographic coordinates , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[119]  Ben Shneiderman,et al.  Direct annotation: a drag-and-drop strategy for labeling photos , 2000, 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics.

[120]  Ganesh S. Oak Information Visualization Introduction , 2022 .

[121]  Wendy W. Moe,et al.  The Influence of Goal‐Directed and Experiential Activities on Online Flow Experiences , 2003 .

[122]  Clifton Forlines,et al.  Sharing and building digital group histories , 2002, CSCW '02.

[123]  Ben Shneiderman,et al.  Meaningful presentations of photo libraries: rationale and applications of bi-level radial quantum layouts , 2005, Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '05).

[124]  Paul A. Beardsley,et al.  Personal digital historian: user interface design , 2001, CHI Extended Abstracts.

[125]  P Beatty,et al.  Bridging the gaps. , 1990, Hospital trustee.

[126]  Martin Wattenberg,et al.  TIMELINESTag clouds and the case for vernacular visualization , 2008, INTR.

[127]  Benjamin M. Good,et al.  Tag clouds for summarizing web search results , 2007, WWW '07.

[128]  Chen-Nee Chuah,et al.  Unveiling facebook: a measurement study of social network based applications , 2008, IMC '08.