Presenting bibliographic families using information visualization: Evaluation of FRBR‐based prototype and hierarchical visualizations

Since their beginnings, bibliographic information systems have been displaying results in the form of long, textual lists. With the development of new data models and computer technologies, the need for new approaches to present and interact with bibliographic data has slowly been maturing. To investigate how this could be accomplished, a prototype system, FrbrVis1, was designed to present work families within a bibliographic information system using information visualization. This paper reports on two user studies, a controlled and an observational experiment, that have been carried out to assess the Functional Requirements for Bibliographic Records (FRBR)‐based against an existing system as well as to test four different hierarchical visual layouts. The results clearly show that FrbrVis offers better performance and user experience compared to the baseline system. The differences between the four hierarchical visualizations (Indented tree, Radial tree, Circlepack, and Sunburst) were, on the other hand, not as pronounced, but the Indented tree and Sunburst design proved to be the most successful, both in performance as well as user perception. The paper therefore not only evaluates the application of a visual presentation of bibliographic work families, but also provides valuable results regarding the performance and user acceptance of individual hierarchical visualization techniques.

[1]  Stephen C. Hirtle,et al.  An empirical comparison of visualization tools to assist information retrieval on the web , 2001, J. Assoc. Inf. Sci. Technol..

[2]  Brian Caulfield,et al.  Towards a Pattern Language Approach to Sharing Experiences in Healthcare Technology Evaluations , 2010, USAB.

[3]  Keith Andrews,et al.  A Comparative Study of Four Hierarchy Browsers using the Hierarchical Visualisation Testing Environment (HVTE) , 2007, 2007 11th International Conference Information Visualization (IV '07).

[4]  Min Song,et al.  Visualization in information retrieval: a three-level analysis , 2000, J. Inf. Sci..

[5]  Dominique L. Scapin,et al.  User-Centered Evaluation of Information Visualization Techniques: Making the HCI-InfoVis Connection Explicit , 2014, Handbook of Human Centric Visualization.

[6]  Alfred Kobsa User Experiments with Tree Visualization Systems , 2004, IEEE Symposium on Information Visualization.

[7]  Chaomei Chen,et al.  Information Visualization: Beyond the Horizon , 2006 .

[8]  Maja Zumer,et al.  FrbrVis: An Information Visualization Approach to Presenting FRBR Work Families , 2012, TPDL.

[9]  Richard P. Smiraglia Be Careful What You Wish For: FRBR, Some Lacunae, A Review , 2012 .

[10]  Ben Shneiderman,et al.  Visualizing digital library search results with categorical and hierarchical axes , 2000, DL '00.

[11]  Eero Hyvönen,et al.  Semantic Web and reasoning for cultural heritage and digital libraries , 2012, Semantic Web.

[12]  Rahmatollah Fattahi Super records: An approach towards the description of works appearing in various manifestations , 1996 .

[13]  Zorana Ercegovac,et al.  Multiple-version resources in digital libraries: Towards user-centered displays , 2006, J. Assoc. Inf. Sci. Technol..

[14]  Sue J. Dyson,et al.  Back‐Shape Changes in Sports Horses , 2014 .

[15]  Richard P. Smiraglia The Nature of 'A Work': Implications for the Organization of Knowledge , 2001 .

[16]  Maja Zumer,et al.  Functional requirements for bibliographic records: an investigation of two prototypes , 2007, Program.

[17]  Ben Shneiderman,et al.  Strategies for evaluating information visualization tools: multi-dimensional in-depth long-term case studies , 2006, BELIV '06.

[18]  John T. Stasko,et al.  An evaluation of space-filling information visualizations for depicting hierarchical structures , 2000, Int. J. Hum. Comput. Stud..

[19]  M. Sheelagh T. Carpendale,et al.  Evaluating Information Visualizations , 2008, Information Visualization.

[20]  Edward A. Fox,et al.  Visualizing search results: some alternatives to query-document similarity , 1996, SIGIR '96.

[21]  Ben Shneiderman,et al.  Readings in information visualization - using vision to think , 1999 .

[22]  Martin Graham,et al.  A Survey of Multiple Tree Visualisation , 2010, Inf. Vis..

[23]  Allyson Carlyle Fulfilling the Second Objective in the Online Catalog: Schemes for Organizing Author and Work Records into Usable Displays , 1997 .

[24]  Gregory B. Newby,et al.  Empirical Study of a 3D Visualization for Information Retrieval Tasks , 2004, Journal of Intelligent Information Systems.

[25]  Allyson Carlyle Ordering Author and Work Records: An Evaluation of Collocation in Online Catalog Displays , 1996, J. Am. Soc. Inf. Sci..

[26]  John E. Leide,et al.  Controlled user evaluations of information visualization interfaces for text retrieval: Literature review and meta-analysis , 2008, J. Assoc. Inf. Sci. Technol..

[27]  Nicholas J. Belkin,et al.  Evaluation of a tool for visualization of information retrieval results , 1996, SIGIR '96.

[28]  Hsin-Hsi Chen,et al.  The Outreach of Digital Libraries: A Globalized Resource Network , 2012, Lecture Notes in Computer Science.

[29]  Steve Jones Graphical query specification and dynamic result previews for a digital library , 1998, UIST '98.

[30]  Russell Beale,et al.  Supporting serendipity: Using ambient intelligence to augment user exploration for data mining and web browsing , 2007, Int. J. Hum. Comput. Stud..

[31]  Marcia Kay Salmon Implementing FRBR in Libraries: Key Issues and Future Directions , 2013 .

[32]  Maja Zumer,et al.  The value of MARC data, or, challenges of frbrisation , 2013, J. Documentation.

[33]  Pierre Tirilly,et al.  Constructing a true LCSH tree of a science and engineering collection , 2012, J. Assoc. Inf. Sci. Technol..

[34]  Sherry Koshman Comparing usability between a visualization and text-based system for information retrieval , 2004, J. Documentation.

[35]  Kristen M. Zgoba,et al.  A Statement of Principles , 1963, Social Service Review.

[36]  Maja Zumer,et al.  Every User His Visualization? User Performance and Preferences of Different Hierarchical Layouts , 2013, ICADL.

[37]  Catherine Plaisant,et al.  SpaceTree: supporting exploration in large node link tree, design evolution and empirical evaluation , 2002, IEEE Symposium on Information Visualization, 2002. INFOVIS 2002..

[38]  Richard P. Smiraglia The “Works” Phenomenon and Best Selling Books , 2007 .

[39]  Richard P. Smiraglia Further Reflections on the Nature of ‘A Work’: An Introduction , 2002 .

[40]  Maja Zumer,et al.  Presenting and Exploring the Complexity of Bibliographic Relationships , 2012, ICADL.

[41]  Bo Fu,et al.  Indented Tree or Graph? A Usability Study of Ontology Visualization Techniques in the Context of Class Mapping Evaluation , 2013, SEMWEB.

[42]  A. H. Chaplin Statement of principles : adopted by the International Conference on Cataloguing Principles, Paris, October, 1961, annotated edition with commentary and examples , 1966 .

[43]  Mary Z. Rose The Ship Has Sailed and We Aren't On It: How Catalogers Could Support User Tasks and Why We Won’t , 2012 .

[44]  Andrew Vande Moere,et al.  The Effect of Aesthetic on the Usability of Data Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[45]  Mark H. Chignell,et al.  Elastic hierarchies: combining treemaps and node-link diagrams , 2005, IEEE Symposium on Information Visualization, 2005. INFOVIS 2005..

[46]  Chris North,et al.  The Value of Information Visualization , 2008, Information Visualization.

[47]  Catherine Plaisant,et al.  The challenge of information visualization evaluation , 2004, AVI.

[48]  Kwok-Fai So,et al.  A segment of optic nerve transplanted intravitreally retards death and enhances axonal regneration of retinal ganglion cells in adult hamsters , 1997 .

[49]  Ana Lupe Cristán,et al.  IFLA cataloguing principles : the statement of International Cataloguing Principles (ICP) and its glossary in 20 languages , 2009 .

[50]  Keith Andrews,et al.  Evaluating information visualisations , 2006, BELIV '06.

[51]  Bijan Parsia,et al.  Visualizing Web Ontologies with CropCircles , 2005 .

[52]  Stuart Andrews,et al.  1798: Bicentennial Verdict , 2006 .

[53]  M. Sheelagh T. Carpendale,et al.  The bohemian bookshelf: supporting serendipitous book discoveries through information visualization , 2012, CHI.

[54]  Maja Zumer,et al.  Coding FRBR-Structured Bibliographic Information in MARC , 2011, ICADL.

[55]  Richard P. Smiraglia,et al.  Derivative Bibliographic Relationships: The Work Relationship in a Global Bibliographic Database , 1999, J. Am. Soc. Inf. Sci..

[56]  Maja Zumer,et al.  User perception of 4 hierarchical layouts , 2013, ASIST.

[57]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[58]  Zorana Ercegovac Multiple-version resources in digital libraries: Towards user-centered displays: Research Articles , 2006 .

[59]  Klaus Meißner,et al.  A Semantics-Based, End-User-Centered Information Visualization Process for Semantic Web Data , 2013 .

[60]  Michael Lewis,et al.  Evaluating visualizations: using a taxonomic guide , 2000, Int. J. Hum. Comput. Stud..

[61]  Marie-France Plassard,et al.  Functional requirements for bibliographic records : final report , 2013 .

[62]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[63]  Jody Condit Fagan Usability Testing of a Large, Multidisciplinary Library Database: Basic Search and Visual Search , 2006 .

[64]  Tanja Mercun Evaluation of information visualization techniques: analysing user experience with reaction cards , 2014, BELIV '14.

[65]  Maja Zumer,et al.  Dimensions of User Experience and Reaction Cards , 2014, ICADL.

[66]  Frédéric Grosjean,et al.  S-phase synchronized CHO cells show elevated transfection efficiency and expression using CaPi , 2004, Cytotechnology.

[67]  Soon Tee Teoh,et al.  A study on multiple views for tree visualization , 2007, Electronic Imaging.

[68]  Ritch Macefield,et al.  How to specify the participant group size for usability studies: a practitioner's guide , 2009 .

[69]  Allyson Carlyle,et al.  Transforming Catalog Displays: Record Clustering for Works of Fiction , 2002 .

[70]  Elaine Svenonius The Intellectual Foundation of Information Organization , 2000 .

[71]  Susan T. Dumais,et al.  Discovery is never by chance: designing for (un)serendipity , 2009, C&C '09.

[72]  John D. Hastings,et al.  CARMA: Assessing Usability through a Non-Biased Online Survey Technique , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[73]  Matthew O. Ward,et al.  Theoretical Foundations of Information Visualization , 2008, Information Visualization.

[74]  Dylgg,et al.  Guidelines for Designing Information Visualization Applications , 1999 .

[75]  Jeffrey Rubin,et al.  Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests , 1994 .

[76]  John T. Stasko,et al.  Value-driven evaluation of visualizations , 2014, BELIV.

[77]  Rahmatollah Fattahi From Information to Knowledge: SuperWorks and the Challenges in the Organization and Representation of the Bibliographic Universe , 2010 .

[78]  Martha M. Yee,et al.  FRBRization: a Method for Turning Online Public Finding Lists into Online Public Catalogs , 2005 .