Visualization of Cultural Heritage Collection Data: State of the Art and Future Challenges

After decades of digitization, large cultural heritage collections have emerged on the web, which contain massive stocks of content from galleries, libraries, archives, and museums. This increase in digital cultural heritage data promises new modes of analysis and increased levels of access for academic scholars and casual users alike. Going beyond the standard representations of search-centric and grid-based interfaces, a multitude of approaches has recently started to enable visual access to cultural collections, and to explore them as complex and comprehensive information spaces by the means of interactive visualizations. In contrast to conventional web interfaces, we witness a widening spectrum of innovative visualization types specially designed for rich collections from the cultural heritage sector. This new class of information visualizations gives rise to a notable diversity of interaction and representation techniques while lending currency and urgency to a discussion about principles such as serendipity, generosity, and criticality in connection with visualization design. With this survey, we review information visualization approaches to digital cultural heritage collections and reflect on the state of the art in techniques and design choices. We contextualize our survey with humanist perspectives on the field and point out opportunities for future research.

[1]  Vincenzo Lombardo,et al.  Visual metaphors for semantic cultural heritage , 2015, 2015 7th International Conference on Intelligent Technologies for Interactive Entertainment (INTETAIN).

[2]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[3]  J. Henrich,et al.  The evolution of cultural evolution , 2003 .

[4]  Johanna Drucker,et al.  Humanities Approaches to Graphical Display , 2011, Digit. Humanit. Q..

[5]  Gennady L. Andrienko,et al.  Exploratory analysis of spatial and temporal data - a systematic approach , 2005 .

[6]  M. Sheelagh T. Carpendale,et al.  More Than Telling a Story: Transforming Data into Visually Shared Stories , 2015, IEEE Computer Graphics and Applications.

[7]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[8]  Morimichi Nishigaki,et al.  ArchivesZ : Visualizing Archival Collections , 2007 .

[9]  Greta Franzini,et al.  Visual Text Analysis in Digital Humanities , 2017, Comput. Graph. Forum.

[10]  Gerik Scheuermann,et al.  GeoTemCo: Comparative Visualization of Geospatial-Temporal Data with Clutter Removal Based on Dynamic Delaunay Triangulations , 2012, VISIGRAPP.

[11]  Menno-Jan Kraak,et al.  Timelines, temporal resolution, temporal zoom and time geography , 2005 .

[12]  M. Sheelagh T. Carpendale,et al.  The bohemian bookshelf: supporting serendipitous book discoveries through information visualization , 2012, CHI.

[13]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[14]  Paolo Ciuccarelli,et al.  Weaving data, slicing views: a design approach to creating visual access for digital archival collections , 2013, CHItaly '13.

[15]  Fabrizio Ivan Apollonio,et al.  Classification Schemes for Visualization of Uncertainty in Digital Hypothetical Reconstruction , 2016, 3D Research Challenges in Cultural Heritage.

[16]  D. Swartz Culture and Power: The Sociology of Pierre Bourdieu , 1998 .

[17]  Uta Hinrichs,et al.  It doesn't compare to being there : in-situ vs. remote exploration of museum collections , 2014 .

[18]  Weijia Xu,et al.  Interactive visualization for curatorial analysis of large digital collection , 2014, Inf. Vis..

[19]  Martin Doerr,et al.  Zen and the Art of Linked Data , 2015 .

[20]  Leif Isaksen,et al.  Peripleo: a tool for exploring heterogenous data through the dimensions of space and time , 2016 .

[21]  Massimo Bergamasco,et al.  Beyond virtual museums: experiencing immersive virtual reality in real museums , 2010 .

[22]  Kwan-Liu Ma,et al.  Living Liquid: Design and Evaluation of an Exploratory Visualization Tool for Museum Visitors , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Katrin Glinka,et al.  Visualising the » Unseen « : Towards Critical Approaches and Strategies of Inclusion in Digital Cultural Heritage Interfaces , 2015 .

[24]  Nigel Ford,et al.  Serendipity and information seeking: an empirical study , 2003, J. Documentation.

[25]  Eric Maisel,et al.  Inline Co-Evolution between Users and Information Presentation for Data Exploration , 2017, IUI.

[26]  M. Sheelagh T. Carpendale,et al.  EMDialog: Bringing Information Visualization into the Museum , 2008, IEEE Transactions on Visualization and Computer Graphics.

[27]  J. Drucker Humanities Approaches to Interface Theory , 2011 .

[28]  Robert Villa,et al.  Search or Browse? Casual Information Access to a Cultural Heritage Collection , 2013, EuroHCIR.

[29]  Silvia Miksch,et al.  A Survey on Visual Approaches for Analyzing Scientific Literature and Patents , 2017, IEEE Transactions on Visualization and Computer Graphics.

[30]  Florian Windhager,et al.  Cultural Heritage Cube. A Conceptual Framework for Visual Exhibition Exploration , 2012, 2012 16th International Conference on Information Visualisation.

[31]  David McG. Squire,et al.  Deconstructing Bricolage: Interactive Online Analysis of Compiled Texts with Factotum , 2015, Digit. Humanit. Q..

[32]  Jefferson Bailey,et al.  Viewshare and the Kress Collection: Creating, Sharing, and Rapidly Prototyping Visual Interfaces to Cultural Heritage Collection Data , 2012, D Lib Mag..

[33]  Eero Hyvönen,et al.  How to deal with massively heterogeneous cultural heritage data - lessons learned in CultureSampo , 2012, Semantic Web.

[34]  Matthew Arnold,et al.  Culture and anarchy ; with, Friendship's garland, and some literary essays , 1965 .

[35]  Johanna Drucker,et al.  Performative Materiality and Theoretical Approaches to Interface , 2013, Digit. Humanit. Q..

[36]  Jimmy J. Lin,et al.  Computational linguistics for metadata building (CLiMB): using text mining for the automatic identification, categorization, and disambiguation of subject terms for image metadata , 2009, Multimedia Tools and Applications.

[37]  Massimo Bergamasco,et al.  Design of information landscapes for cultural heritage content , 2008, DIMEA.

[38]  Craig A. Knoblock,et al.  Connecting the Smithsonian American Art Museum to the Linked Data Cloud , 2013, ESWC.

[39]  Mark M. Hall,et al.  Just Looking Around: Supporting Casual Users Initial Encounters with Digital Cultural Heritage , 2015, SCST@ECIR.

[40]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[41]  William Ribarsky,et al.  VAiRoma: A Visual Analytics System for Making Sense of Places, Times, and Events in Roman History , 2016, IEEE Transactions on Visualization and Computer Graphics.

[42]  Babak Saleh,et al.  Large-scale Classification of Fine-Art Paintings: Learning The Right Metric on The Right Feature , 2015, ArXiv.

[43]  GlamMapping Trove,et al.  GlamMapping Trove , 2016 .

[44]  S. Dawson Keywords: a Vocabulary of Culture and Society , 1976 .

[45]  Raimondo Schettini,et al.  Browsing museum image collections on a multi-touch table , 2012, Inf. Syst..

[46]  Ann Blandford,et al.  “Making my own luck”: Serendipity strategies and how to support them in digital information environments , 2014, J. Assoc. Inf. Sci. Technol..

[47]  N. Di Blas,et al.  In Search of Novel Ways To Design Large Cultural Web Sites , 2010 .

[48]  Marian Dörk,et al.  Past Visions and Reconciling Views: Visualizing Time, Texture and Themes in Cultural Collections , 2017, Digit. Humanit. Q..

[49]  Paula Goodale Individual Differences in Exploration and Content Curation Activities within a Cultural Heritage Digital Library , 2016, ACHS@JCDL.

[50]  Damon Crockett,et al.  Direct visualization techniques for the analysis of image data: the slice histogram and the growing entourage plot , 2016 .

[51]  Ross Parry Recoding the Museum: Digital Heritage and the Technologies of Change , 2007 .

[52]  Europeana Definition of the Europeana Data Model v5.2.5 , 2014 .

[53]  Mitchell Whitelaw,et al.  Generous Interfaces for Digital Cultural Collections , 2015, Digit. Humanit. Q..

[54]  Jean-Daniel Fekete,et al.  ARIES: Enabling Visual Exploration and Organization of Art Image Collections , 2018, IEEE Computer Graphics and Applications.

[55]  Roberto Therón,et al.  Highly interactive and natural user interfaces: enabling visual analysis in historical lexicography , 2014, DATeCH '14.

[56]  Viviana Mascardi,et al.  Investigative analysis across documents and drawings: visual analytics for archaeologists , 2012, AVI.

[57]  Gerik Scheuermann,et al.  Interactive Visual Profiling of Musicians , 2016, IEEE Transactions on Visualization and Computer Graphics.

[58]  Silvia Miksch,et al.  Visual Encodings of Temporal Uncertainty: A Comparative User Study , 2016, IEEE Transactions on Visualization and Computer Graphics.

[59]  J. Kamps,et al.  Information Retrieval in Cultural Heritage , 2009 .

[60]  Olivia Vane,et al.  Using Data Visualisation to Tell Stories about Collections , 2016, EVA.

[61]  Jonathan Foster,et al.  User Categories for Digital Cultural Heritage , 2016, ACHS@JCDL.

[62]  Mitchell Whitelaw,et al.  Exploring the digital commons: an approach to the visualisation of large heritage datasets , 2010, EVA.

[63]  Yahaya Ahmad,et al.  The Scope and Definitions of Heritage: From Tangible to Intangible , 2006 .

[64]  Luca Mainetti,et al.  Visualizing cultural digital resources using social network analysis , 2015, 2015 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management (IC3K).

[65]  M. Sheelagh T. Carpendale,et al.  The information flaneur: a fresh look at information seeking , 2011, CHI.

[66]  Merete Sanderhoff Open Images. Risk or opportunity for art collections in the digital age , 1970 .

[67]  Natalie Kerracher,et al.  The Design Space of Temporal Graph Visualisation , 2014, EuroVis.

[68]  M. Sheelagh T. Carpendale,et al.  Critical InfoVis: exploring the politics of visualization , 2013, CHI Extended Abstracts.

[69]  Dirk Helbing,et al.  A network framework of cultural history , 2014, Science.

[70]  Florian Kräutli Visualising cultural data : exploring digital collections through timeline visualisations , 2016 .

[71]  Chris Alen Sula,et al.  Quantifying Culture: Four Types of Value in Visualisation , 2013, Electronic Visualisation in Arts and Culture.

[72]  Michael Granitzer,et al.  FacetScape: A Visualization for Exploring the Search Space , 2014, 2014 18th International Conference on Information Visualisation.

[73]  Martin H. Levinson Not by Genes Alone: How Culture Transformed Human Evolution , 2006 .

[74]  Elaine Toms,et al.  Chance Encounters in the Digital Library , 2009, ECDL.

[75]  Falko Kuester,et al.  Cultural Analytics in Large-Scale Visualization Environments , 2011, Computer.

[76]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[77]  Paolo Cignoni,et al.  Browsing Large Image Datasets through Voronoi Diagrams , 2010, IEEE Transactions on Visualization and Computer Graphics.

[78]  Ye Yuan,et al.  Vis4Heritage: Visual Analytics Approach on Grotto Wall Painting Degradations , 2013, IEEE Transactions on Visualization and Computer Graphics.

[79]  Anne J. Gilliland-Swetland Digital preservation and metadata: history, theory, practice , 2002 .

[80]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[81]  Marcia J. Bates,et al.  The design of browsing and berrypicking techniques for the online search interface , 1989 .

[82]  Olga Buchel,et al.  Designing map-based visualizations for collection understanding , 2011, JCDL '11.

[83]  Marco Tagliasacchi,et al.  HistoGraph -- A Visualization Tool for Collaborative Analysis of Networks from Historical Social Multimedia Collections , 2014, 2014 18th International Conference on Information Visualisation.

[84]  Gary Marchionini,et al.  Previews and overviews in digital libraries: Designing surrogates to support visual information seeking , 2000, J. Am. Soc. Inf. Sci..

[85]  E. Hornecker,et al.  The Loupe: tangible augmented reality for learning to look at Ancient Greek art , 2016 .

[86]  Robin Horst,et al.  artVIS: an interactive visualization for painting collections , 2017, VINCI.

[87]  S. Miksch,et al.  Visualization of Cultural Heritage Data for Casual Users , 2016 .

[88]  Klaus Schöffmann,et al.  Similarity-Based Visualization for Image Browsing Revisited , 2011, 2011 IEEE International Symposium on Multimedia.

[89]  Bethany Nowviskie,et al.  Geo-Temporal Interpretation of Archival Collections with Neatline , 2013, Lit. Linguistic Comput..

[90]  Miguel Carvalhais,et al.  Regarding Value in Digital Serendipitous Interactions , 2016 .

[91]  Uta Hinrichs,et al.  Diving in at the Deep End: The Value of Alternative In-Situ Approaches for Systematic Library Search , 2016, CHI.

[92]  Silvia Miksch,et al.  A matter of time: Applying a data-users-tasks design triangle to visual analytics of time-oriented data , 2014, Comput. Graph..

[93]  Ben Ennis Butler Visual Exploration of Australian Prints and Printmaking , 2013 .

[94]  Antonis Bikakis,et al.  Cognitive-Based Visualization of Semantically Structured Cultural Heritage Data , 2015, VOILA@ISWC.

[95]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[96]  A. Jones EXPLODING CANONS: The Anthropology of Museums , 1993 .

[97]  John J. Leggett,et al.  Collection understanding , 2004, JCDL.

[98]  Stephen Boyd Davis,et al.  Known Unknowns: Representing Uncertainty in Historical Time , 2013, EVA.

[99]  Randy Silverman Preserving Our Heritage: Perspectives From Antiquity to the Digital Age , 2015 .

[100]  Laura Deal Visualizing Digital Collections , 2014, ArXiv.

[101]  Julianne Nyhan Visual Interface Design for Digital Cultural Heritage: A Guide to Rich Prospect Browsing , 2014, J. Documentation.

[102]  W. Sewell The concept(s) of culture , 2004 .

[103]  Beat Signer,et al.  ArtVis: combining advanced visualisation and tangible interaction for the exploration, analysis and browsing of digital artwork collections , 2014, AVI.

[104]  Sean Bechhofer,et al.  SKOS Simple Knowledge Organization System Reference , 2009 .

[105]  Florian Windhager,et al.  Linked Information Visualization for Linked Open Government Data. A Visual Synthetics Approach to Governmental Data and Knowledge Collections , 2016 .

[106]  Paul S.C. Taçon,et al.  A collaborative, ontological and information visualization model approach in a centralized rock art heritage platform , 2016 .

[107]  Marian Dörk,et al.  One view is not enough: High-level visualizations of a large cultural collection , 2017 .

[108]  Josef Froschauer,et al.  Revisiting 3D information landscapes for the display of art historical web content , 2011, Advances in Computer Entertainment Technology.

[109]  Uta Hinrichs,et al.  Speculative Practices: Utilizing InfoVis to Explore Untapped Literary Collections , 2016, IEEE Transactions on Visualization and Computer Graphics.

[110]  Manuel Menezes de Oliveira Neto,et al.  Overview and State-of-the-Art of Uncertainty Visualization , 2014, Scientific Visualization.

[111]  Paul H. Lewis,et al.  New Ways to Search, Navigate and Use Multimedia Museum Collections over the Web , 2005 .

[112]  A. Kroeber,et al.  Culture, a critical review of concepts and definitions , 1953 .

[113]  Eike Kleiner Blended shelf: reality-based presentation and exploration of library collections , 2013, ISI.

[114]  Andreas Butz,et al.  Towards the Big Picture: Enriching 3D Models with Information Visualisation and Vice Versa , 2009, Smart Graphics.

[115]  C. Calhoun Critical Social Theory: Culture, History, and the Challenge of Difference , 1995 .

[116]  Madely du Preez Linked Data for Libraries, Archives and Museums: How to Clean, Link and Publish your Metadata , 2015, Electron. Libr..

[117]  Edward A. Fox,et al.  Exploring digital libraries: integrating browsing, searching, and visualization , 2006, Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06).

[118]  Florian Kräutli,et al.  Revealing cultural collections over time , 2015 .

[119]  Thomas Ertl,et al.  Sifting through visual arts collections , 2016, Comput. Graph..

[120]  Susan T. Dumais,et al.  PivotPaths: Strolling through Faceted Information Spaces , 2012, IEEE Transactions on Visualization and Computer Graphics.

[121]  Gareth Davey What is Museum Fatigue ? , 2007 .

[122]  Lora Aroyo,et al.  DIVE into the event-based browsing of linked historical media , 2015, J. Web Semant..