What's the Situation with Situated Visualization? A Survey and Perspectives on Situatedness

Situated visualization is an emerging concept within visualization, in which data is visualized in situ, where it is relevant to people. The concept has gained interest from multiple research communities, including visualization, human-computer interaction (HCI) and augmented reality. This has led to a range of explorations and applications of the concept, however, this early work has focused on the operational aspect of situatedness leading to inconsistent adoption of the concept and terminology. First, we contribute a literature survey in which we analyze 44 papers that explicitly use the term “situated visualization” to provide an overview of the research area, how it defines situated visualization, common application areas and technology used, as well as type of data and type of visualizations. Our survey shows that research on situated visualization has focused on technology-centric approaches that foreground a spatial understanding of situatedness. Secondly, we contribute five perspectives on situatedness (space, time, place, activity, and community) that together expand on the prevalent notion of situatedness in the corpus. We draw from six case studies and prior theoretical developments in HCI. Each perspective develops a generative way of looking at and working with situatedness in design and research. We outline future directions, including considering technology, material and aesthetics, leveraging the perspectives for design, and methods for stronger engagement with target audiences. We conclude with opportunities to consolidate situated visualization research.

[1]  Adrien Fonnet,et al.  Survey of Immersive Analytics , 2021, IEEE Transactions on Visualization and Computer Graphics.

[2]  Rui José,et al.  Dimensions of Situatedness for Digital Public Displays , 2014, Adv. Hum. Comput. Interact..

[3]  Andrew Vande Moere,et al.  Towards a Model of Information Aesthetics in Information Visualization , 2007, 2007 11th International Conference Information Visualization (IV '07).

[4]  Niklas Elmqvist,et al.  Ubiquitous Analytics: Interacting with Big Data Anywhere, Anytime , 2013, Computer.

[5]  Ulrich Engelke,et al.  MelissAR: Towards Augmented Visual Analytics of Honey Bee Behaviour , 2016, CHI Extended Abstracts.

[6]  Sean White,et al.  SiteLens: situated visualization techniques for urban site visits , 2009, CHI.

[7]  Raimund Dachselt,et al.  Investigating the Impact of Real-World Environments on the Perception of 2D Visualizations in Augmented Reality , 2021, CHI.

[8]  Drew Hemment,et al.  Stop the Noise! Enhancing Meaningfulness in Participatory Sensing with Community Level Indicators , 2018, Conference on Designing Interactive Systems.

[9]  Saul Greenberg,et al.  Context as a Dynamic Construct , 2001, Hum. Comput. Interact..

[10]  Marian Dörk,et al.  I/O Bits: User-Driven, Situated, and Dedicated Self-Tracking , 2021, Conference on Designing Interactive Systems.

[11]  Jonathan C. Roberts,et al.  Visualization beyond the Desktop--the Next Big Thing , 2014, IEEE Computer Graphics and Applications.

[12]  Johan Redström,et al.  Informative art: using amplified artworks as information displays , 2000, DARE '00.

[13]  Vassilis Kostakos The big hole in HCI research , 2015, Interactions.

[14]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[15]  M. Sheelagh T. Carpendale,et al.  Personal Visualization and Personal Visual Analytics , 2015, IEEE Transactions on Visualization and Computer Graphics.

[16]  Paul Dourish,et al.  What we talk about when we talk about context , 2004, Personal and Ubiquitous Computing.

[17]  Luigi Gallo,et al.  Situated Visualization in Augmented Reality: Exploring Information Seeking Strategies , 2019, 2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[18]  Sara Ann Wylie,et al.  Chemicals in the Creek: designing a situated data physicalization of open government data with the community , 2020, IEEE Transactions on Visualization and Computer Graphics.

[19]  Manfred Tscheligi,et al.  Enhancing the Shopping Experience with Ambient Displays: A Field Study in a Retail Store , 2007, AmI.

[20]  Andrew Vande Moere,et al.  Street infographics: raising awareness of local issues through a situated urban visualization , 2013, PerDis.

[21]  Ehud Sharlin,et al.  Duopography: using back-of-device multi-touch input to manipulate spatial data on mobile tangible interactive topography , 2017, SIGGRAPH ASIA Mobile Graphics and Interactive Applications.

[22]  Clemens Nylandsted Klokmose,et al.  Situated Sketching and Enactment for Pervasive Displays , 2019, ISS.

[23]  Andrew Vande Moere,et al.  Conveying a civic issue through data via spatially distributed public visualization and polling displays , 2018, NordiCHI.

[24]  Heidrun Schumann,et al.  Visualization of Time-Oriented Data , 2011, Human-Computer Interaction Series.

[25]  Yvonne Rogers,et al.  "Everyone Is Talking about It!": A Distributed Approach to Urban Voting Technology and Visualisations , 2015, CHI.

[26]  María-Jesús Lobo,et al.  OPPORTUNITIES AND CHALLENGES FOR AUGMENTED REALITY SITUATED GEOGRAPHICAL VISUALIZATION , 2020 .

[27]  Paul Dourish,et al.  Re-place-ing space: the roles of place and space in collaborative systems , 1996, CSCW '96.

[28]  George W. Fitzmaurice,et al.  Situated information spaces and spatially aware palmtop computers , 1993, CACM.

[29]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[30]  Liam J. Bannon,et al.  Space, Place and the Design of Technologically-Enhanced Physical Environments , 2005 .

[31]  Andrew Vande Moere,et al.  How the Arrangement of Content and Location Impact the Use of Multiple Distributed Public Displays , 2019, Conference on Designing Interactive Systems.

[32]  Konrad Tollmar,et al.  Virtually living together , 2000, DIS '00.

[33]  Pierre Dragicevic,et al.  Embedded Data Representations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[34]  Pierre Dragicevic,et al.  Opportunities and Challenges for Data Physicalization , 2015, CHI.

[35]  Raimund Dachselt,et al.  Here and Now: Reality-Based Information Retrieval: Perspective Paper , 2018, CHIIR.

[36]  O. Bertelsen,et al.  Activity Theory , 2003 .

[37]  M. Sheelagh T. Carpendale,et al.  Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics , 2016, ISS.

[38]  Lucy A. Suchman,et al.  Plans and Situated Actions: The Problem of Human-Machine Communication (Learning in Doing: Social, , 1987 .

[39]  Susanne Bødker,et al.  'A Farmer, a Place and at least 20 Members': The Development of Artifact Ecologies in Volunteer-based Communities , 2016, CSCW.

[40]  Gerd Kortuem,et al.  Informing the design of situated glyphs for a care facility , 2012, 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC).

[41]  Stephan Freytag,et al.  The Spectrum Of Social Time , 2016 .

[42]  Thomas Pederson,et al.  From Conceptual Links to Causal Relations - Physical-Virtual Artefacts in Mixed-Reality Space , 2003 .

[43]  Beatriz Sousa Santos,et al.  Situated Visualization in The Decision Process Through Augmented Reality , 2019, 2019 23rd International Conference Information Visualisation (IV).

[44]  Danielle Albers Szafir,et al.  HydrogenAR: Interactive Data-Driven Presentation of Dispenser Reliability , 2020, 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[45]  Yvonne Rogers,et al.  VoxBox: A Tangible Machine that Gathers Opinions from the Public at Events , 2015, TEI.

[46]  Andreas Zimmermann,et al.  An Operational Definition of Context , 2007, CONTEXT.

[47]  B. Penders,et al.  Research in the wild , 2007, Nature.

[48]  Robert Elliott,et al.  Descriptive and interpretive approaches to qualitative research , 2005 .

[49]  F. Alallah,et al.  Exploring the Need and Design for Situated Video Analytics , 2020, SUI.

[50]  Huamin Qu,et al.  Augmenting Static Visualizations with PapARVis Designer , 2020, CHI.

[51]  Pauline Gourlet,et al.  Cairn: A Tangible Apparatus for Situated Data Collection, Visualization and Analysis , 2017, Conference on Designing Interactive Systems.

[52]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[53]  Arnaud Prouzeau,et al.  Corsican Twin: Authoring In Situ Augmented Reality Visualisations in Virtual Reality , 2020, AVI.

[54]  Sean White,et al.  Visualization Techniques for Augmented Reality , 2011, Handbook of Augmented Reality.

[55]  Anderson Maciel,et al.  Augmented Situated Visualization for Spatial and Context-Aware Decision-Making , 2020, AVI.

[56]  Stefanie Zollmann,et al.  Smart Vidente: advances in mobile augmented reality for interactive visualization of underground infrastructure , 2013, Personal and Ubiquitous Computing.

[57]  Sean White,et al.  Virtual Vouchers: Prototyping a Mobile Augmented Reality User Interface for Botanical Species Identification , 2006, 3D User Interfaces (3DUI'06).

[58]  Keke Wu,et al.  Designing for Mobile and Immersive Visual Analytics in the Field , 2019, IEEE Transactions on Visualization and Computer Graphics.

[59]  Pierre Dragicevic,et al.  Showing Data About People: A Design Space of Anthropographics , 2020, IEEE Transactions on Visualization and Computer Graphics.

[60]  Ross T. Smith,et al.  Situated Analytics: Demonstrating immersive analytical tools with Augmented Reality , 2016, J. Vis. Lang. Comput..

[61]  A NormanDonald Technology first, needs last , 2010 .

[62]  Albrecht Schmidt,et al.  There is more to context than location , 1999, Comput. Graph..

[63]  Rhys Goldstein,et al.  Designing a Multi-Agent Occupant Simulation System to Support Facility Planning and Analysis for COVID-19 , 2021, Conference on Designing Interactive Systems.

[64]  Y. Tuan Space and Place: Humanistic Perspective , 1979 .

[65]  Geraldine Fitzpatrick The Locales Framework - Understanding and Designing for Wicked Problems , 2003, The Kluwer international series on computer supported cooperative work.

[66]  Ross T. Smith,et al.  Situated Analytics , 2018, Immersive Analytics.

[67]  Johnny Rodgers,et al.  Exploring Ambient and Artistic Visualization for Residential Energy Use Feedback , 2011, IEEE Transactions on Visualization and Computer Graphics.

[68]  Matteo Golfarelli,et al.  A-BI+: A framework for Augmented Business Intelligence , 2020, Inf. Syst..

[69]  Hiroshi Ishii,et al.  Ambient Displays: Turning Architectural Space into an Interface between People and Digital Information , 1998, CoBuild.

[70]  Bernhard Jenny,et al.  Immersive visualization with bar graphics , 2020, Cartography and Geographic Information Science.

[71]  John T. Stasko,et al.  Casual Information Visualization: Depictions of Data in Everyday Life , 2007, IEEE Transactions on Visualization and Computer Graphics.

[72]  Gerd Kortuem,et al.  Exploring the Design Space for Situated Glyphs to Support Dynamic Work Environments , 2011, Pervasive.

[73]  Johanna Beyer,et al.  Towards an Understanding of Situated AR Visualization for Basketball Free-Throw Training , 2021, CHI.

[74]  Jon Bird,et al.  The Pulse of Tidy Street : Measuring and Publicly Displaying Domestic Electricity Consumption , 2010 .

[75]  Yvonne Rogers,et al.  Physikit: Data Engagement Through Physical Ambient Visualizations in the Home , 2016, CHI.

[76]  John T. Stasko,et al.  Personalized Peripheral Information Awareness Through Information Art , 2004, UbiComp.

[77]  Stefanie Zollmann,et al.  VISGIS: Dynamic situated visualization for geographic information systems , 2016, 2016 International Conference on Image and Vision Computing New Zealand (IVCNZ).

[78]  P. Hartvigsen The Computer for the 21st Century (1991) , 2014 .

[79]  Carman Neustaedter,et al.  Time-Turner: Data Engagement Through Everyday Objects in the Home , 2017, Conference on Designing Interactive Systems.

[80]  Jo Vermeulen,et al.  DRAFT VERSION : Sketching and Ideation Activities for Situated Visualization Design , 2019 .

[81]  Norbert A. Streitz,et al.  Hello.Wall - Beyond Ambient Displays , 2003 .

[82]  L. Yardley,et al.  Research Methods for Clinical and Health Psychology , 2003 .

[83]  Andrew Vande Moere,et al.  The Role of Tangible Interaction in Exploring Information on Public Visualization Displays , 2015, PerDis.

[84]  Won-Ki Jeong,et al.  DXR: A Toolkit for Building Immersive Data Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[85]  Mary Beth Rosson,et al.  Wild at Home: The Neighborhood as a Living Laboratory for HCI , 2013, TCHI.

[86]  Nina Valkanova,et al.  Public visualization displays of citizen data: Design, impact and implications , 2014, Int. J. Hum. Comput. Stud..

[87]  Lesandro Ponciano,et al.  Defamiliarization, Representation Granularity, and User Experience: A Qualitative Study with Two Situated Visualizations , 2019, 2019 IEEE Pacific Visualization Symposium (PacificVis).

[88]  Paul Dourish,et al.  Re-space-ing place: "place" and "space" ten years on , 2006, CSCW '06.

[89]  Andrew Vande Moere,et al.  Designing for the Situated and Public Visualization of Urban Data , 2012 .

[90]  Andrew Vande Moere,et al.  Citizen Dialogue Kit: Public Polling and Data Visualization Displays for Bottom-Up Citizen Participation , 2019, Conference on Designing Interactive Systems.

[91]  Myron W. Krueger,et al.  Responsive environments , 1977, AFIPS '77.

[92]  Susanne Bødker,et al.  Through the Interface: A Human Activity Approach To User Interface Design , 1990 .

[93]  Sean White,et al.  Interaction and presentation techniques for shake menus in tangible augmented reality , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[94]  Andrew Vande Moere,et al.  Visualising things. Perspectives on how to make things public through visualisation , 2015 .

[95]  Bruce H. Thomas,et al.  Visualising Environmental Corrosion in Outdoor Augmented Reality , 2011, AUIC.

[96]  Steven K. Feiner,et al.  Situated documentaries: embedding multimedia presentations in the real world , 1999, Digest of Papers. Third International Symposium on Wearable Computers.

[97]  Alexandra Voit,et al.  Revisited: Comparison of Empirical Methods to Evaluate Visualizations Supporting Crafting and Assembly Purposes , 2020, IEEE Transactions on Visualization and Computer Graphics.

[98]  Wesley Willett,et al.  Building with Data: Architectural Models as Inspiration for Data Physicalization , 2017, CHI.

[99]  Ronie Salgado,et al.  Toward Agile Situated Visualization: An Exploratory User Study , 2020, CHI Extended Abstracts.

[100]  Anderson Maciel,et al.  Augmented situated visualization methods towards electromagnetic compatibility testing , 2020, Computers & Graphics.

[101]  Andrew Vande Moere,et al.  The Stakeholder Perspective on Using Public Polling Displays for Civic Engagement , 2021, C&T.

[102]  Maribeth Gandy Coleman,et al.  Participatory Design of STEM Education AR Experiences for Heterogeneous Student Groups: Exploring Dimensions of Tangibility, Simulation, and Interaction , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[103]  Dieter Schmalstieg,et al.  Grand Challenges in Immersive Analytics , 2021, CHI.