Facts, Interactivity and Videotape: Exploring the Design Space of Data in Interactive Video Storytelling

We live in a society that is increasingly data rich, with an unprecedented amount of information being captured, stored and analysed about our lives and the people we share them with. We explore the relationship between this new data and emergent forms of interactive video storytelling. In particular we ask: i) how can interactive video storytelling techniques be employed to provide accessible, informative and pleasurable ways for people to engage with data; and ii) how can data be used by the creators of interactive video stories to meet expressive goals and support new forms of experience? We present an analysis of 43 interactive videos that use data in a noteworthy fashion. This analysis reveals a design space comprising key techniques for telling engaging interactive video stories with and about data. To conclude, we discuss challenges relating to the production and consumption of such content and make recommendations for future research.

[1]  Matthew Chalmers,et al.  Personal tracking as lived informatics , 2014, CHI.

[2]  Jon Froehlich,et al.  Personal informatics in practice: improving quality of life through data , 2012, CHI Extended Abstracts.

[3]  Bruce Sterling,et al.  COVER STORYDesign fiction , 2009, INTR.

[4]  Wanda Pratt,et al.  Understanding quantified-selfers' practices in collecting and exploring personal data , 2014, CHI.

[5]  Paul Ashton.  The Calling Card Script: A Writer's Toolbox for Screen, Stage and Radio , 2011 .

[6]  Jon Yorke.  Into the woods : how stories work and why we tell them , 2014 .

[7]  Justin M. Rao,et al.  Filter Bubbles, Echo Chambers, and Online News Consumption , 2016 .

[8]  Frank Melchior,et al.  Object-based broadcasting - curation, responsiveness and user experience , 2014 .

[9]  深度.  Do Not Track真的有用吗 , 2013 .

[10]  Paul Coulton,et al.  Perceptive Media - Adaptive Storytelling for Digital Broadcast , 2015, INTERACT.

[11]  Steve. Poole.  Unspeak: Words Are Weapons , 2007 .

[12]  Nigel Shadbolt,et al.  Network Effect , 2020, The Blackwell Encyclopedia of Sociology.

[13]  Ben Shneiderman,et al.  Improving Healthcare with Interactive Visualization , 2013, Computer.

[14]  James K. Scarborough,et al.  Leveraging the engagement of games to change energy behavior , 2012, 2012 International Conference on Collaboration Technologies and Systems (CTS).

[15]  Jonathan Hook,et al.  Volvelles, domes and wristbands: embedding digital fabrication within a visitor's trajectory of engagement , 2014, Conference on Designing Interactive Systems.

[16]  Michael Eisenberg,et al.  Towards the crafting of personal health technologies , 2014, Conference on Designing Interactive Systems.

[17]  P. Seeberger.  Land of opportunity. , 2009, ACS chemical biology.

[18]  Ron Wakkary,et al.  Design fictions , 2012, TEI.

[19]  Tiffany Holmes,et al.  Eco-visualization: combining art and technology to reduce energy consumption , 2007, C&C '07.

[20]  James A. Hendler,et al.  Visualization tools for open government data , 2013, DG.O.

[21]  Patrick Olivier,et al.  Media of Things: Supporting the Production of Metadata Rich Media Through IoT Sensing , 2018, CHI.

[22]  M. Goodman.  Real Emotional Logic: Film and Television Docudrama as Persuasive Practice , 2006 .

[23]  Jonathan Hook,et al.  Enabling Polyvocality in Interactive Documentaries through "Structural Participation" , 2017, CHI.

[24]  Hamed Haddadi,et al.  Personal Data: Thinking Inside the Box , 2015, Aarhus Conference on Critical Alternatives.

[25]  Michael S. Horn,et al.  The DeepTree Exhibit: Visualizing the Tree of Life to Facilitate Informal Learning , 2012, IEEE Transactions on Visualization and Computer Graphics.

[26]  Christophe Hurter,et al.  Understanding Data Videos: Looking at Narrative Visualization through the Cinematography Lens , 2015, CHI.

[27]  Kate Nash,et al.  Goa Hippy Tribe: Theorising Documentary Content on a Social Network Site , 2012 .

[28]  Jodi Forlizzi,et al.  A stage-based model of personal informatics systems , 2010, CHI.

[29]  Uichin Lee,et al.  Exploring UX issues in Quantified Self technologies , 2015, 2015 Eighth International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[30]  Ian Li,et al.  Personal informatics & context: Using context to reveal factors that affect behavior , 2011, J. Ambient Intell. Smart Environ..

[31]  Michael Gurstein,et al.  Open data: Empowering the empowered or effective data use for everyone? , 2011, First Monday.

[32]  Joseph Lindley,et al.  A machine learning: an example of HCI prototyping with design fiction , 2014, NordiCHI.

[33]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[34]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[35]  Anh Duc Duong,et al.  Addressing cold-start problem in recommendation systems , 2008, ICUIMC '08.

[36]  Andra Leurdijk,et al.  Interactive TV narratives: Opportunities, progress, and challenges , 2008, TOMCCAP.

[37]  Yannis Charalabidis,et al.  Benefits, Adoption Barriers and Myths of Open Data and Open Government , 2012, Inf. Syst. Manag..

[38]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[39]  Maxat Kassen,et al.  A promising phenomenon of open data: A case study of the Chicago open data project , 2013, Gov. Inf. Q..