The Challenges of Using Biodata in Promotional Filmmaking

We present a study of how filmmakers collected and visualized physiological data—“biodata”—to construct a series of short promotional films depicting people undergoing “thrilling” experiences. Drawing on ethnographic studies of two major advertising campaigns, we highlight key concerns for integrating sensors and sensor data into film production. Our findings address the perceived benefits of using biodata within narratives; the nature of different on-screen representations of biodata; and the challenges presented when integrating biodata into production processes. Drawing on this, we reconsider the nature of information visualization in the filmmaking context. Further implications from our case studies provide recommendations for human--computer interaction (HCI) collaborations with filmmaking and broadcast industries, focusing both on the practical matters of fitting sensor technologies into and handling data within production workflows, as well as discussing the broader implications for managing the veracity of that data within professional media production.

[1]  Christian Licoppe,et al.  The collaborative work of producing meaningful shots in mobile video telephony , 2009, Mobile HCI.

[2]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[3]  Yvonne Rogers,et al.  Introduction to the Special Issue of “The Turn to The Wild” , 2013, TCHI.

[4]  Kristina Höök,et al.  A foundation for emotional expressivity , 2005, DUX '05.

[5]  Martin Wattenberg,et al.  Artistic Data Visualization: Beyond Visual Analytics , 2007, HCI.

[6]  Joe Marshall,et al.  The machine in the ghost: augmenting broadcasting with biodata , 2012, CHI EA '12.

[7]  Stefan Rennick Egglestone,et al.  Performing thrill: designing telemetry systems and spectator interfaces for amusement rides , 2008, CHI.

[8]  Kristina Höök,et al.  Mind the body!: designing a mobile stress management application encouraging personal reflection , 2010, Conference on Designing Interactive Systems.

[9]  Daniel A. Keim,et al.  Challenges in Visual Data Analysis , 2006, Tenth International Conference on Information Visualisation (IV'06).

[10]  Huiru Zheng,et al.  Visualization of data for ambient assisted living services , 2011, IEEE Communications Magazine.

[11]  David W. McDonald,et al.  Goal-setting considerations for persuasive technologies that encourage physical activity , 2009, Persuasive '09.

[12]  Alice Twemlow,et al.  AIGA (American Institute of Graphic Arts), AIGA National Conferences, and AIGA Medal (1914–) , 2016 .

[13]  K. Gegenfurtner,et al.  Design Issues in Gaze Guidance Under review with ACM Transactions on Computer Human Interaction , 2009 .

[14]  Jeffrey Heer,et al.  Balancing exertion experiences , 2012, CHI.

[15]  Stefan Rennick Egglestone,et al.  Breath control of amusement rides , 2011, CHI.

[16]  Patrick Olivier,et al.  StoryCrate: tabletop storyboarding for live film production , 2012, CHI.

[17]  David A. Shamma,et al.  Live mobile collaboration for video production: design, guidelines, and requirements , 2013, Personal and Ubiquitous Computing.

[18]  Carl Gutwin,et al.  Useful junk?: the effects of visual embellishment on comprehension and memorability of charts , 2010, CHI.

[19]  Phoebe Sengers,et al.  Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight , 2011, CHI.

[20]  Mark J. Perry,et al.  Temporal hybridity: footage with instant replay in real time , 2010, CHI.

[21]  Steve Benford,et al.  A conversation between trees: what data feels like in the forest , 2013, CHI.

[22]  E. Tufte Beautiful Evidence , 2006 .

[23]  M. Sheelagh T. Carpendale,et al.  Critical InfoVis: exploring the politics of visualization , 2013, CHI Extended Abstracts.

[24]  Oskar Juhlin,et al.  Context-dependent software solutions to handle video synchronization and delay in collaborative live mobile video production , 2014, Personal and Ubiquitous Computing.

[25]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[26]  Larissa Hjorth,et al.  Understanding physical activity through 3D printed material artifacts , 2014, CHI.

[27]  Mark J. Perry,et al.  Lean collaboration through video gestures: co-ordinating the production of live televised sport , 2009, CHI.

[28]  Mark J. Perry,et al.  Amateur vision and recreational orientation:: creating live video together , 2012, CSCW '12.

[29]  Patrick Olivier,et al.  Facilitating TV production using StoryCrate , 2013, Creativity & Cognition.

[30]  Kristina Höök,et al.  Knowing, Communication and Experiencing through Body and Emotion , 2008, IEEE Trans. Learn. Technol..

[31]  Paul Dourish,et al.  How emotion is made and measured , 2007, Int. J. Hum. Comput. Stud..

[32]  Andrew Vande Moere,et al.  Guiding the Viewer's Imagination: How Visual Rhetorical Figures Create Meaning in Animated Infographics , 2009, 2009 13th International Conference Information Visualisation.

[33]  John Rooksby,et al.  Wild in the Laboratory: A Discussion of Plans and Situated Actions , 2013, TCHI.

[34]  Stefan Rennick Egglestone,et al.  Performance-Led Research in the Wild , 2013, TCHI.

[35]  Perttu Hämäläinen,et al.  Using heart rate to control an interactive game , 2007, CHI.

[36]  Niloofar Dezfuli,et al.  CoStream: in-situ co-construction of shared experiences through mobile video sharing during live events , 2012, CHI EA '12.

[37]  Alexandra Weilenmann,et al.  Mobile video literacy: negotiating the use of a new visual technology , 2014, Personal and Ubiquitous Computing.

[38]  C Nold Emotional Cartography: Technologies of the Self , 2009 .