Towards Narrative Medical Visualization

Narrative visualization aims to communicate scientific results to a general audience and garners significant attention in various applications. Merging exploratory and explanatory visualization could effectively support non-expert understanding of scientific processes. Medical research results, e.g., mechanisms of the healthy human body, explanations of pathological processes, or avoidable risk factors for diseases, are also interesting to a general audience that includes patients and their relatives. This paper discusses how narrative techniques can be applied to medical visualization to tell data-driven stories about diseases. We address the general public comprising people interested in medicine without specific medical background knowledge. We derived a general template for the narrative medical visualization of diseases. Applying this template to three diseases selected to span bone, vascular, and organ system, we discuss how narrative techniques can support visual communication and facilitate understanding of medical data. Other scientists can adapt our proposed template to inform an audience on other diseases. With our work, we show the potential of narrative medical visualization and conclude with a comprehensive research agenda. CCS Concepts • Applied computing → Life and medical sciences; • Human-centered computing → Visualization;

[1]  Hanspeter Pfister,et al.  Beyond Memorability: Visualization Recognition and Recall , 2016, IEEE Transactions on Visualization and Computer Graphics.

[2]  Li Jin,et al.  The trends in incidence of primary liver cancer caused by specific etiologies: Results from the Global Burden of Disease Study 2016 and implications for liver cancer prevention. , 2019, Journal of hepatology.

[3]  Sunmoo Yoon,et al.  Sometimes more is more: iterative participatory design of infographics for engagement of community members with varying levels of health literacy , 2016, J. Am. Medical Informatics Assoc..

[4]  Anders Ynnerman,et al.  Interactive visualization of 3d scanned mummies at public venues , 2016, Commun. ACM.

[5]  Ana Figueiras,et al.  How to Tell Stories Using Visualization , 2014, 2014 18th International Conference on Information Visualisation.

[6]  C. Oppenheim,et al.  Unruptured intracranial aneurysms: An updated review of current concepts for risk factors, detection and management. , 2017, Revue neurologique.

[7]  Robert S. Laramee,et al.  Storytelling and Visualization: An Extended Survey , 2018, Inf..

[8]  Bongshin Lee,et al.  Visual Narrative Flow: Exploring Factors Shaping Data Visualization Story Reading Experiences , 2017, Comput. Graph. Forum.

[9]  Ana Figueiras,et al.  Narrative Visualization: A Case Study of How to Incorporate Narrative Elements in Existing Visualizations , 2014, 2014 18th International Conference on Information Visualisation.

[10]  Nicholas Diakopoulos,et al.  Visualization Rhetoric: Framing Effects in Narrative Visualization , 2011, IEEE Transactions on Visualization and Computer Graphics.

[11]  Alejandro F. Frangi,et al.  The Role of Computational Fluid Dynamics in the Management of Unruptured Intracranial Aneurysms: A Clinicians' View , 2009, Comput. Intell. Neurosci..

[12]  Ivan Viola,et al.  Visual Abstraction , 2019, Foundations of Data Visualization.

[13]  Rickichard Izzo,et al.  The Vascular Modeling Toolkit: A Python Library for the Analysis of Tubular Structures in Medical Images , 2018, J. Open Source Softw..

[14]  Thomas Ertl,et al.  From Visualization Research to Public Presentation - Design and Realization of a Scientific Exhibition , 2017, SIGRAD.

[15]  L. Gravitz Liver cancer , 2014, Nature.

[16]  Jean-Daniel Fekete,et al.  Storytelling in Information Visualizations: Does it Engage Users to Explore Data? , 2015, CHI.

[17]  Jeffrey Heer,et al.  Narrative Visualization: Telling Stories with Data , 2010, IEEE Transactions on Visualization and Computer Graphics.

[18]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[19]  Shriti Singh,et al.  Challenges in liver cancer and possible treatment approaches. , 2020, Biochimica et biophysica acta. Reviews on cancer.

[20]  Konrad J. Schönborn,et al.  What Biological Visualizations Do Science Center Visitors Prefer in an Interactive Touch Table? , 2018, Education Sciences.

[21]  Eduard Groeller,et al.  HyperLabels: Browsing of Dense and Hierarchical Molecular 3D Models , 2020, IEEE Transactions on Visualization and Computer Graphics.

[22]  Sung-Hee Kim,et al.  Towards a Taxonomy for Evaluating User Engagement in Information Visualization , 2015 .

[23]  Bongshin Lee,et al.  Emerging and Recurring Data-Driven Storytelling Techniques: Analysis of a Curated Collection of Recent Stories , 2016 .

[24]  Elmar Eisemann,et al.  The Online Anatomical Human: Web-based Anatomy Education , 2016, Eurographics.

[25]  Niklas Elmqvist,et al.  A Taxonomy of 3D Occlusion Management for Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[26]  Anders Ynnerman,et al.  Reaching Broad Audiences in an Educational Setting , 2020, Foundations of Data Visualization.

[27]  Helwig Hauser,et al.  Story Telling for Presentation in Volume Visualization , 2007, EuroVis.

[28]  Kai Lawonn,et al.  PelVis: Atlas-based Surgical Planning for Oncological Pelvic Surgery , 2017, IEEE Transactions on Visualization and Computer Graphics.

[29]  Michael Wohlfart,et al.  Story Telling Aspects in Medical Applications , 2006 .

[30]  Jock D. Mackinlay,et al.  Storytelling: The Next Step for Visualization , 2013, Computer.

[31]  Anders Ynnerman,et al.  Reflections on Visualization for Broad Audiences , 2020, Foundations of Data Visualization.

[32]  Nahum Gershon,et al.  What storytelling can do for information visualization , 2001, Commun. ACM.

[33]  H. Peitgen,et al.  HepaVision2 — a software assistant for preoperative planning in living-related liver transplantation and oncologic liver surgery , 2002 .

[34]  I. Saito [Unruptured intracranial aneurysms]. , 2004, No to shinkei = Brain and nerve.

[35]  J. Gurney,et al.  Pelvic Fracture Care. , 2018, Military medicine.

[36]  Michael Böttinger Reaching Broad Audiences from a Research Institute Setting , 2020, Foundations of Data Visualization.

[37]  Bernhard Preim,et al.  Survey of Labeling Techniques in Medical Visualizations , 2014, VCBM.

[38]  Alexander Bock,et al.  OpenSpace: A System for Astrographics , 2020, IEEE Transactions on Visualization and Computer Graphics.

[39]  Ivan Viola,et al.  Interactively illustrating polymerization using three-level model fusion , 2014, BMC Bioinformatics.

[40]  Kwan-Liu Ma,et al.  Scientific Storytelling Using Visualization , 2012, IEEE Computer Graphics and Applications.

[41]  Alexander Bock,et al.  Reaching Broad Audiences from a Science Center or Museum Setting , 2020, Foundations of Data Visualization.

[42]  Anders Ynnerman,et al.  Exploranation: A New Science Communication Paradigm , 2018, IEEE Computer Graphics and Applications.

[43]  Fabio Crameri,et al.  The misuse of colour in science communication , 2020, Nature Communications.

[44]  M. Sheelagh T. Carpendale,et al.  More Than Telling a Story: Transforming Data into Visually Shared Stories , 2015, IEEE Computer Graphics and Applications.

[45]  David A Steinman,et al.  The Computational Fluid Dynamics Rupture Challenge 2013--Phase II: Variability of Hemodynamic Simulations in Two Intracranial Aneurysms. , 2015, Journal of biomechanical engineering.

[46]  Anders Ynnerman,et al.  Challenges and Open Issues in Visualization for Broad Audiences , 2020, Foundations of Data Visualization.

[47]  Bernhard Preim,et al.  A survey of medical animations , 2020, Comput. Graph..