Multi-Touch Surfaces and Patient-Specific Data

While the usefulness of 3D visualizations has been shown for a range of clinical applications such as treatment planning it still had difficulties in being adopted in widespread clinical practice. This chapter describes how multi-touch surfaces with patient-specific data have contributed to breaking this barrier, paving the way for adoption into clinical practice and, at the same time, also found widespread use in educational settings and in communication of science to the general public. The key element identified for this adoption is the string of steps found in the full imaging chain, which will be described as an introduction to the topic in this chapter. Emphasis in the chapter is, however, visualization aspects, e.g., intuitive interaction with patient-specific data captured with the latest high speed and high-quality imaging modalities. A necessary starting point for this discussion is the foundations of and state-of-the-art in volumetric rendering, which form the basis for the underlying theory part of the chapter. The chapter presents two use cases. One case is focusing on the use of multi-touch in medical education and the other is focusing on the use of touch surfaces at public venues, such as science centers and museums.

[1]  G. Herman,et al.  Three-dimensional display of human organs from computed tomograms , 1979 .

[2]  Pat Hanrahan,et al.  Volume Rendering , 2020, Definitions.

[3]  Eric P. Lafortune,et al.  Mathematical Models and Monte Carlo Algorithms for Physically Based Rendering , 1995 .

[4]  Nelson L. Max,et al.  Optical Models for Direct Volume Rendering , 1995, IEEE Trans. Vis. Comput. Graph..

[5]  Paul A. Beardsley,et al.  Design galleries: a general approach to setting parameters for computer graphics and animation , 1997, SIGGRAPH.

[6]  Joe Michael Kniss,et al.  Statistically quantitative volume visualization , 2005, VIS 05. IEEE Visualization, 2005..

[7]  Anders Ynnerman,et al.  Full Body Virtual Autopsies using a State-of-the-art Volume Rendering Pipeline , 2006, IEEE Transactions on Visualization and Computer Graphics.

[8]  D. Louis Collins,et al.  A new improved version of the realistic digital brain phantom , 2006, NeuroImage.

[9]  Claes Lundström,et al.  Efficient Medical Volume Visualization : An Approach Based on Domain Knowledge , 2007 .

[10]  Julian L Burton,et al.  Clinical, educational, and epidemiological value of autopsy , 2007, The Lancet.

[11]  Bernhard Preim,et al.  Visualization in Medicine: Theory, Algorithms, and Applications , 2007 .

[12]  Anders Ynnerman,et al.  Uncertainty Visualization in Medical Volume Rendering Using Probabilistic Animation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[13]  Timo Ropinski,et al.  Interactive Volume Rendering with Dynamic Ambient Occlusion and Color Bleeding , 2008, Comput. Graph. Forum.

[14]  Anders Ynnerman,et al.  Interactive Global Light Propagation in Direct Volume Rendering using Local Piecewise Integration , 2008, VG/PBG@SIGGRAPH.

[15]  Anders Ynnerman,et al.  Local Ambient Occlusion in Direct Volume Rendering , 2010, IEEE Transactions on Visualization and Computer Graphics.

[16]  Pere-Pau Vázquez,et al.  Real-time ambient occlusion and halos with Summed Area Tables , 2010, Comput. Graph..

[17]  Osman Ratib,et al.  A lung segmentectomy performed with 3D reconstruction images available on the operating table with an iPad. , 2011, Interactive cardiovascular and thoracic surgery.

[18]  Anders Ynnerman,et al.  Multi-Touch Table System for Medical Visualization: Application to Orthopedic Surgery Planning , 2011, IEEE Transactions on Visualization and Computer Graphics.

[19]  Anders Ynnerman,et al.  Efficient Visibility Encoding for Dynamic Illumination in Direct Volume Rendering , 2012, IEEE Transactions on Visualization and Computer Graphics.

[20]  Timo Ropinski,et al.  Historygrams: Enabling Interactive Global Illumination in Direct Volume Rendering using Photon Mapping , 2012, IEEE Transactions on Visualization and Computer Graphics.

[21]  Charl P. Botha,et al.  Exposure Render: An Interactive Photo-Realistic Volume Rendering Framework , 2012, PloS one.

[22]  Mary Czerwinski,et al.  Co-Located Collaborative Visual Analytics around a Tabletop Display , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  P. Ljung,et al.  State‐of‐the‐art of visualization in post‐mortem imaging , 2012, APMIS : acta pathologica, microbiologica, et immunologica Scandinavica.

[24]  Timo Ropinski,et al.  A Survey of Volumetric Illumination Techniques for Interactive Volume Rendering , 2014, Comput. Graph. Forum.

[25]  Timo Ropinski,et al.  Interaction techniques as a communication channel when presenting 3D visualizations , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[26]  Thomas Schultz,et al.  Learning Probabilistic Transfer Functions: A Comparative Study of Classifiers , 2015, Comput. Graph. Forum.

[27]  Tanya M. Custer,et al.  The Utilization of the Anatomage Virtual Dissection Table in theEducation of Imaging Science Students , 2015 .

[28]  Anders Ynnerman,et al.  Interactive visualization of 3d scanned mummies at public venues , 2016, Commun. ACM.

[29]  Jens H. Krüger,et al.  State of the Art in Transfer Functions for Direct Volume Rendering , 2016, Comput. Graph. Forum.

[30]  Dorin Comaniciu,et al.  Shaping the Future through Innovations: From Medical Imaging to Precision Medicine , 2016, Medical Image Anal..

[31]  Martin Falk,et al.  Intuitive Exploration of Volumetric Data Using Dynamic Galleries , 2016, IEEE Transactions on Visualization and Computer Graphics.

[32]  Baiyu Chen,et al.  Evaluation of conventional imaging performance in a research whole-body CT system with a photon-counting detector array , 2016, Physics in medicine and biology.

[33]  Daniel Jönsson,et al.  Linköping Studies in Science and Technology. Dissertation, No. 1789 Enhancing Salient Features in Volumetric Data Using Illumination and Transfer Functions Enhancing Salient Features in Volumetric Data Using Illumination and Transfer Functions Jönsson and A. Ynnerman. Correlated Photon Mapping for I , 2022 .

[34]  Tobias Isenberg Interactive Exploration of Three-Dimensional Scientific Visualizations on Large Display Surfaces , 2016, Collaboration Meets Interactive Spaces.

[35]  Anders Ynnerman,et al.  Correlated Photon Mapping for Interactive Global Illumination of Time-Varying Volumetric Data , 2017, IEEE Transactions on Visualization and Computer Graphics.

[36]  T. C. Singel,et al.  A comparative study of learning with “anatomage” virtual dissection table versus traditional dissection method in neuroanatomy , 2017 .

[37]  Savvas Nicolaou,et al.  A Golden Opportunity for Radiologists: Bringing Clinical Relevance to Undergraduate Anatomy through Virtual Dissection , 2017, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[38]  Anique B. H. de Bruin,et al.  Is there a superior simulator for human anatomy education? How virtual dissection can overcome the anatomic and pedagogic limitations of cadaveric dissection , 2018, Medical teacher.

[39]  Bernhard Preim,et al.  A survey of virtual human anatomy education systems , 2018, Comput. Graph..

[40]  Jesús García Martín,et al.  Possibilities for the use of Anatomage (the Anatomical Real Body-Size Table) for Teaching and Learning Anatomy with the Students , 2018 .

[41]  Anders Ynnerman,et al.  Exploranation: A New Science Communication Paradigm , 2018, IEEE Computer Graphics and Applications.

[42]  Anique B. H. de Bruin,et al.  Virtual Dissection with Clinical Radiology Cases Provides Educational Value to First Year Medical Students. , 2019, Academic radiology.

[43]  Amy L Wilson-Delfosse,et al.  Evaluating the Anatomage Table Compared to Cadaveric Dissection as a Learning Modality for Gross Anatomy , 2019, Medical Science Educator.

[44]  Dzintra Kazoka,et al.  3D dissection tools in Anatomage supported interactive human anatomy teaching and learning , 2019, SHS Web of Conferences.