Intelligent and Immersive Visual Analytics of Health Data

Massive amounts of health data have been created together with the advent of computer technologies and next generation sequencing technologies. Analytical techniques can significantly aid in the processing, integration and interpretation of the complex data. Visual analytics field has been rapidly evolving together with the advancement in automated analysis methods such as data mining, machine learning and statistics, visualization, and immersive technologies. Although automated analysis processes greatly support the decision making, conservative domains such as medicine, banking, and insurance need trusts on machine learning models. Explainable artificial intelligence could open the black boxes of the machine learning models to improve the trusts for decision makers. Immersive technologies allow the users to engage naturally with the blended reality in where they can look the information in different angles in addition to traditional screens. This chapter reviews and discusses the intelligent visualization, artificial intelligence and immersive technologies in health domain. We also illustrate the ideas with various case studies in genomic data visual analytics.

[1]  A. Mirelman,et al.  Virtual reality for rehabilitation in Parkinson's disease. , 2014, The Cochrane database of systematic reviews.

[2]  Dieter Schmalstieg,et al.  Caleydo: Design and evaluation of a visual analysis framework for gene expression data in its biological context , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[3]  Gennady L. Andrienko,et al.  Intelligent Visualisation and Information Presentation for Civil Crisis Management , 2007, Trans. GIS.

[4]  Katrin Amunts,et al.  Interactive 3D visualization of structural changes in the brain of a person with corticobasal syndrome , 2014, Front. Neuroinform..

[5]  Colin Ware,et al.  Information Visualization: Perception for Design , 2000 .

[6]  David A. Thomas,et al.  The Neurobiology of Virtual Reality Pain Attenuation , 2007, Cyberpsychology Behav. Soc. Netw..

[7]  Oliver G. Staadt,et al.  On Spatial Perception Issues In Augmented Reality Based Immersive Analytics , 2016, ISS Companion.

[8]  Helga Thorvaldsdóttir,et al.  Integrative Genomics Viewer , 2011, Nature Biotechnology.

[9]  Gustavo Saposnik,et al.  واقعیت مجازی برای توانبخشی استروک , 2017 .

[10]  Yi Zhou,et al.  Using Visualization to Illustrate Machine Learning Models for Genomic Data , 2019, ACSW.

[11]  Ulrich Engelke,et al.  Collaborative Framework Design for Immersive Analytics , 2016, 2016 Big Data Visual Analytics (BDVA).

[12]  Mou-Ze Liu,et al.  Application of Machine-Learning Models to Predict Tacrolimus Stable Dose in Renal Transplant Recipients , 2017, Scientific Reports.

[13]  Mary Goldman,et al.  The UCSC Cancer Genomics Browser: update 2015 , 2014, Nucleic Acids Res..

[14]  Xiaodi Huang,et al.  Applying Graph Layout Techniques to Web Information Visualization and Navigation , 2007, Computer Graphics, Imaging and Visualisation (CGIV 2007).

[15]  Dieter Kranzlmuller,et al.  Perspectives for using virtual reality to extend visual data mining in information visualization , 2016, 2016 IEEE Aerospace Conference.

[16]  Hunter G Hoffman,et al.  Virtual reality pain control during burn wound debridement of combat-related burn injuries using robot-like arm mounted VR goggles. , 2011, The Journal of trauma.

[17]  Ali Arya,et al.  DATA-DRIVEN FRAMEWORK FOR AN ONLINE 3D IMMERSIVE ENVIRONMENT FOR EDUCATIONAL APPLICATIONS , 2010 .

[18]  Héctor Corrada Bravo,et al.  Epiviz: interactive visual analytics for functional genomics data , 2014, Nature Methods.

[19]  Yu Qian,et al.  TabuVis: A tool for visual analytics multidimensional datasets , 2013, Science China Information Sciences.

[20]  Anderson Maciel,et al.  Medical imaging VR: can immersive 3D aid in diagnosis? , 2016, VRST.

[21]  Nicholas Polys,et al.  Immersive analytics: Crossing the gulfs with high-performance visualization , 2016, 2016 Workshop on Immersive Analytics (IA).

[22]  Lei Wang,et al.  Research on 3D Visualization of Underground Antique Tomb Based on Augmented Reality , 2013 .

[23]  Atul Sajjanhar,et al.  RNASeqBrowser: A genome browser for simultaneous visualization of raw strand specific RNAseq reads and UCSC genome browser custom tracks , 2015, BMC Genomics.

[24]  Andrea Turolla,et al.  Virtual Reality for Upper Limb Rehabilitation in Subacute and Chronic Stroke: A Randomized Controlled Trial. , 2018, Archives of physical medicine and rehabilitation.

[25]  Mao Lin Huang,et al.  Interactive Visualization for Patient-to-Patient Comparison , 2014, Genomics & informatics.

[26]  Matthew Montebello,et al.  A case study inside virtual worlds: use of analytics for immersive spaces , 2013, LAK '13.

[27]  Jeremy Kepner,et al.  Improving Big Data visual analytics with interactive virtual reality , 2015, 2015 IEEE High Performance Extreme Computing Conference (HPEC).

[28]  David B. Douglas,et al.  Augmented Reality: Advances in Diagnostic Imaging , 2017, Multimodal Technol. Interact..

[29]  Simeon Simoff,et al.  Immersive Intelligence Genomic Data Visualisation , 2019, ACSW.

[30]  Nils J. Nilsson,et al.  The Quest for Artificial Intelligence , 2009 .

[31]  Min Chen,et al.  Glyph-based Visualization: Foundations, Design Guidelines, Techniques and Applications , 2013, Eurographics.

[32]  Nicholas Ho,et al.  Unlocking the complexity of genomic data of RMS patients through visual analytics , 2012, 2012 International Conference on Computerized Healthcare (ICCH).

[33]  Raphael Fuchs,et al.  Visual Human+Machine Learning , 2009, IEEE Transactions on Visualization and Computer Graphics.

[34]  Bennett A Landman,et al.  Immersive virtual reality for visualization of abdominal CT , 2013, Medical Imaging.

[35]  Nicholas Ho,et al.  Visual Analytics of Clinical and Genetic Datasets of Acute Lymphoblastic Leukaemia , 2011, ICONIP.

[36]  Nuria Lopez-Bigas,et al.  Gitools: Analysis and Visualisation of Genomic Data Using Interactive Heat-Maps , 2011, PloS one.

[37]  Quang Vinh Nguyen,et al.  Visual Analytics of Genomic and Cancer Data: A Systematic Review , 2019, Cancer informatics.

[38]  Hamid Rastegari,et al.  Intelligent mining of large-scale bio-data: Bioinformatics applications , 2018 .

[39]  Thomas Ertl,et al.  Interactive Molecular Graphics for Augmented Reality Using HoloLens , 2018, J. Integr. Bioinform..

[40]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[41]  Colin Ware,et al.  Chapter Seven – Space Perception , 2013 .

[42]  Molly E Waring,et al.  Evaluating and selecting mobile health apps: strategies for healthcare providers and healthcare organizations , 2014, Translational behavioral medicine.

[43]  Qian Shan,et al.  Augmented Reality Based Brain Tumor 3D Visualization , 2017, EUSPN/ICTH.

[44]  Emily A. Stevens,et al.  Genomic medicine and targeted therapy for solid tumors , 2015, Journal of surgical oncology.

[45]  N. Ferey,et al.  Immersive Visualization for Genome Exploration and Analysis , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[46]  Joseph J. LaViola,et al.  Immersive VR for Scientific Visualization: A Progress Report , 2000, IEEE Computer Graphics and Applications.

[47]  William Ribarsky,et al.  Visual analytics for complex concepts using a human cognition model , 2008, 2008 IEEE Symposium on Visual Analytics Science and Technology.

[48]  Sameer Singh,et al.  “Why Should I Trust You?”: Explaining the Predictions of Any Classifier , 2016, NAACL.

[49]  Anton J. Enright,et al.  Visualizing genome and systems biology: technologies, tools, implementation techniques and trends, past, present and future , 2015, GigaScience.

[50]  Heikki Lehväslaiho,et al.  Three‐dimensional immersive virtual reality for studying cellular compartments in 3D models from EM preparations of neural tissues , 2015, The Journal of comparative neurology.

[51]  Brendan J. Frey,et al.  Machine Learning in Genomic Medicine: A Review of Computational Problems and Data Sets , 2016, Proceedings of the IEEE.

[52]  Joan Llobera,et al.  Virtual reality for assessment of patients suffering chronic pain: a case study , 2012, Experimental Brain Research.

[53]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[54]  Mel Slater,et al.  Enhancing Our Lives with Immersive Virtual Reality , 2016, Front. Robot. AI.

[55]  Daniel F. Keefe,et al.  Virtual reality for persistent pain: A new direction for behavioral pain management , 2012, PAIN®.

[56]  Silvia Behnke,et al.  Subtype and prognostic classification of rhabdomyosarcoma by immunohistochemistry. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[57]  Quang Vinh Nguyen,et al.  Visual Analytics of Complex Genomics Data to Guide Effective Treatment Decisions , 2016, J. Imaging.

[58]  Aleksandr Ometov,et al.  Visualizing Big Data with augmented and virtual reality: challenges and research agenda , 2015, Journal of Big Data.