Cohort-based T-SSIM Visual Computing for Radiation Therapy Prediction and Exploration

We describe a visual computing approach to radiation therapy (RT) planning, based on spatial similarity within a patient cohort. In radiotherapy for head and neck cancer treatment, dosage to organs at risk surrounding a tumor is a large cause of treatment toxicity. Along with the availability of patient repositories, this situation has lead to clinician interest in understanding and predicting RT outcomes based on previously treated similar patients. To enable this type of analysis, we introduce a novel topology-based spatial similarity measure, T-SSIM, and a predictive algorithm based on this similarity measure. We couple the algorithm with a visual steering interface that intertwines visual encodings for the spatial data and statistical results, including a novel parallel-marker encoding that is spatially aware. We report quantitative results on a cohort of 165 patients, as well as a qualitative evaluation with domain experts in radiation oncology, data management, biostatistics, and medical imaging, who are collaborating remotely.

[1]  G. Elisabeta Marai,et al.  MOSBIE: a tool for comparison and analysis of rule-based biochemical models , 2014, BMC Bioinformatics.

[2]  Jimeng Sun,et al.  Integrating Distance Metrics Learned from Multiple Experts and its Application in Inter-Patient Similarity Assessment , 2011, SDM.

[3]  Jeffrey Heer,et al.  D³ Data-Driven Documents , 2011, IEEE Transactions on Visualization and Computer Graphics.

[4]  Torsten Kuhlen,et al.  VisNEST — Interactive analysis of neural activity data , 2013, 2013 IEEE Symposium on Biological Data Visualization (BioVis).

[5]  Marco Nolden,et al.  The Medical Imaging Interaction Toolkit , 2004, Medical Image Anal..

[6]  Yao Sun,et al.  RuleBender: integrated modeling, simulation and visualization for rule-based intracellular biochemistry , 2012, BMC Bioinformatics.

[7]  Cigdem Demir,et al.  The cell graphs of cancer , 2004, ISMB/ECCB.

[8]  G. Elisabeta Marai,et al.  RemBrain: Exploring Dynamic Biospatial Networks with Mosaic Matrices and Mirror Glyphs , 2017, Visualization and Data Analysis.

[9]  K. Ramani,et al.  Three-dimensional shape searching : state-ofthe-art review and future trends , 2005 .

[10]  Wes McKinney,et al.  Data Structures for Statistical Computing in Python , 2010, SciPy.

[11]  David Dagan Feng,et al.  Content-Based Medical Image Retrieval: A Survey of Applications to Multidimensional and Multimodality Data , 2013, Journal of Digital Imaging.

[12]  Anis Sharafoddini,et al.  Patient Similarity in Prediction Models Based on Health Data: A Scoping Review , 2017, JMIR medical informatics.

[13]  Euripides G. M. Petrakis,et al.  Similarity Searching in Medical Image Databases , 1997, IEEE Trans. Knowl. Data Eng..

[14]  G. Elisabeta Marai,et al.  Activity-Centered Domain Characterization for Problem-Driven Scientific Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[15]  Yaxing Wei,et al.  Visual Reconciliation of Alternative Similarity Spaces in Climate Modeling , 2014, IEEE Transactions on Visualization and Computer Graphics.

[16]  Markus Hadwiger,et al.  NeuroBlocks – Visual Tracking of Segmentation and Proofreading for Large Connectomics Projects , 2016, IEEE Transactions on Visualization and Computer Graphics.

[17]  S. Webb Optimizing the planning of intensity-modulated radiotherapy. , 1994, Physics in medicine and biology.

[18]  Laurence E Court,et al.  Dose to larynx predicts for swallowing complications after intensity-modulated radiotherapy. , 2008, International journal of radiation oncology, biology, physics.

[19]  David H. Laidlaw,et al.  Exploring 3D DTI Fiber Tracts with Linked 2D Representations , 2009, IEEE Transactions on Visualization and Computer Graphics.

[20]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[21]  Kresimir Matkovic,et al.  An integrated visual analysis system for fusing MR spectroscopy and multi-modal radiology imaging , 2014, 2014 IEEE Conference on Visual Analytics Science and Technology (VAST).

[22]  Marcel Breeuwer,et al.  Visual Analysis of Tumor Control Models for Prediction of Radiotherapy Response , 2016, Comput. Graph. Forum.

[23]  Eduard Gröller,et al.  World Lines , 2010, IEEE Transactions on Visualization and Computer Graphics.

[24]  Linda G. Shapiro,et al.  Classifying craniosynostosis deformations by skull shape imaging , 2005, 18th IEEE Symposium on Computer-Based Medical Systems (CBMS'05).

[25]  Daniel Patel,et al.  A virtual reality solution for evaluation of radiotherapy plans. , 2007, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[26]  Klaus Mueller,et al.  Conjoint Analysis to Measure the Perceived Quality in Volume Rendering , 2007, IEEE Transactions on Visualization and Computer Graphics.

[27]  Stephanie Evergreen,et al.  Design Principles for Data Visualization in Evaluation , 2013 .

[28]  T. Lumley,et al.  PRINCIPAL COMPONENT ANALYSIS AND FACTOR ANALYSIS , 2004, Statistical Methods for Biomedical Research.

[29]  R Mohan,et al.  Conformal radiation treatment of prostate cancer using inversely-planned intensity-modulated photon beams produced with dynamic multileaf collimation. , 1996, International journal of radiation oncology, biology, physics.

[30]  G. Elisabeta Marai,et al.  GRACE: A Visual Comparison Framework for Integrated Spatial and Non-Spatial Geriatric Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[31]  Steve B. Jiang,et al.  3D radiotherapy dose prediction on head and neck cancer patients with a hierarchically densely connected U-net deep learning architecture , 2018, Physics in medicine and biology.

[32]  Jonathan G. Li,et al.  Unnecessary laryngeal irradiation in the IMRT era , 2004, Head & neck.

[33]  Jianying Hu,et al.  Towards Personalized Medicine: Leveraging Patient Similarity and Drug Similarity Analytics , 2014, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[34]  Eduard Gröller,et al.  Bladder Runner: Visual Analytics for the Exploration of RT‐Induced Bladder Toxicity in a Cohort Study , 2018, Comput. Graph. Forum.

[35]  T. Williams,et al.  Immersive Visualization with Automated Collision Detection for Radiotherapy Treatment Planning , 2007, MMVR.

[36]  C. Compton,et al.  AJCC Cancer Staging Manual , 2002, Springer New York.

[37]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[38]  Maureen C. Stone,et al.  Whisper, Don't Scream: Grids and Transparency , 2011, IEEE Transactions on Visualization and Computer Graphics.

[39]  Markus Hadwiger,et al.  ConnectomeExplorer: Query-Guided Visual Analysis of Large Volumetric Neuroscience Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[40]  Thomas G. Dietterich,et al.  Facilitating testing and debugging of Markov Decision Processes with interactive visualization , 2015, VL/HCC.

[41]  Ming Ouhyoung,et al.  On Visual Similarity Based 3D Model Retrieval , 2003, Comput. Graph. Forum.

[42]  Joseph O. Deasy,et al.  Radiation dose-volume effects in the esophagus. , 2010, International journal of radiation oncology, biology, physics.

[43]  Natasha M. Maurits,et al.  Eurographics/ Ieee-vgtc Symposium on Visualization (2007) Functional Unit Maps for Data-driven Visualization of High-density Eeg Coherence , 2022 .

[44]  Jatinder R Palta,et al.  Intensity-modulated radiotherapy in the standard management of head and neck cancer: promises and pitfalls. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[45]  Edward R. Tufte,et al.  Envisioning Information , 1990 .

[46]  Eduard Gröller,et al.  Visual Analysis and Steering of Flooding Simulations , 2013, IEEE Transactions on Visualization and Computer Graphics.

[47]  Chris R. Johnson Top Scientific Visualization Research Problems , 2004, IEEE Computer Graphics and Applications.

[48]  Daniel S. Margulies,et al.  Three-Dimensional Mean-Shift Edge Bundling for the Visualization of Functional Connectivity in the Brain , 2012, IEEE Transactions on Visualization and Computer Graphics.

[49]  Philippe Lambin,et al.  Functional MRI for radiotherapy dose painting. , 2012, Magnetic resonance imaging.

[50]  I. Jolliffe Principal Component Analysis and Factor Analysis , 1986 .

[51]  Linda G. Shapiro,et al.  HEAD AND NECK CANCER PATIENT SIMILARITY BASED ON ANATOMICAL STRUCTURAL GEOMETRY , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[52]  Natasha M. Maurits,et al.  Data-Driven Visualization and Group Analysis of Multichannel EEG Coherence with Functional Units , 2008, IEEE Transactions on Visualization and Computer Graphics.

[53]  Denis Gracanin,et al.  ComVis: A Coordinated Multiple Views System for Prototyping New Visualization Technology , 2008, 2008 12th International Conference Information Visualisation.

[54]  G. Elisabeta Marai,et al.  Precision Risk Analysis of Cancer Therapy with Interactive Nomograms and Survival Plots , 2019, IEEE Transactions on Visualization and Computer Graphics.

[55]  W. H. Swann A survey of non‐linear optimization techniques , 1969, FEBS letters.

[56]  I El Naqa,et al.  Dose response explorer: an integrated open-source tool for exploring and modelling radiotherapy dose–volume outcome relationships , 2006, Physics in medicine and biology.

[57]  G. Elisabeta Marai Visual Scaffolding in Integrated Spatial and Nonspatial Analysis , 2015, EuroVA@EuroVis.

[58]  Kenney Ng,et al.  Clustervision: Visual Supervision of Unsupervised Clustering , 2018, IEEE Transactions on Visualization and Computer Graphics.

[59]  Jeffrey Heer,et al.  SpanningAspectRatioBank Easing FunctionS ArrayIn ColorIn Date Interpolator MatrixInterpola NumObjecPointI Rectang ISchedu Parallel Pause Scheduler Sequen Transition Transitioner Transiti Tween Co DelimGraphMLCon IData JSONCon DataField DataSc Dat DataSource Data DataUtil DirtySprite LineS RectSprite , 2011 .

[60]  Karen B. Schloss,et al.  Mapping Color to Meaning in Colormap Data Visualizations , 2019, IEEE Transactions on Visualization and Computer Graphics.