CECAV-DNN: Collective Ensemble Comparison and Visualization using Deep Neural Networks

Abstract We propose a deep learning approach to collectively compare two or multiple ensembles, each of which is a collection of simulation outputs. The purpose of collective comparison is to help scientists understand differences between simulation models by comparing their ensemble simulation outputs. However, the collective comparison is non-trivial because the spatiotemporal distributions of ensemble simulation outputs reside in a very high dimensional space. To this end, we choose to train a deep discriminative neural network to measure the dissimilarity between two given ensembles, and to identify when and where the two ensembles are different. We also design and develop a visualization system to help users understand the collective comparison results based on the discriminative network. We demonstrate the effectiveness of our approach with two real-world applications, including the ensemble comparison of the community atmosphere model (CAM) and the rapid radiative transfer model for general circulation models (RRTMG) for climate research, and the comparison of computational fluid dynamics (CFD) ensembles with different spatial resolutions.

[1]  Ayan Biswas,et al.  Efficient Local Histogram Searching via Bitmap Indexing , 2015, Comput. Graph. Forum.

[2]  Xiaotong Liu,et al.  Visualization of Time-Varying Weather Ensembles across Multiple Resolutions , 2017, IEEE Transactions on Visualization and Computer Graphics.

[3]  David Lopez-Paz,et al.  Revisiting Classifier Two-Sample Tests , 2016, ICLR.

[4]  Yun Qian,et al.  Some issues in uncertainty quantification and parameter tuning: a case study of convective parameterization scheme in the WRF regional climate model , 2011 .

[5]  Rüdiger Westermann,et al.  Streamline Variability Plots for Characterizing the Uncertainty in Vector Field Ensembles , 2016, IEEE Transactions on Visualization and Computer Graphics.

[6]  Barnabás Póczos,et al.  Nonparametric Divergence Estimation with Applications to Machine Learning on Distributions , 2011, UAI.

[7]  Kenneth I. Joy,et al.  Modality-Driven Classification and Visualization of Ensemble Variance , 2016, IEEE Transactions on Visualization and Computer Graphics.

[8]  Alireza Entezari,et al.  Isosurface Visualization of Data with Nonparametric Models for Uncertainty , 2016, IEEE Transactions on Visualization and Computer Graphics.

[9]  Han-Wei Shen,et al.  Uncertainty Visualization Using Copula-Based Analysis in Mixed Distribution Models , 2018, IEEE Transactions on Visualization and Computer Graphics.

[10]  Qing Wang,et al.  Divergence Estimation for Multidimensional Densities Via $k$-Nearest-Neighbor Distances , 2009, IEEE Transactions on Information Theory.

[11]  Hans-Christian Hege,et al.  Probabilistic Marching Cubes , 2011, Comput. Graph. Forum.

[12]  Martin J. Wainwright,et al.  Estimating Divergence Functionals and the Likelihood Ratio by Convex Risk Minimization , 2008, IEEE Transactions on Information Theory.

[13]  J. Hintze,et al.  Violin plots : A box plot-density trace synergism , 1998 .

[14]  Alfred O. Hero,et al.  Multivariate f-divergence Estimation With Confidence , 2014, NIPS.

[15]  Alexander Kumpf,et al.  Visualizing Confidence in Cluster-Based Ensemble Weather Forecast Analyses , 2020, IEEE Transactions on Visualization and Computer Graphics.

[16]  Markus Hadwiger,et al.  Ovis: A Framework for Visual Analysisof Ocean Forecast Ensembles , 2014, IEEE Transactions on Visualization and Computer Graphics.

[17]  Ross T. Whitaker,et al.  Contour Boxplots: A Method for Characterizing Uncertainty in Feature Sets from Simulation Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.

[18]  Andrew Zisserman,et al.  Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps , 2013, ICLR.

[19]  Xiaotong Liu,et al.  Multi-Resolution Climate Ensemble Parameter Analysis with Nested Parallel Coordinates Plots , 2017, IEEE Transactions on Visualization and Computer Graphics.

[20]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[21]  Alireza Entezari,et al.  Uncertainty Quantification in Linear Interpolation for Isosurface Extraction , 2013, IEEE Transactions on Visualization and Computer Graphics.

[22]  Andrew Mercer,et al.  Uncertainty-Aware Multidimensional Ensemble Data Visualization and Exploration , 2015, IEEE Transactions on Visualization and Computer Graphics.

[23]  Rüdiger Westermann,et al.  Time-Hierarchical Clustering and Visualization of Weather Forecast Ensembles , 2017, IEEE Transactions on Visualization and Computer Graphics.

[24]  Ross T. Whitaker,et al.  Curve Boxplot: Generalization of Boxplot for Ensembles of Curves , 2014, IEEE Transactions on Visualization and Computer Graphics.

[25]  P. Diggle,et al.  Analysis of Longitudinal Data , 2003 .

[26]  Mukund Raj,et al.  Evaluating Shape Alignment via Ensemble Visualization , 2016, IEEE Computer Graphics and Applications.

[27]  Kenneth I. Joy,et al.  Characterizing and Visualizing Predictive Uncertainty in Numerical Ensembles Through Bayesian Model Averaging , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  Kenneth I. Joy,et al.  Comparative Visual Analysis of Lagrangian Transport in CFD Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.

[29]  Kenneth I. Joy,et al.  Future Challenges for Ensemble Visualization , 2014, IEEE Computer Graphics and Applications.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Hans-Christian Hege,et al.  Nonparametric Models for Uncertainty Visualization , 2013, Comput. Graph. Forum.

[32]  Andrew Mercer,et al.  Noodles: A Tool for Visualization of Numerical Weather Model Ensemble Uncertainty , 2010, IEEE Transactions on Visualization and Computer Graphics.

[33]  Hans-Christian Hege,et al.  Positional Uncertainty of Isocontours: Condition Analysis and Probabilistic Measures , 2011, IEEE Transactions on Visualization and Computer Graphics.

[34]  Hanqi Guo,et al.  Finite-Time Lyapunov Exponents and Lagrangian Coherent Structures in Uncertain Unsteady Flows , 2016, IEEE Transactions on Visualization and Computer Graphics.

[35]  Alireza Entezari,et al.  A Statistical Direct Volume Rendering Framework for Visualization of Uncertain Data , 2017, IEEE Transactions on Visualization and Computer Graphics.

[36]  A. Müller Integral Probability Metrics and Their Generating Classes of Functions , 1997, Advances in Applied Probability.

[37]  Daniel Weiskopf,et al.  Flow Radar Glyphs—Static Visualization of Unsteady Flow with Uncertainty , 2011, IEEE Transactions on Visualization and Computer Graphics.

[38]  Han-Wei Shen,et al.  Distribution Driven Extraction and Tracking of Features for Time-varying Data Analysis , 2016, IEEE Transactions on Visualization and Computer Graphics.

[39]  Christopher G. Healey,et al.  Exploring ensemble visualization , 2012, Visualization and Data Analysis.

[40]  Rüdiger Westermann,et al.  Visual Analysis of Spatial Variability and Global Correlations in Ensembles of Iso‐Contours , 2016, Comput. Graph. Forum.

[41]  Han-Wei Shen,et al.  In Situ Distribution Guided Analysis and Visualization of Transonic Jet Engine Simulations , 2017, IEEE Transactions on Visualization and Computer Graphics.

[42]  Doris Dransch,et al.  Visual Analytics for Correlation‐Based Comparison of Time Series Ensembles , 2015, Comput. Graph. Forum.

[43]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[44]  Helwig Hauser,et al.  Accepted for Publication in Ieee Transactions on Visualization and Computer Graphics, Authors' Personal Copy 1 Interactive Visual Analysis of Heterogeneous Scientific Data across an Interface , 2022 .