Slycat Ensemble Analysis of Electrical Circuit Simulations

An ensemble is a group of related simulation runs, each consisting of the same set of variables, in a shared high-dimensional space describing a particular problem domain. Ensemble analysis looks at the combined behaviors and features of the simulations to discover higher-level patterns that describe aspects of the underlying problem space. Sensitivity analysis is a type of ensemble analysis that evaluates how changes in simulation input parameters correlate with simulation results. Commonly, simple regression and multiple regression techniques are used to correlate single inputs to single outputs, or groups of inputs to a single output, respectively. However, neither of these approaches evaluates the collective relationships among multiple inputs and outputs. Existing visualization tools are fundamentally designed to view no more than a few simulations in combination. Ensembles containing hundreds or thousands of simulations require a different type of analysis, different visual abstractions, and a different system architecture to effectively manage integrating so many results. We present Slycat, a scalable, collaborative, remote analysis and visualization system designed for ensemble analysis. Slycat uses Canonical Correlation Analysis (CCA) to model relationships between input and output variables, providing a generalized correlation capability that analyzes any variable subsets from the two variable groups. Using linked views, we provide multiple representations of the CCA results for an ensemble, each showing the results at a different level of abstraction. The tight integration of analysis and visualization allows analysts to iteratively explore their data, forming and testing hypotheses about how simulation input parameters are driving output results in their ensembles. We provide two real-life examples using electrical circuit simulation ensembles of differing scales to demonstrate Slycat’s utility in answering common analysis questions. Slycat is available under an open source license through github.

[1]  C. Marzban,et al.  Model Tuning with Canonical Correlation Analysis , 2014 .

[2]  Andrew T. Wilson,et al.  Toward visual analysis of ensemble data sets , 2009, UltraVis '09.

[3]  Eric R. Keiter,et al.  Electrical modeling and simulation for stockpile stewardship , 2013, XRDS.

[4]  Jun Zhang,et al.  Sensitivity Analysis of a large-scale system dynamics immigration model , 2010, 2010 IEEE Systems and Information Engineering Design Symposium.

[5]  Brian Everitt,et al.  Principles of Multivariate Analysis , 2001 .

[6]  David C. Banks,et al.  Clustered Ensemble Averaging: A Technique for Visualizing Qualitative Features of , 2006 .

[7]  Kenneth I. Joy,et al.  Comparative Visual Analysis of Lagrangian Transport in CFD Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.

[8]  Gillian A. Burrington,et al.  A User's Perspective , 2007, Libr. Trends.

[9]  Andrew T. Wilson,et al.  Visualization of uncertainty and ensemble data: Exploration of climate modeling and weather forecast data with integrated ViSUS-CDAT systems , 2009 .

[10]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[11]  Eduard Gröller,et al.  World Lines , 2010, IEEE Transactions on Visualization and Computer Graphics.

[12]  Juha Karhunen,et al.  Finding dependent and independent components from related data sets: A generalized canonical correlation analysis based method , 2013, Neurocomputing.

[13]  Kwan-Liu Ma,et al.  Correlation study of time-varying multivariate climate data sets , 2009, 2009 IEEE Pacific Visualization Symposium.

[14]  Andrew Mercer,et al.  Noodles: A Tool for Visualization of Numerical Weather Model Ensemble Uncertainty , 2010, IEEE Transactions on Visualization and Computer Graphics.

[15]  Asaf Degani,et al.  Canonical Correlation Analysis: Use of Composite Heliographs for Representing Multiple Patterns , 2006, Diagrams.

[16]  Valerio Pascucci,et al.  Ensemble-Vis: A Framework for the Statistical Visualization of Ensemble Data , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[17]  Wolfgang Berger,et al.  Comparative Visual Analysis of 2D Function Ensembles , 2012, Comput. Graph. Forum.

[18]  Michael S. Eldred,et al.  DAKOTA , A Multilevel Parallel Object-Oriented Framework for Design Optimization , Parameter Estimation , Uncertainty Quantification , and Sensitivity Analysis Version 4 . 0 User ’ s Manual , 2006 .

[19]  Michael S. Eldred,et al.  DAKOTA, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis Version 3.0 Developers Manual (title change from electronic posting) , 2002 .

[20]  Stefan Bruckner,et al.  Result-Driven Exploration of Simulation Parameter Spaces for Visual Effects Design , 2010, IEEE Transactions on Visualization and Computer Graphics.

[21]  Michael S. Eldred,et al.  DAKOTA : a multilevel parallel object-oriented framework for design optimization, parameter estimation, uncertainty quantification, and sensitivity analysis. Version 5.0, user's reference manual. , 2010 .

[22]  Hongya Ge,et al.  Does canonical correlation analysis provide reliable information on data correlation in array processing? , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Denis Gracanin,et al.  Interactive Visual Analysis of Multiple Simulation Runs Using the Simulation Model View: Understanding and Tuning of an Electronic Unit Injector , 2010, IEEE Transactions on Visualization and Computer Graphics.

[24]  James J. Filliben,et al.  An Efficient Sensitivity Analysis Method for Large Cloud Simulations , 2011, IEEE CLOUD.

[25]  M. B. Abdelhalim,et al.  Hybrid Latin Hypercube Designs , 2010, 2010 The 7th International Conference on Informatics and Systems (INFOS).

[26]  Gang Zhao,et al.  Sensitivity analysis for a forest growth model: A statistical and time-dependent point of view , 2012, 2012 IEEE 4th International Symposium on Plant Growth Modeling, Simulation, Visualization and Applications.

[27]  Eduard Gröller,et al.  Nodes on Ropes: A Comprehensive Data and Control Flow for Steering Ensemble Simulations , 2011, IEEE Transactions on Visualization and Computer Graphics.

[28]  Kenneth Moreland,et al.  Diverging Color Maps for Scientific Visualization , 2009, ISVC.

[29]  Hans Knutsson,et al.  Learning multidimensional signal processing , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[30]  Peter E. Thornton,et al.  Big data visual analytics for exploratory earth system simulation analysis , 2013, Comput. Geosci..

[31]  J. Schmee An Introduction to Multivariate Statistical Analysis , 1986 .

[32]  Daniel F. Keefe,et al.  Design by Dragging: An Interface for Creative Forward and Inverse Design with Simulation Ensembles , 2013, IEEE Transactions on Visualization and Computer Graphics.