Graph-based visual analysis for large-scale hydrological modeling

This article reports on the development and application of a visual analytics approach to big data cleaning and integration focused on very large graphs, constructed in support of national-scale hydrological modeling. We explain why large graphs are required for hydrology modeling and describe how we create two graphs using continental United States heterogeneous national data products. The first smaller graph is constructed by assigning level-12 hydrological unit code watersheds as nodes. Creating and cleaning graphs at this scale highlight the issues that cannot be addressed without high-resolution datasets and expert intervention. Expert intervention, aided with visual analytical tools, is necessary to address edge directions at the second graph scale: subdividing continental United States streams as edges (851,265,305) and nodes (683,298,991) for large-scale hydrological modeling. We demonstrate how large graph workflows are created and are used for automated analysis to prepare the user interface for visual analytics. We explain the design of the visual interface using a watershed case study and then discuss how the visual interface is used to engage the expert user to resolve data and graph issues.

[1]  A. House Physical Hydrology , 2015 .

[2]  Kwan-Liu Ma,et al.  Large-Scale Graph Visualization and Analytics , 2013, Computer.

[3]  Alva L. Couch,et al.  HydroShare: Advancing Collaboration through Hydrologic Data and Model Sharing , 2015 .

[4]  F. P. Kapinos,et al.  Hydrologic unit maps , 1987 .

[5]  Ben Shneiderman,et al.  Designing Semantic Substrates for Visual Network Exploration , 2007, Inf. Vis..

[6]  Ben Shneiderman,et al.  Systematic yet flexible discovery: guiding domain experts through exploratory data analysis , 2008, IUI '08.

[7]  Pak Chung Wong,et al.  Visual Matrix Clustering of Social Networks , 2013, IEEE Computer Graphics and Applications.

[8]  Christopher J. Duffy,et al.  Essential Terrestrial Variable data workflows for distributed water resources modeling , 2013, Environ. Model. Softw..

[9]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[10]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[11]  Ben Shneiderman,et al.  Dynamic queries for visual information seeking , 1994, IEEE Software.

[12]  Christopher J. Duffy,et al.  Automating data-model workflows at a level 12 HUC scale: Watershed modeling in a distributed computing environment , 2014, Environ. Model. Softw..

[13]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[14]  Jeffery S. Horsburgh,et al.  HydroShare: Sharing Diverse Environmental Data Types and Models as Social Objects with Application to the Hydrology Domain , 2016 .

[15]  Lorne Leonard HydroTerre: Towards an expert system for scaling hydrological data and models from hill-slopes to major-river basins , 2015 .

[16]  Christopher J. Duffy,et al.  Visualization workflows for level-12 HUC scales: Towards an expert system for watershed analysis in a distributed computing environment , 2016, Environ. Model. Softw..

[17]  Tamal K. Dey,et al.  Delaunay Mesh Generation , 2012, Chapman and Hall / CRC computer and information science series.

[18]  Dominique Brodbeck,et al.  Research directions in data wrangling: Visualizations and transformations for usable and credible data , 2011, Inf. Vis..

[19]  Witold F. Krajewski,et al.  Towards an integrated Flood Information System: Centralized data access, analysis, and visualization , 2013, Environ. Model. Softw..

[20]  Daniel A. Keim,et al.  Visual Analytics: Scope and Challenges , 2008, Visual Data Mining.

[21]  Christopher J. Duffy,et al.  Tuning Heterogeneous Computing Platforms for Large-Scale Hydrology Data Management , 2016, IEEE Transactions on Parallel and Distributed Systems.

[22]  Yi-Jia Chang,et al.  Inundation Mapping Initiatives of the Iowa Flood Center: Statewide Coverage and Detailed Urban Flooding Analysis , 2012 .