Managing Big Data for Scientific Visualization

Many areas of endeavor have problems with big data. Some classical business applications have faced big data for some time (e.g. airline reservation systems), and newer business applications to exploit big data are under construction (e.g. data warehouses, federations of databases). While engineering and scientific visualization have also faced the problem for some time, solutions are less well developed, and common techniques are less well understood. In this section we offer some structure to understand what has been done to manage big data for engineering and scientific visualization, and to understand and go forward in areas that may prove fruitful. With this structure as backdrop, we discuss the work that has been done in management of big data, as well as our own work on demand-paged segments for fluid flow visualization.

[1]  Steve Bryson,et al.  The virtual wind tunnel , 1992, IEEE Computer Graphics and Applications.

[2]  Bruce Lucas,et al.  A data model for scientific visualization with provisions for regular and irregular grids , 1991, Proceeding Visualization '91.

[3]  Michael Cox,et al.  Application-controlled demand paging for out-of-core visualization , 1997 .

[4]  Kevin P. McAuliffe,et al.  An architecture for a scientific visualization system , 1992, Proceedings Visualization '92.

[5]  Alex T. Pang,et al.  Mix&Match: a construction kit for visualization , 1994, Proceedings Visualization '94.

[6]  Steve Bryson,et al.  FEL: the Field Encapsulation Library , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[7]  David R. Cheriton,et al.  Application-controlled physical memory using external page-cache management , 1992, ASPLOS V.

[8]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[9]  Carlo H. Séquin,et al.  Database and display algorithms for interactive visualization of architectural models , 1993 .

[10]  David A. Lane UFAT-a particle tracer for time-dependent flow fields , 1994, Proceedings Visualization '94.

[11]  John L. Pfaltz,et al.  Scientific Database Management (Panel Reports and Supporting Material) , 1990 .

[12]  Zahid Ahmed,et al.  Bridging the gap between visualization and data management: A simple visualization management system , 1993, Proceedings Visualization '93.

[13]  Jennifer Widom,et al.  Research problems in data warehousing , 1995, CIKM '95.

[14]  Koji Koyamada,et al.  Isosurface generation by using extrema graphs , 1994, Proceedings Visualization '94.

[15]  D. Scott Dyer,et al.  A dataflow toolkit for visualization , 1990, IEEE Computer Graphics and Applications.

[16]  Michael Stonebraker,et al.  Tioga: A database-oriented visualization tool , 1993, Proceedings Visualization '93.

[17]  Ulrich Neumann Parallel volume-rendering algorithm performance on mesh-connected multicomputers , 1993 .

[18]  Kwan-Liu Ma,et al.  Out-of-Core Streamline Visualization on Large Unstructured Meshes , 1997, IEEE Trans. Vis. Comput. Graph..

[19]  Charles R. Dyer,et al.  Display of scientific data structures for algorithm visualization , 1992, Proceedings Visualization '92.

[20]  David H. Laidlaw,et al.  The application visualization system: a computational environment for scientific visualization , 1989, IEEE Computer Graphics and Applications.

[21]  Kai Hwang,et al.  Computer architecture and parallel processing , 1984, McGraw-Hill Series in computer organization and architecture.

[22]  Eric J. Golin,et al.  Fine-grain visualization algorithms in dataflow environments , 1993, Proceedings Visualization '93.

[23]  Georges G. Grinstein,et al.  An architecture for retaining and analyzing visual explorations of databases , 1995, Proceedings Visualization '95.

[24]  Marti A. Hearst TileBars: visualization of term distribution information in full text information access , 1995, CHI '95.

[25]  David C. Banks,et al.  Vortex tubes in turbulent flows: identification, representation, reconstruction , 1994, Proceedings Visualization '94.