Management and Analysis of Large Scientific Datasets

The method of empirical eigenfunctions (Karhunen-Loève procedure) is developed within a framework suitable for dealing with large scientific datasets. It is shown that this furnishes an intrinsic representation of any given database which is always, in a well-defined mathematical sense, the optimal description. The methodology is illustrated by a variety of examples, arising out of current research and taken from pattern recognition, turbulent flow, physiology, and oceanographic flow. In each instance examples of the empirical eigenfunctions are presented.

[1]  D. Ts'o,et al.  Cortical functional architecture and local coupling between neuronal activity and the microcirculation revealed by in vivo high-resolution optical imaging of intrinsic signals. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[2]  H. Harman.  Modern factor analysis , 1961 .

[3]  R. Courant,et al.  Methods of Mathematical Physics , 1962 .

[4]  V. A. Krasil’nikov,et al.  Atmospheric turbulence and radio-wave propagation , 1962 .

[5]  S. Balachandar,et al.  Numerical simulation of high Rayleigh number convection , 1989 .

[6]  L. Sirovich,et al.  Optimal low-dimensional dynamical approximations , 1990 .

[7]  Gene H. Golub,et al.  Matrix computations , 1983 .

[8]  Lawrence Sirovich,et al.  Turbulent thermal convection in a finite domain: Part II. Numerical results , 1990 .

[9]  Tony F. Chan,et al.  An Improved Algorithm for Computing the Singular Value Decomposition , 1982, TOMS.

[10]  Satosi Watanabe,et al.  Knowing and guessing , 1969 .

[11]  A. Pipkin,et al.  A Course on Integral Equations , 1991 .

[12]  L. Sirovich.  Chaotic dynamics of coherent structures , 1989 .

[13]  Lawrence Sirovich,et al.  The use of the Karhunen-Loegve procedure for the calculation of linear Eigenfunctions , 1991 .

[14]  Nadine Aubry,et al.  Spatiotemporal analysis of complex signals: Theory and applications , 1991 .

[15]  C. Moler,et al.  Singular Value Analysis of Cryptograms , 1983 .

[16]  Amiram Grinvald,et al.  Iso-orientation domains in cat visual cortex are arranged in pinwheel-like patterns , 1991, Nature.

[17]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[18]  T. Wiesel,et al.  Functional architecture of cortex revealed by optical imaging of intrinsic signals , 1986, Nature.

[19]  Michel Loève,et al.  Probability Theory I , 1977 .

[20]  G. Stewart,et al.  Matrix Perturbation Theory , 1990 .

[21]  E. Schmidt.  Zur Theorie der linearen und nichtlinearen Integralgleichungen , 1907 .

[22]  L. Sirovich,et al.  Plane waves and structures in turbulent channel flow , 1990 .

[23]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[24]  L. Sirovich.  Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[25]  Lawrence Sirovich,et al.  Turbulent thermal convection in a finite domain: Part I. Theory , 1990 .

[26]  Lawrence Sirovich,et al.  Low-dimensional dynamics for the complex Ginzburg-Landau equation , 1990 .

[27]  Lawrence Sirovich,et al.  An Eigenfunction Analysis of Turbulent Thermal Convection , 1989 .

[28]  Lawrence Sirovich,et al.  Application of the Karhunen-Loeve Procedure for the Characterization of Human Faces , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  M. Karplus,et al.  Proteins: A Theoretical Perspective of Dynamics, Structure, and Thermodynamics , 1988 .

[30]  S. Balachandar,et al.  Simulations of turbulent thermal convection , 1989 .

[31]  Lawrence Sirovich,et al.  Two boundary value problems for the Ginzburg-Landau equation , 1990 .

[32]  L. Sirovich,et al.  Coherent structures and chaos: A model problem , 1987 .

[33]  Lawrence Sirovich,et al.  LOW DIMENSIONAL DESCRIPTION OF COMPLICATED PHENOMENA , 1988 .

[34]  L. Sirovich.  Empirical Eigenfunctions and Low Dimensional Systems , 1991 .

[35]  Lawrence Sirovich,et al.  Eigenfunction analysis of turbulent mixing phenomena , 1991 .

[36]  L. Sirovich.  Analysis of turbulent flows by means of the empirical eigenfunctions , 1991 .

[37]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[38]  R. Preisendorfer,et al.  Principal Component Analysis in Meteorology and Oceanography , 1988 .