Visualizing differences in movies of cortical activity

This paper discusses techniques for visualizing structure in video data and other data sets that represent time snapshots of physical phenomena. Individual frames of a movie are treated as vectors and projected onto a low-dimensional subspace spanned by principal components. Movies can be compared and their differences visualized by analyzing the nature of the subspace and the projections of multiple movies onto the same subspace. The approach is demonstrated on an application in neurobiology in which the electrical response of a visual cortex to optical stimulation is imaged onto a high-speed photodiode array to produce a cortical movie. Techniques for sampling movies over a single trial and multiple trials are discussed. The approach provides the traditional benefits of principal component analysis (compression, noise reduction and classification) and also allows the visual separation of spatial and temporal behavior.

[1]  Simone Santini,et al.  In search of information in visual media , 1997, CACM.

[2]  G. W. Stewart,et al.  On the Early History of the Singular Value Decomposition , 1993, SIAM Rev..

[3]  Lawrence Sirovich,et al.  Management and Analysis of Large Scientific Datasets , 1992 .

[4]  Steve Bryson,et al.  An extensible interactive visualization framework for the virtual windtunnel , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[5]  J.X. Chen,et al.  Advancing Interactive Visualization and Computational Steering , 1996, IEEE Computational Science and Engineering.

[6]  Wolfgang Effelsberg,et al.  Abstracting Digital Movies Automatically , 1996, J. Vis. Commun. Image Represent..

[7]  Michael Gorman,et al.  Cellular pattern formation in circular domains. , 1997, Chaos.

[8]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[10]  D. Senseman,et al.  Correspondence between visually evoked voltage-sensitive dye signals and synaptic activity recorded in cortical pyramidal cells with intracellular microelectrodes , 1996, Visual Neuroscience.

[11]  Gemunu H. Gunaratne,et al.  Karhunen-Loève analysis of spatiotemporal flame patterns , 1998 .

[12]  Michael E. Papka,et al.  Interactive virtual reality in simulations: exploring lag time , 1996 .

[13]  E. Schmidt.  Zur Theorie der linearen und nichtlinearen Integralgleichungen , 1907 .

[14]  Wilfrid Lefer,et al.  The motion map: efficient computation of steady flow animations , 1997 .

[15]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[16]  Juha Karhunen,et al.  Nonlinear PCA type approaches for source separation and independent component analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[17]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[18]  L. Sirovich,et al.  Modeling the functional organization of the visual cortex , 1996 .

[19]  L Sirovich,et al.  Low-dimensional procedure for the characterization of human faces. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[20]  Michael Dellnitz,et al.  Symmetry of attractors and the Karhunen-Loegve decomposition , 1994 .

[21]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.