A Computational Approach to Fisher Information Geometry with Applications to Image Analysis

We develop a computational approach to non-parametric Fisher information geometry and algorithms to calculate geodesic paths in this geometry. Geodesics are used to quantify divergence of probability density functions and to develop tools of data analysis in information manifolds. The methodology developed is applied to several image analysis problems using a representation of textures based on the statistics of multiple spectral components. Histograms of filter responses are viewed as elements of a non-parametric statistical manifold, and local texture patterns are compared using information geometry. Appearance-based object recognition experiments, as well as region-based image segmentation experiments are carried out to test both the representation and metric. The proposed representation of textures is also applied to the development of a spectral cartoon model of images.

[1]  Anuj Srivastava,et al.  Universal Analytical Forms for Modeling Image Probabilities , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[3]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[4]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[5]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[6]  G. B. Smith,et al.  Preface to S. Geman and D. Geman, “Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images” , 1987 .

[7]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[8]  Anuj Srivastava,et al.  Statistical shape analysis: clustering, learning, and testing , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Tony F. Chan,et al.  Variational PDE models in image processing , 2002 .

[10]  Alfred O. Hero,et al.  A binary linear programming formulation of the graph edit distance , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  D. Mumford,et al.  Optimal approximations by piecewise smooth functions and associated variational problems , 1989 .

[12]  MumfordDavid,et al.  Filters, Random Fields and Maximum Entropy (FRAME) , 1998 .

[13]  Aapo Hyvärinen,et al.  Survey on Independent Component Analysis , 1999 .

[14]  Joachim M. Buhmann,et al.  Pairwise Data Clustering by Deterministic Annealing , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Xiuwen Liu,et al.  Independent spectral representations of images for recognition. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[17]  Anuj Srivastava,et al.  Analysis of planar shapes using geodesic paths on shape spaces , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  H. Karcher Riemannian center of mass and mollifier smoothing , 1977 .

[19]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  D. Mumford Elastica and Computer Vision , 1994 .

[21]  Song-Chun Zhu,et al.  Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling , 1998, International Journal of Computer Vision.

[22]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[23]  Giovanni Pistone,et al.  An Infinite-Dimensional Geometric Structure on the Space of all the Probability Measures Equivalent to a Given One , 1995 .

[24]  A. G. Flesia,et al.  Can recent innovations in harmonic analysis `explain' key findings in natural image statistics? , 2001, Network.

[25]  Song-Chun Zhu,et al.  Equivalence of Julesz Ensembles and FRAME Models , 2000, International Journal of Computer Vision.