A hierarchical Bayesian-map approach to computational imaging

We present a novel approach to inverse problems in imaging based on a Hierarchical Bayesian-MAP (HB-MAP) formulation. In this paper we specifically focus on the difficult and basic inverse problem of multi-sensor (tomographic) imaging wherein the source image of interest is viewed from multiple directions by independent sensors. We employ a Probabilistic Graphical Modeling extension of the Compound Gaussian (CG) distribution as a global image prior into a Hierarchical Bayesian inference procedure. We first demonstrate the performance of the algorithm on Monte-Carlo trials followed by empirical data involving natural (optical) images. We demonstrate how our algorithm outperforms many of the previous approaches in the literature including Filtered Back-projection (FBP) and a variety of state-of-the-art compressive sensing (CS) algorithms.

[1]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[2]  Zhifeng Zhang,et al.  Adaptive time-frequency decompositions , 1994 .

[3]  Eero P. Simoncelli Statistical models for images: compression, restoration and synthesis , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[4]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[5]  Zachary Chance,et al.  Information-theoretic structure of multistatic radar imaging , 2011, 2011 IEEE RadarCon (RADAR).

[6]  Eero P. Simoncelli,et al.  Random Cascades on Wavelet Trees and Their Use in Analyzing and Modeling Natural Images , 2001 .

[7]  Christian P. Robert,et al.  The Bayesian choice , 1994 .

[8]  R. Vershynin,et al.  Signal Recovery from Inaccurate and Incomplete Measurements via Regularized Orthogonal Matching Pursuit , 2010 .

[9]  B. Borden,et al.  Fundamentals of Radar Imaging , 2009 .

[10]  M. Glas,et al.  Principles of Computerized Tomographic Imaging , 2000 .

[11]  Jerry Nedelman,et al.  Book review: “Bayesian Data Analysis,” Second Edition by A. Gelman, J.B. Carlin, H.S. Stern, and D.B. Rubin Chapman & Hall/CRC, 2004 , 2005, Comput. Stat..

[12]  J.-L. Starck,et al.  Astronomical image and signal processing: looking at noise, information and scale , 2001, IEEE Signal Processing Magazine.

[13]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[14]  S. Mallat A wavelet tour of signal processing , 1998 .

[15]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[16]  Mark A. Richards,et al.  Fundamentals of Radar Signal Processing , 2005 .

[17]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[18]  Christian P. Robert,et al.  The Bayesian choice : from decision-theoretic foundations to computational implementation , 2007 .

[19]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[20]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[21]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[22]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[23]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[24]  D. Munson,et al.  A tomographic formulation of spotlight-mode synthetic aperture radar , 1983, Proceedings of the IEEE.

[25]  Darrell A. Turkington Matrix Calculus and Zero-One Matrices , 2005 .

[26]  Stéphane Mallat,et al.  A Wavelet Tour of Signal Processing, 2nd Edition , 1999 .

[27]  Heather Bourbeau Greed Is Good , 2004 .

[28]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[29]  Darrell A. Turkington Matrix Calculus and Zero-One Matrices: Statistical and Econometric Applications , 2001 .

[30]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[31]  A. C. Bovik,et al.  A nonlinear compound representation of sea clutter , 2012, 2012 IEEE Radar Conference.

[32]  Sarah Eichmann,et al.  The Radon Transform And Some Of Its Applications , 2016 .

[33]  Deanna Needell,et al.  Signal Recovery From Incomplete and Inaccurate Measurements Via Regularized Orthogonal Matching Pursuit , 2007, IEEE Journal of Selected Topics in Signal Processing.

[34]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[35]  Venkat Chandrasekaran,et al.  Estimation in Gaussian Graphical Models Using Tractable Subgraphs: A Walk-Sum Analysis , 2008, IEEE Transactions on Signal Processing.

[36]  A. Willsky Multiresolution Markov models for signal and image processing , 2002, Proc. IEEE.

[37]  Devavrat Shah,et al.  Message Passing for Maximum Weight Independent Set , 2008, IEEE Transactions on Information Theory.

[38]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[39]  Martin J. Wainwright,et al.  Scale Mixtures of Gaussians and the Statistics of Natural Images , 1999, NIPS.

[40]  James O. Berger,et al.  Statistical Decision Theory and Bayesian Analysis, Second Edition , 1985 .

[41]  J. G. Gander,et al.  An introduction to signal detection and estimation , 1990 .

[42]  Raghu G. Raj,et al.  SAR Automatic Target Recognition Using Discriminative Graphical Models , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[43]  Christian Borgs,et al.  Belief Propagation for Weighted b-Matchings on Arbitrary Graphs and its Relation to Linear Programs with Integer Solutions , 2007, SIAM J. Discret. Math..

[44]  Joel A. Tropp,et al.  Just relax: convex programming methods for identifying sparse signals in noise , 2006, IEEE Transactions on Information Theory.

[45]  A. TroppJ. Greed is good , 2006 .

[46]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[47]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[48]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.