Telescoping Recursive Representations and Estimation of Gauss–Markov Random Fields

We present telescoping recursive representations for both continuous and discrete indexed noncausal Gauss-Markov random fields. Our recursions start at the boundary (a hypersurface in ) and telescope inwards. For example, for images, the telescoping representation reduce recursions from to , i.e., to recursions on a single dimension. Under appropriate conditions, the recursions for the random field are linear stochastic differential/difference equations driven by white noise, for which we derive recursive estimation algorithms, that extend standard algorithms, like the Kalman-Bucy filter and the Rauch-Tung-Striebel smoother, to noncausal Markov random fields.

[1]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[2]  Giorgio Picci,et al.  Minimal realization and dynamic properties of optimal smoothers , 2000, IEEE Trans. Autom. Control..

[3]  L. Pitt A Markov property for Gaussian processes with a multidimensional parameter , 1971 .

[4]  A. Bagchi,et al.  Smoothing and likelihood ratio for Gaussian boundary value processes , 1989 .

[5]  Bernard C. Levy,et al.  Principles of Signal Detection and Parameter Estimation , 2008 .

[6]  Ruggero Frezza,et al.  Gaussian reciprocal processes and self-adjoint stochastic differential equations of second order , 1991 .

[7]  Pi,et al.  A Stochastic Realization Approach to the Smoothing Problem , .

[8]  José M. F. Moura,et al.  Reciprocal fields: A model for random fields pinned to two boundaries , 2010, 49th IEEE Conference on Decision and Control (CDC).

[9]  P. Levy A Special Problem of Brownian Motion, and a General Theory of Gaussian Random Functions , 1956 .

[10]  L. Milne‐Thomson A Treatise on the Theory of Bessel Functions , 1945, Nature.

[11]  Thomas Kailath,et al.  A further note on backwards Markovian models (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[12]  Bernard C. Levy,et al.  Characterization of Multivariate Stationary Gaussian Reciprocal Diffusions , 1997 .

[13]  John K. Goutsias,et al.  Mutually compatible Gibbs random fields , 1989, IEEE Trans. Inf. Theory.

[14]  Anil K. Jain,et al.  A Semicausal Model for Recursive Filtering of Two-Dimensional Images , 1977, IEEE Transactions on Computers.

[15]  C. Striebel,et al.  On the maximum likelihood estimates for linear dynamic systems , 1965 .

[16]  José M. F. Moura,et al.  Graphical Models as Block-Tree Graphs , 2010, ArXiv.

[17]  M. Frydenberg The chain graph Markov property , 1990 .

[18]  John W. Woods,et al.  Two-dimensional discrete Markovian fields , 1972, IEEE Trans. Inf. Theory.

[19]  A. Krener,et al.  Modeling and estimation of discrete-time Gaussian reciprocal processes , 1990 .

[20]  Laveen N. Kanal,et al.  Classification of binary random patterns , 1965, IEEE Trans. Inf. Theory.

[21]  L. Held,et al.  Gaussian Markov Random Fields: Theory And Applications (Monographs on Statistics and Applied Probability) , 2005 .

[22]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[23]  E. Wong Two-Dimensional Random Fields and Representation of Images , 1968 .

[24]  José M. F. Moura,et al.  A telescoping approach to recursive enhancement of noisy images , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  G. A. Watson A treatise on the theory of Bessel functions , 1944 .

[26]  Erik H. Vanmarcke,et al.  Random Fields: Analysis and Synthesis. , 1985 .

[27]  Eugene Wong,et al.  Recursive linear smoothing of two-dimensional random fields , 1981, IEEE Trans. Inf. Theory.

[28]  D. K. Pickard A curious binary lattice process , 1977, Journal of Applied Probability.

[29]  José M. F. Moura,et al.  Gauss-Markov random fields (CMrf) with continuous indices , 1997, IEEE Trans. Inf. Theory.

[30]  Michael I. Jordan Graphical Models , 1998 .

[31]  Arthur J. Krener,et al.  Realizations of reciprocal processes , 1988 .

[32]  A. Habibi Two-dimensional Bayesian estimate of images , 1972 .

[33]  Nikhil Balram,et al.  Recursive structure of noncausal Gauss-Markov random fields , 1992, IEEE Trans. Inf. Theory.

[34]  T. Marzetta Two-dimensional linear prediction: Autocorrelation arrays, minimum-phase prediction error filters, and reflection coefficient arrays , 1980 .

[35]  Ali H. Sayed,et al.  Generalized Chandrasekhar recursions from the generalized Schur algorithm , 1994, IEEE Trans. Autom. Control..

[36]  J. P. McKean Brownian Motion with a Several-Dimensional Time , 1963 .

[37]  Francesca P. Carli,et al.  Modelling and Simulation of Images by Reciprocal Processes , 2008, Tenth International Conference on Computer Modeling and Simulation (uksim 2008).

[38]  Ahmed H. Tewfik,et al.  Internal models and recursive estimation for 2-D isotropic random fields , 1991, IEEE Trans. Inf. Theory.

[39]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[40]  Alessandro Beghi,et al.  Continuous-time Gauss-Markov processes with fixed reciprocal dynamics , 1997 .

[41]  Michael I. Jordan,et al.  Graphical Models, Exponential Families, and Variational Inference , 2008, Found. Trends Mach. Learn..

[42]  K. Åström Introduction to Stochastic Control Theory , 1970 .

[43]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[44]  B. Jamison,et al.  Reciprocal Processes: The Stationary Gaussian Case , 1970 .

[45]  H. Weinert,et al.  A new characterization for multivariate Gaussian reciprocal processes , 1993, IEEE Trans. Autom. Control..

[46]  Stefan Friedrich,et al.  Topology , 2019, Arch. Formal Proofs.

[47]  T. Speed,et al.  Gaussian Markov Distributions over Finite Graphs , 1986 .

[48]  B. Øksendal Stochastic differential equations : an introduction with applications , 1987 .

[49]  Virginia L. Stonick,et al.  On a natural homotopy between linear and nonlinear single-layer networks , 1996, IEEE Trans. Neural Networks.

[50]  A. Willsky,et al.  Solution and linear estimation of 2-D nearest-neighbor models , 1990 .

[51]  P. Whittle ON STATIONARY PROCESSES IN THE PLANE , 1954 .

[52]  Lang Tong,et al.  Detection error exponent for spatially dependent samples in random networks , 2009, 2009 IEEE International Symposium on Information Theory.

[53]  H. Künsch Gaussian Markov random fields , 1979 .

[54]  H. Vincent Poor,et al.  How Much Information Can One Get From a Wireless Ad Hoc Sensor Network Over a Correlated Random Field? , 2009, IEEE Transactions on Information Theory.

[55]  John M. Watts,et al.  Analysis and synthesis , 1985 .

[56]  JOHN w. WOODS,et al.  Kalman filtering in two dimensions , 1977, IEEE Trans. Inf. Theory.

[57]  A. Willsky,et al.  Linear estimation of boundary value stochastic processes-- Part I: The role and construction of complementary models , 1984 .

[58]  A. Lindquist,et al.  A Stochastic Realization Approach to the Smoothing Problem. Revised. , 1979 .

[59]  BERNARD C. LEVY,et al.  Characterization of Stationary Discrete-Time Gaussian Reciprocal Processes over a Finite Interval , 2002, SIAM J. Matrix Anal. Appl..