Image identification and estimation using the maximum entropy principle

Abstract Image identification and estimation using a reduced update Kalman filter (RUKF) requires that a model for the generating process is available. In (Kaufman, H.,Woods, J.W., Dravida, S., Tekalp, A.M., 1983. IEEE Trans. Automat. Control AC-28 (7)), a RUKF was used for image pixel density estimation using a 2D autoregressive model (AR) and for blurred image restoration (Koch, S., Kaufman, H., Biemond, J., 1995. IEEE Trans. Image Process. 4 (4), 520–523). However, in (Kaufman et al., 1983) , the AR model order and the measurement noise covariance were assumed to be known a priori. Recently, in (Kadaba, S.R., Gelfand, S.B., Kashyap, R.L., 1998. IEEE Trans. Image Process. 7 (10), 1439–1452) the authors proposed a recursive estimation algorithm for images using non-gaussian AR models. They supposed, like in (Kaufman et al., 1983) , that the measurement noise covariance and the model order were a priori known. Also, the process noise density, which may be non-gaussian, is assumed to be known. In the present work, image identification and estimation using a RUKF is reconsidered. No a priori information concerning the model order, the measurement noise covariance is needed. They are determined according to the maximum entropy principle (MEP) using an exhaustive search algorithm. It is shown that the estimation error with maximum entropy corresponds to the minimum mean squared error (MSE) giving the true model order and for the true noise covariance. Experimental results on simulated and real images are given to illustrate the performance of the proposed approach.

[1]  N. Nahi Role of recursive estimation in statistical image enhancement , 1972 .

[2]  John W. Woods,et al.  Image Estimation Using Doubly Stochastic Gaussian Random Field Models , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Alexander A. Sawchuk,et al.  Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Wen-Rong Wu,et al.  Image restoration using fast modified reduced update Kalman filter , 1990, 1990 IEEE International Conference on Systems Engineering.

[5]  Brahim Aksasse,et al.  Two-dimensional autoregressive (2-D AR) model order estimation , 1999, IEEE Trans. Signal Process..

[6]  Murali Tummala New algorithm for solving block matrix equations with applications in 2-D AR spectral estimation , 1991, IEEE Trans. Signal Process..

[7]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[8]  S. Rajala,et al.  Adaptive nonlinear image restoration by a modified Kalman filtering approach , 1981 .

[9]  E. Jaynes On the rationale of maximum-entropy methods , 1982, Proceedings of the IEEE.

[10]  Jan M. Van Campenhout,et al.  Maximum entropy and conditional probability , 1981, IEEE Trans. Inf. Theory.

[11]  J. Cadzow,et al.  Singular-value decomposition approach to time series modelling , 1983 .

[12]  P. Kiernan Two-dimensional AR spectral estimation using a two-dimensional minimum free energy method , 1995, IEEE Trans. Signal Process..

[13]  H. R. Keshavan,et al.  Enhancement of Noisy Images Using an Interpolative Model in Two Dimensions , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Xinhua Zhuang,et al.  Maximum entropy image reconstruction , 1991, IEEE Trans. Signal Process..

[15]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[16]  H. Akaike A new look at the statistical model identification , 1974 .

[17]  Hassan Qjidaa,et al.  Robust Line Fitting in a Noisy Image by the Method of Moments , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Brahim Aksasse,et al.  A rank test based approach to order estimation. I. 2-D AR models application , 1999, IEEE Trans. Signal Process..

[19]  Rangasami L. Kashyap,et al.  Recursive estimation of images using non-Gaussian autoregressive models , 1998, IEEE Trans. Image Process..

[20]  Alf J. Isaksson,et al.  Frequency domain accuracy of identified 2-D causal AR-models , 1994, IEEE Trans. Signal Process..

[21]  Howard Kaufman,et al.  Restoration of spatially varying blurred images using multiple model-based extended Kalman filters , 1995, IEEE Trans. Image Process..